Aug 05 10:07:29 devstack cinder-volume[77589]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 05 10:07:29 devstack cinder-volume[77589]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 05 10:07:29 devstack cinder-volume[77589]: we strongly recommend against using it for new projects. Aug 05 10:07:29 devstack cinder-volume[77589]: If you are already using Eventlet, we recommend migrating to a different Aug 05 10:07:29 devstack cinder-volume[77589]: framework. For more detail see Aug 05 10:07:29 devstack cinder-volume[77589]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 05 10:07:29 devstack cinder-volume[77589]: import eventlet # noqa Aug 05 10:07:31 devstack cinder-volume[77589]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=77589) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 05 10:07:31 devstack cinder-volume[77589]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=77589) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 05 10:07:31 devstack cinder-volume[77589]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=77589) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 05 10:07:32 devstack cinder-volume[77589]: INFO dbcounter [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] Registered counter for database cinder Aug 05 10:07:32 devstack cinder-volume[77589]: DEBUG oslo_db.sqlalchemy.engines [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77589) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG dbcounter [-] [77589] Writer thread running {{(pid=77589) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 05 10:07:33 devstack cinder-volume[77589]: INFO cinder.rpc [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 05 10:07:33 devstack cinder-volume[77589]: INFO cinder.rpc [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_db.sqlalchemy.engines [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77589) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 05 10:07:33 devstack cinder-volume[77589]: INFO cinder.volume.manager [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] Determined volume DB was empty at startup. Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG cinder.volume.manager [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=77589) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 05 10:07:33 devstack cinder-volume[77589]: INFO cinder.volume.manager [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] Service not found for updating active_backend_id, assuming default for driver init. Aug 05 10:07:33 devstack cinder-volume[77589]: WARNING stevedore.named [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 05 10:07:33 devstack cinder-volume[77589]: WARNING castellan.key_manager [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 05 10:07:33 devstack cinder-volume[77589]: WARNING cinder.keymgr.conf_key_mgr [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG cinder.volume.drivers.lvm [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=77589) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_concurrency.processutils [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=77589) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_concurrency.processutils [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] CMD "cinder-rtstool verify" returned: 0 in 0.394s {{(pid=77589) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_db.sqlalchemy.engines [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77589) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 05 10:07:33 devstack cinder-volume[77589]: INFO cinder.rpc [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Aug 05 10:07:33 devstack cinder-volume[77589]: INFO cinder.rpc [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Aug 05 10:07:33 devstack cinder-volume[77589]: WARNING stevedore.named [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 05 10:07:33 devstack cinder-volume[77589]: WARNING castellan.key_manager [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 05 10:07:33 devstack cinder-volume[77589]: INFO cinder.volume.manager [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_db.sqlalchemy.engines [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77589) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 05 10:07:33 devstack cinder-volume[77589]: INFO oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] Starting 1 workers Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] Started child 77734 {{(pid=77589) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] Full set of CONF: {{(pid=77589) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] ******************************************************************************** {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3518}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] Configuration options gathered from: {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3519}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3520}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3521}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] ================================================================================ {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3526}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] allow_availability_zone_fallback = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] allow_compression_on_image_upload = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] allowed_direct_url_schemes = [] {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] api_rate_limit = True {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] auth_strategy = keystone {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] az_cache_duration = 3600 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] backend_availability_zone = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77734]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] backend_host = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] backend_name = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] backend_stats_polling_interval = 60 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] backup_api_class = cinder.backup.api.API {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] backup_name_template = backup-%s {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] backup_use_same_host = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] backup_use_temp_snapshot = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] chap_password = **** {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] chap_username = {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] cinder_internal_tenant_project_id = 6d2fed8e7ffd410f8cbe5d4e9d2b4a18 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] cinder_internal_tenant_user_id = 28eee46bde1947bf8755d3e409ed5fec {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] cloned_volume_same_az = True {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] cluster = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] compression_format = gzip {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] compute_api_class = cinder.compute.nova.API {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] config_dir = [] {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] config_source = [] {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] control_exchange = openstack {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] debug = True {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] default_availability_zone = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] default_group_type = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] default_volume_type = lvmdriver-1 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] disk_geometry = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] driver_client_cert = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] driver_client_cert_key = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] driver_data_namespace = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] driver_ssl_cert_path = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] driver_ssl_cert_verify = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] driver_use_ssl = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] enable_force_upload = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] enable_new_services = True {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] enable_unsupported_driver = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] enabled_backends = ['lvmdriver-1'] {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] enforce_multipath_for_image_xfer = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] filter_function = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] glance_api_insecure = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] glance_api_servers = ['http://192.168.122.9/image'] {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] glance_api_ssl_compression = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] glance_ca_certificates_file = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] glance_catalog_info = image:glance:publicURL {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] glance_certfile = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] glance_keyfile = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] glance_num_retries = 3 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] glance_request_timeout = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] goodness_function = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] graceful_shutdown_timeout = 5 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] group_api_class = cinder.group.api.API {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] host = devstack {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] image_compress_on_upload = True {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] image_conversion_address_space_limit = 1 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] image_conversion_cpu_limit = 60 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] image_conversion_disable = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] image_upload_use_cinder_backend = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] image_upload_use_internal_tenant = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] image_volume_cache_enabled = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] image_volume_cache_max_count = 0 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] image_volume_cache_max_size_gb = 0 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] init_host_max_objects_retrieval = 0 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] instance_format = [instance: %(uuid)s] {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] iscsi_target_flags = {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] iscsi_write_cache = on {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] iser_helper = tgtadm {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] iser_ip_address = 192.168.122.9 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] iser_port = 3260 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] log_color = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] log_config_append = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] log_dir = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77734]: INFO cinder.volume.manager [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] Starting volume driver LVMVolumeDriver (3.0.0) Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] log_file = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] log_options = True {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] log_rotate_interval = 1 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] log_rotate_interval_type = days {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] log_rotation_type = none {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] max_age = 0 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] max_logfile_count = 30 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] max_logfile_size_mb = 200 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] max_over_subscription_ratio = 20.0 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] message_reap_interval = 86400 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] message_ttl = 2592000 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] migration_create_volume_timeout_secs = 300 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] monkey_patch = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] monkey_patch_modules = [] {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] my_ip = 192.168.122.9 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] no_snapshot_gb_quota = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] num_iser_scan_tries = 3 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] num_shell_tries = 3 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] num_volume_device_scan_tries = 3 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] nvmeof_conn_info_version = 1 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] nvmet_ns_id = 10 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] nvmet_port_id = 1 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] osapi_max_limit = 1000 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] osapi_volume_ext_list = [] {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] osapi_volume_listen = 0.0.0.0 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] osapi_volume_listen_port = 8776 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] osapi_volume_use_ssl = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] osapi_volume_workers = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] per_volume_size_limit = -1 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] periodic_fuzzy_delay = 60 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] periodic_interval = 60 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] project_id_regex = [0-9a-f\-]+ {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] public_endpoint = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] publish_errors = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] quota_backup_gigabytes = 1000 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] quota_backups = 10 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] quota_gigabytes = 1000 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] quota_groups = 10 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] quota_snapshots = 10 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] quota_volumes = 10 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] rate_limit_burst = 0 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] rate_limit_except_level = CRITICAL {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] rate_limit_interval = 0 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] reinit_driver_count = 3 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] replication_device = **** {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] report_discard_supported = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] report_interval = 120 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] reservation_clean_interval = 86400 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] reservation_expire = 86400 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] reserved_image_namespaces = [] {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] reserved_percentage = 0 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] rpc_response_timeout = 120 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] run_external_periodic_tasks = True {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] scst_target_driver = iscsi {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] scst_target_iqn_name = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] service_down_time = 720 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:07:33 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] shell_completion = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] snapshot_name_template = snapshot-%s {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] snapshot_same_host = True {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] split_loggers = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] state_path = /opt/stack/data/cinder {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] storage_availability_zone = nova {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] storage_protocol = iSCSI {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] syslog_log_facility = LOG_USER {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] target_helper = lioadm {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] target_ip_address = 192.168.122.9 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] target_port = 3260 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] target_protocol = iscsi {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] target_secondary_ip_addresses = [] {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] trace_flags = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] transfer_api_class = cinder.transfer.api.API {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] transport_url = **** {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] until_refresh = 0 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] use_chap_auth = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] use_default_quota_class = True {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] use_journal = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] use_json = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] use_multipath_for_image_xfer = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] use_stderr = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] use_syslog = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] verify_glance_signatures = enabled {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] volume_api_class = cinder.volume.api.API {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] volume_backend_name = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] volume_clear = zero {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] volume_clear_ionice = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] volume_clear_size = 0 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] volume_copy_bps_limit = 0 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] volume_dd_blocksize = 1M {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] volume_name_template = volume-%s {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] volume_service_inithost_offload = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] volume_usage_audit_period = month {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] zoning_mode = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] oslo_concurrency.disable_process_locking = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] keystone_authtoken.auth_section = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] keystone_authtoken.auth_type = password {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] keystone_authtoken.auth_version = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] keystone_authtoken.cache = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] keystone_authtoken.certfile = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] keystone_authtoken.delay_auth_decision = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] keystone_authtoken.http_connect_timeout = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:33 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:07:33 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] keystone_authtoken.include_service_catalog = True {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] keystone_authtoken.insecure = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] keystone_authtoken.interface = public {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] keystone_authtoken.keyfile = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] keystone_authtoken.memcache_password = {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] keystone_authtoken.memcache_username = {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] keystone_authtoken.region_name = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:33 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] keystone_authtoken.service_token_roles_required = True {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] keystone_authtoken.service_type = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] keystone_authtoken.token_cache_time = 300 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.9/identity {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] cache.backend = dogpile.cache.null {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] cache.backend_argument = **** {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] cache.backend_expiration_time = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] cache.config_prefix = cache.oslo {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] cache.debug_cache_backend = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] cache.enable_retry_client = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] cache.enable_socket_keepalive = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] cache.enabled = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] cache.expiration_time = 600 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] cache.hashclient_retry_attempts = 2 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] cache.memcache_dead_retry = 300 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] cache.memcache_pool_maxsize = 10 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] cache.memcache_sasl_enabled = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] cache.password = **** {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] cache.proxies = [] {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] cache.redis_db = 0 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] cache.redis_sentinel_service_name = mymaster {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] cache.redis_server = localhost:6379 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] cache.retry_attempts = 2 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] cache.retry_delay = 0.0 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] cache.socket_keepalive_count = 1 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] cache.socket_keepalive_idle = 1 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] cache.socket_keepalive_interval = 1 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] cache.socket_timeout = 1.0 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] cache.tls_allowed_ciphers = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] cache.tls_cafile = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] cache.tls_certfile = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] cache.tls_enabled = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] cache.tls_keyfile = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] cache.username = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] coordination.backend_url = **** {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] database.asyncio_connection = **** {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] database.asyncio_slave_connection = **** {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] database.backend = sqlalchemy {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] database.connection = **** {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] database.connection_debug = 0 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] database.connection_parameters = {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] database.connection_recycle_time = 3600 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] database.connection_trace = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] database.db_inc_retry_interval = True {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.038s {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] database.db_max_retries = 20 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] database.db_max_retry_interval = 10 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] database.db_retry_interval = 1 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] database.max_overflow = 50 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] database.max_pool_size = 5 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] database.max_retries = 10 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] database.mysql_wsrep_sync_wait = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] database.pool_timeout = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] database.retry_interval = 10 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] database.slave_connection = **** {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] database.sqlite_synchronous = True {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] database.synchronous_reader = True {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] database.use_db_reconnect = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] profiler.connection_string = messaging:// {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] profiler.enabled = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] profiler.es_doc_type = notification {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] profiler.es_scroll_size = 10000 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] profiler.es_scroll_time = 2m {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] profiler.filter_error_trace = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] profiler.hmac_keys = **** {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] profiler.sentinel_service_name = mymaster {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] profiler.socket_timeout = 0.1 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] profiler.trace_requests = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] profiler.trace_sqlalchemy = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] profiler_jaeger.process_tags = {} {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] profiler_jaeger.service_name_prefix = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] profiler_otlp.service_name_prefix = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] oslo_policy.enforce_new_defaults = True {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] oslo_policy.policy_default_rule = default {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] oslo_policy.policy_file = policy.yaml {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] oslo_policy.remote_timeout = 60.0 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] privsep_osbrick.group = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] privsep_osbrick.helper_command = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] privsep_osbrick.user = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] cinder_sys_admin.group = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] cinder_sys_admin.helper_command = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] cinder_sys_admin.user = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] service_user.auth_section = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] service_user.auth_type = password {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] service_user.cafile = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] service_user.certfile = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] service_user.collect_timing = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] service_user.insecure = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] service_user.keyfile = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] service_user.send_service_user_token = True {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] service_user.split_loggers = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] service_user.timeout = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] glance.auth_section = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] glance.auth_type = password {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] glance.certfile = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] glance.collect_timing = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] glance.insecure = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] glance.keyfile = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] glance.region_name = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] glance.split_loggers = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] glance.timeout = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] backend_defaults.backend_availability_zone = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] backend_defaults.chap_password = **** {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] backend_defaults.chap_username = {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] backend_defaults.disk_geometry = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] backend_defaults.driver_client_cert = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] backend_defaults.driver_client_cert_key = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] backend_defaults.driver_data_namespace = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] backend_defaults.driver_use_ssl = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] backend_defaults.enable_unsupported_driver = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] backend_defaults.extra_capabilities = {} {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] backend_defaults.filter_function = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] backend_defaults.goodness_function = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] backend_defaults.iscsi_target_flags = {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] backend_defaults.iscsi_write_cache = on {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] backend_defaults.iser_helper = tgtadm {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] backend_defaults.iser_ip_address = 192.168.122.9 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] backend_defaults.iser_port = 3260 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack sudo[77739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] backend_defaults.lvm_mirrors = 0 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] backend_defaults.lvm_share_target = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] backend_defaults.lvm_type = auto {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack sudo[77739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] backend_defaults.num_shell_tries = 3 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] backend_defaults.nvmet_port_id = 1 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] backend_defaults.replication_device = **** {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] backend_defaults.report_discard_supported = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] backend_defaults.reserved_percentage = 0 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] backend_defaults.scst_target_driver = iscsi {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] backend_defaults.scst_target_iqn_name = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] backend_defaults.storage_protocol = iSCSI {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] backend_defaults.target_helper = tgtadm {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] backend_defaults.target_ip_address = 192.168.122.9 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] backend_defaults.target_port = 3260 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] backend_defaults.target_protocol = iscsi {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] backend_defaults.trace_flags = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] backend_defaults.unique_fqdn_network = True {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] backend_defaults.use_chap_auth = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] backend_defaults.volume_backend_name = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] backend_defaults.volume_clear = zero {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] backend_defaults.volume_clear_ionice = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] backend_defaults.volume_clear_size = 0 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] backend_defaults.volume_group = cinder-volumes {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] oslo_reports.file_event_handler = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] oslo_reports.log_dir = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] lvmdriver-1.backend_availability_zone = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] lvmdriver-1.backend_host = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] lvmdriver-1.chap_password = **** {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] lvmdriver-1.chap_username = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] lvmdriver-1.chiscsi_conf = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] lvmdriver-1.disk_geometry = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] lvmdriver-1.driver_client_cert = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] lvmdriver-1.driver_data_namespace = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] lvmdriver-1.driver_use_ssl = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] lvmdriver-1.extra_capabilities = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] lvmdriver-1.filter_function = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] lvmdriver-1.goodness_function = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] lvmdriver-1.iser_helper = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] lvmdriver-1.iser_ip_address = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] lvmdriver-1.iser_port = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] lvmdriver-1.iser_target_prefix = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] lvmdriver-1.lvm_conf_file = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] lvmdriver-1.lvm_mirrors = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] lvmdriver-1.lvm_share_target = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] lvmdriver-1.lvm_type = auto {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] lvmdriver-1.num_shell_tries = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] lvmdriver-1.nvmet_port_id = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] lvmdriver-1.replication_device = **** {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] lvmdriver-1.report_discard_supported = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] lvmdriver-1.reserved_percentage = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] lvmdriver-1.scst_target_driver = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] lvmdriver-1.storage_protocol = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] lvmdriver-1.target_helper = lioadm {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] lvmdriver-1.target_ip_address = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] lvmdriver-1.target_port = 3260 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] lvmdriver-1.target_protocol = iscsi {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] lvmdriver-1.trace_flags = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] lvmdriver-1.use_chap_auth = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] lvmdriver-1.volume_clear = zero {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] lvmdriver-1.volume_clear_size = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] lvmdriver-1.volumes_dir = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] oslo_messaging_rabbit.ssl = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] oslo_messaging_rabbit.ssl_version = {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] oslo_messaging_notifications.driver = [] {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] oslo_messaging_notifications.retry = -1 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] oslo_messaging_notifications.transport_url = **** {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] key_manager.fixed_key = **** {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] barbican.barbican_api_version = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] barbican.barbican_endpoint = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] barbican.barbican_endpoint_type = public {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] barbican.barbican_region_name = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] barbican.cafile = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] barbican.certfile = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] barbican.collect_timing = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] barbican.insecure = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] barbican.keyfile = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] barbican.number_of_retries = 60 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] barbican.retry_delay = 1 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] barbican.send_service_user_token = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] barbican.split_loggers = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] barbican.timeout = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] barbican.verify_ssl = True {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] barbican.verify_ssl_path = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] barbican_service_user.auth_section = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] barbican_service_user.auth_type = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] barbican_service_user.cafile = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] barbican_service_user.certfile = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] barbican_service_user.collect_timing = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] barbican_service_user.insecure = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] barbican_service_user.keyfile = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] barbican_service_user.split_loggers = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] barbican_service_user.timeout = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] vault.approle_role_id = **** {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] vault.approle_secret_id = **** {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] vault.auth_method = approle {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] vault.auth_path = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] vault.kv_mountpoint = secret {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] vault.kv_path = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] vault.kv_version = 2 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] vault.namespace = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] vault.root_token_id = **** {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] vault.ssl_ca_crt_file = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] vault.timeout = 60.0 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] vault.token_file = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] vault.token_role = None {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] vault.use_ssl = False {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:07:34 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] ******************************************************************************** {{(pid=77589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3552}} Aug 05 10:07:34 devstack sudo[77739]: pam_unix(sudo:session): session closed for user root Aug 05 10:07:34 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.434s {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:07:34 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:07:34 devstack sudo[77743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 05 10:07:34 devstack sudo[77743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:07:34 devstack sudo[77743]: pam_unix(sudo:session): session closed for user root Aug 05 10:07:34 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.277s {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:07:34 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 10:07:34 devstack cinder-volume[77734]: INFO cinder.brick.local_dev.lvm [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Aug 05 10:07:34 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:07:34 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:07:34 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:07:34 devstack sudo[77805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 05 10:07:34 devstack sudo[77805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:07:35 devstack sudo[77805]: pam_unix(sudo:session): session closed for user root Aug 05 10:07:35 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:07:35 devstack cinder-volume[77734]: DEBUG cinder.brick.local_dev.lvm [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=77734) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Aug 05 10:07:35 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:07:35 devstack sudo[77920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 05 10:07:35 devstack sudo[77920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:07:35 devstack sudo[77920]: pam_unix(sudo:session): session closed for user root Aug 05 10:07:35 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.502s {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:07:35 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:07:35 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:07:35 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:07:35 devstack sudo[78108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 05 10:07:35 devstack sudo[78108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:07:35 devstack sudo[78108]: pam_unix(sudo:session): session closed for user root Aug 05 10:07:35 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.268s {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:07:35 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:07:35 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:07:35 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:07:35 devstack sudo[78200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Aug 05 10:07:35 devstack sudo[78200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:07:36 devstack sudo[78200]: pam_unix(sudo:session): session closed for user root Aug 05 10:07:36 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.300s {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:07:36 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:07:36 devstack sudo[78326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 05 10:07:36 devstack sudo[78326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:07:36 devstack sudo[78326]: pam_unix(sudo:session): session closed for user root Aug 05 10:07:36 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.337s {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:07:36 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:07:36 devstack sudo[78356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 05 10:07:36 devstack sudo[78356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:07:36 devstack sudo[78356]: pam_unix(sudo:session): session closed for user root Aug 05 10:07:36 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.328s {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:07:36 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:07:36 devstack sudo[78440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 05 10:07:36 devstack sudo[78440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:07:37 devstack sudo[78440]: pam_unix(sudo:session): session closed for user root Aug 05 10:07:37 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:07:37 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:07:37 devstack sudo[78443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 05 10:07:37 devstack sudo[78443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:07:37 devstack sudo[78443]: pam_unix(sudo:session): session closed for user root Aug 05 10:07:37 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.319s {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:07:37 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:07:37 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:07:37 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:07:37 devstack sudo[78502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 05 10:07:37 devstack sudo[78502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:07:37 devstack sudo[78502]: pam_unix(sudo:session): session closed for user root Aug 05 10:07:37 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.322s {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:07:37 devstack cinder-volume[77734]: INFO cinder.volume.drivers.lvm [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] Enabling LVM thin provisioning by default because a thin pool exists. Aug 05 10:07:37 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:07:37 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:07:37 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:07:37 devstack sudo[78537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 05 10:07:37 devstack sudo[78537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:07:38 devstack sudo[78537]: pam_unix(sudo:session): session closed for user root Aug 05 10:07:38 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.277s {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:07:38 devstack cinder-volume[77734]: DEBUG cinder.volume.drivers.lvm [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] Updating volume stats {{(pid=77734) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 05 10:07:38 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:07:38 devstack sudo[78540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 05 10:07:38 devstack sudo[78540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:07:38 devstack sudo[78540]: pam_unix(sudo:session): session closed for user root Aug 05 10:07:38 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:07:38 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:07:38 devstack sudo[78549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 05 10:07:38 devstack sudo[78549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:07:38 devstack sudo[78549]: pam_unix(sudo:session): session closed for user root Aug 05 10:07:38 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:07:38 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:07:38 devstack sudo[78552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 05 10:07:38 devstack sudo[78552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:07:38 devstack sudo[78552]: pam_unix(sudo:session): session closed for user root Aug 05 10:07:38 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:07:38 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:07:38 devstack sudo[78555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 05 10:07:38 devstack sudo[78555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:07:39 devstack sudo[78555]: pam_unix(sudo:session): session closed for user root Aug 05 10:07:39 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:07:39 devstack cinder-volume[77734]: INFO cinder.volume.driver [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] Driver hasn't implemented _init_vendor_properties() Aug 05 10:07:39 devstack cinder-volume[77734]: DEBUG cinder.volume.driver [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=77734) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 05 10:07:39 devstack cinder-volume[77734]: DEBUG oslo_db.sqlalchemy.engines [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77734) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 05 10:07:39 devstack cinder-volume[77734]: DEBUG dbcounter [-] [77734] Writer thread running {{(pid=77734) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 05 10:07:39 devstack cinder-volume[77734]: DEBUG cinder.db.api [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] Building query based on filter {{(pid=77734) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 05 10:07:39 devstack cinder-volume[77734]: DEBUG cinder.image.image_utils [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=77734) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 05 10:07:39 devstack cinder-volume[77734]: INFO cinder.keymgr.migration [None req-5580ef0d-f50b-4f2d-98ff-00e108b792c8 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 05 10:07:39 devstack cinder-volume[77734]: DEBUG cinder.volume.drivers.lvm [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] Updating volume stats {{(pid=77734) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 05 10:07:39 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:07:39 devstack sudo[78559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 05 10:07:39 devstack sudo[78559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:07:39 devstack sudo[78559]: pam_unix(sudo:session): session closed for user root Aug 05 10:07:39 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.285s {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:07:39 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:07:39 devstack sudo[78562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 05 10:07:39 devstack sudo[78562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:07:39 devstack sudo[78562]: pam_unix(sudo:session): session closed for user root Aug 05 10:07:39 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.300s {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:07:39 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:07:39 devstack sudo[78582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 05 10:07:39 devstack sudo[78582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:07:40 devstack sudo[78582]: pam_unix(sudo:session): session closed for user root Aug 05 10:07:40 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.522s {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:07:40 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:07:40 devstack sudo[78607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 05 10:07:40 devstack sudo[78607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:07:40 devstack sudo[78607]: pam_unix(sudo:session): session closed for user root Aug 05 10:07:40 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.403s {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:07:40 devstack cinder-volume[77734]: DEBUG cinder.manager [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] Notifying Schedulers of capabilities ... {{(pid=77734) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:07:40 devstack cinder-volume[77734]: INFO cinder.volume.manager [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] Driver initialization completed successfully. Aug 05 10:07:40 devstack cinder-volume[77734]: INFO cinder.manager [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] Initiating service 2 cleanup Aug 05 10:07:40 devstack cinder-volume[77734]: INFO cinder.manager [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] Service 2 cleanup completed. Aug 05 10:07:40 devstack cinder-volume[77734]: DEBUG cinder.service [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] Creating RPC server for service cinder-volume {{(pid=77734) start /opt/stack/cinder/cinder/service.py:231}} Aug 05 10:07:40 devstack cinder-volume[77734]: DEBUG cinder.service [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=77734) start /opt/stack/cinder/cinder/service.py:237}} Aug 05 10:07:40 devstack cinder-volume[77734]: INFO cinder.volume.manager [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Aug 05 10:07:40 devstack cinder-volume[77734]: DEBUG cinder.volume.drivers.lvm [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] Updating volume stats {{(pid=77734) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 05 10:07:40 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:07:40 devstack sudo[78612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 05 10:07:40 devstack sudo[78612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:07:41 devstack sudo[78612]: pam_unix(sudo:session): session closed for user root Aug 05 10:07:41 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.309s {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:07:41 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:07:41 devstack sudo[78615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 05 10:07:41 devstack sudo[78615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:07:41 devstack sudo[78615]: pam_unix(sudo:session): session closed for user root Aug 05 10:07:41 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:07:41 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:07:41 devstack sudo[78621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 05 10:07:41 devstack sudo[78621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:07:41 devstack sudo[78621]: pam_unix(sudo:session): session closed for user root Aug 05 10:07:41 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:07:41 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:07:41 devstack sudo[78624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 05 10:07:41 devstack sudo[78624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:07:42 devstack sudo[78624]: pam_unix(sudo:session): session closed for user root Aug 05 10:07:42 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:07:42 devstack cinder-volume[77734]: INFO cinder.volume.manager [None req-f4ea567a-88af-4f83-9e52-db69a925e64e None None] Driver post RPC initialization completed successfully. Aug 05 10:07:43 devstack cinder-volume[77589]: DEBUG dbcounter [-] [77589] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=77589) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:07:50 devstack cinder-volume[77734]: DEBUG dbcounter [-] [77734] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=77734) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:07:52 devstack cinder-volume[77734]: DEBUG dbcounter [-] [77734] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=77734) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:08:22 devstack cinder-volume[77734]: DEBUG oslo_service.periodic_task [None req-0151ebcc-8d4c-47b3-8697-43357c40ba0a None None] Running periodic task VolumeManager._thread_info {{(pid=77734) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:08:22 devstack cinder-volume[77734]: DEBUG cinder.volume.manager [None req-0151ebcc-8d4c-47b3-8697-43357c40ba0a None None] thread count: 6 {{(pid=77734) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 10:08:22 devstack cinder-volume[77734]: DEBUG cinder.volume.manager [None req-0151ebcc-8d4c-47b3-8697-43357c40ba0a None None] thread info: [<_MainThread(MainThread, started 139332797485184)>, , , , , ] {{(pid=77734) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 10:09:22 devstack cinder-volume[77734]: DEBUG oslo_service.periodic_task [None req-0151ebcc-8d4c-47b3-8697-43357c40ba0a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77734) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:09:22 devstack cinder-volume[77734]: DEBUG cinder.volume.drivers.lvm [None req-0151ebcc-8d4c-47b3-8697-43357c40ba0a None None] Updating volume stats {{(pid=77734) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 05 10:09:22 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-0151ebcc-8d4c-47b3-8697-43357c40ba0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:09:22 devstack sudo[83810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 05 10:09:22 devstack sudo[83810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:09:22 devstack sudo[83810]: pam_unix(sudo:session): session closed for user root Aug 05 10:09:22 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-0151ebcc-8d4c-47b3-8697-43357c40ba0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:09:22 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-0151ebcc-8d4c-47b3-8697-43357c40ba0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:09:22 devstack sudo[83813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 05 10:09:22 devstack sudo[83813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:09:22 devstack sudo[83813]: pam_unix(sudo:session): session closed for user root Aug 05 10:09:22 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-0151ebcc-8d4c-47b3-8697-43357c40ba0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:09:22 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-0151ebcc-8d4c-47b3-8697-43357c40ba0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:09:22 devstack sudo[83816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 05 10:09:22 devstack sudo[83816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:09:22 devstack sudo[83816]: pam_unix(sudo:session): session closed for user root Aug 05 10:09:22 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-0151ebcc-8d4c-47b3-8697-43357c40ba0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.249s {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:09:22 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-0151ebcc-8d4c-47b3-8697-43357c40ba0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:09:22 devstack sudo[83819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 05 10:09:22 devstack sudo[83819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:09:23 devstack sudo[83819]: pam_unix(sudo:session): session closed for user root Aug 05 10:09:23 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-0151ebcc-8d4c-47b3-8697-43357c40ba0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:09:23 devstack cinder-volume[77734]: DEBUG cinder.manager [None req-0151ebcc-8d4c-47b3-8697-43357c40ba0a None None] Notifying Schedulers of capabilities ... {{(pid=77734) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:09:23 devstack cinder-volume[77734]: DEBUG oslo_service.periodic_task [None req-0151ebcc-8d4c-47b3-8697-43357c40ba0a None None] Running periodic task VolumeManager._thread_info {{(pid=77734) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:09:23 devstack cinder-volume[77734]: DEBUG cinder.volume.manager [None req-0151ebcc-8d4c-47b3-8697-43357c40ba0a None None] thread count: 6 {{(pid=77734) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 10:09:23 devstack cinder-volume[77734]: DEBUG cinder.volume.manager [None req-0151ebcc-8d4c-47b3-8697-43357c40ba0a None None] thread info: [<_MainThread(MainThread, started 139332797485184)>, , , , , ] {{(pid=77734) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 10:09:52 devstack cinder-volume[77734]: DEBUG dbcounter [-] [77734] Writing DB stats cinder:SELECT=1 {{(pid=77734) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:09:52 devstack cinder-volume[77734]: DEBUG dbcounter [-] [77734] Writing DB stats cinder:UPDATE=1 {{(pid=77734) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:10:22 devstack cinder-volume[77734]: DEBUG oslo_service.periodic_task [None req-0151ebcc-8d4c-47b3-8697-43357c40ba0a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77734) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:10:22 devstack cinder-volume[77734]: DEBUG cinder.volume.drivers.lvm [None req-0151ebcc-8d4c-47b3-8697-43357c40ba0a None None] Updating volume stats {{(pid=77734) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 05 10:10:22 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-0151ebcc-8d4c-47b3-8697-43357c40ba0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:10:22 devstack sudo[85401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 05 10:10:22 devstack sudo[85401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:10:22 devstack sudo[85401]: pam_unix(sudo:session): session closed for user root Aug 05 10:10:22 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-0151ebcc-8d4c-47b3-8697-43357c40ba0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:10:22 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-0151ebcc-8d4c-47b3-8697-43357c40ba0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:10:22 devstack sudo[85404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 05 10:10:22 devstack sudo[85404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:10:22 devstack sudo[85404]: pam_unix(sudo:session): session closed for user root Aug 05 10:10:22 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-0151ebcc-8d4c-47b3-8697-43357c40ba0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:10:22 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-0151ebcc-8d4c-47b3-8697-43357c40ba0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:10:22 devstack sudo[85426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 05 10:10:22 devstack sudo[85426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:10:22 devstack sudo[85426]: pam_unix(sudo:session): session closed for user root Aug 05 10:10:22 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-0151ebcc-8d4c-47b3-8697-43357c40ba0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.263s {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:10:22 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-0151ebcc-8d4c-47b3-8697-43357c40ba0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:10:22 devstack sudo[85429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 05 10:10:22 devstack sudo[85429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:10:23 devstack sudo[85429]: pam_unix(sudo:session): session closed for user root Aug 05 10:10:23 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-0151ebcc-8d4c-47b3-8697-43357c40ba0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:10:23 devstack cinder-volume[77734]: DEBUG cinder.manager [None req-0151ebcc-8d4c-47b3-8697-43357c40ba0a None None] Notifying Schedulers of capabilities ... {{(pid=77734) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:10:23 devstack cinder-volume[77734]: DEBUG oslo_service.periodic_task [None req-0151ebcc-8d4c-47b3-8697-43357c40ba0a None None] Running periodic task VolumeManager._thread_info {{(pid=77734) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:10:23 devstack cinder-volume[77734]: DEBUG cinder.volume.manager [None req-0151ebcc-8d4c-47b3-8697-43357c40ba0a None None] thread count: 6 {{(pid=77734) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 10:10:23 devstack cinder-volume[77734]: DEBUG cinder.volume.manager [None req-0151ebcc-8d4c-47b3-8697-43357c40ba0a None None] thread info: [<_MainThread(MainThread, started 139332797485184)>, , , , , ] {{(pid=77734) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 10:11:22 devstack cinder-volume[77734]: DEBUG oslo_service.periodic_task [None req-0151ebcc-8d4c-47b3-8697-43357c40ba0a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77734) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:11:22 devstack cinder-volume[77734]: DEBUG cinder.volume.drivers.lvm [None req-0151ebcc-8d4c-47b3-8697-43357c40ba0a None None] Updating volume stats {{(pid=77734) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 05 10:11:22 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-0151ebcc-8d4c-47b3-8697-43357c40ba0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:11:22 devstack sudo[86831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 05 10:11:22 devstack sudo[86831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:11:22 devstack sudo[86831]: pam_unix(sudo:session): session closed for user root Aug 05 10:11:22 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-0151ebcc-8d4c-47b3-8697-43357c40ba0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:11:22 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-0151ebcc-8d4c-47b3-8697-43357c40ba0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:11:22 devstack sudo[86834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 05 10:11:22 devstack sudo[86834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:11:22 devstack sudo[86834]: pam_unix(sudo:session): session closed for user root Aug 05 10:11:22 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-0151ebcc-8d4c-47b3-8697-43357c40ba0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:11:22 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-0151ebcc-8d4c-47b3-8697-43357c40ba0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:11:22 devstack sudo[86838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 05 10:11:22 devstack sudo[86838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:11:22 devstack sudo[86838]: pam_unix(sudo:session): session closed for user root Aug 05 10:11:22 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-0151ebcc-8d4c-47b3-8697-43357c40ba0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.257s {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:11:22 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-0151ebcc-8d4c-47b3-8697-43357c40ba0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:11:22 devstack sudo[86841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 05 10:11:22 devstack sudo[86841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:11:23 devstack sudo[86841]: pam_unix(sudo:session): session closed for user root Aug 05 10:11:23 devstack cinder-volume[77734]: DEBUG oslo_concurrency.processutils [None req-0151ebcc-8d4c-47b3-8697-43357c40ba0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=77734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:11:23 devstack cinder-volume[77734]: DEBUG cinder.manager [None req-0151ebcc-8d4c-47b3-8697-43357c40ba0a None None] Notifying Schedulers of capabilities ... {{(pid=77734) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:11:23 devstack cinder-volume[77734]: DEBUG oslo_service.periodic_task [None req-0151ebcc-8d4c-47b3-8697-43357c40ba0a None None] Running periodic task VolumeManager._thread_info {{(pid=77734) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:11:23 devstack cinder-volume[77734]: DEBUG cinder.volume.manager [None req-0151ebcc-8d4c-47b3-8697-43357c40ba0a None None] thread count: 6 {{(pid=77734) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 10:11:23 devstack cinder-volume[77734]: DEBUG cinder.volume.manager [None req-0151ebcc-8d4c-47b3-8697-43357c40ba0a None None] thread info: [<_MainThread(MainThread, started 139332797485184)>, , , , , ] {{(pid=77734) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 10:11:52 devstack cinder-volume[77734]: DEBUG dbcounter [-] [77734] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=77734) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:12:07 devstack cinder-volume[77589]: INFO oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] Caught SIGTERM, stopping children Aug 05 10:12:07 devstack cinder-volume[77589]: DEBUG oslo_concurrency.lockutils [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] Acquiring lock "singleton_lock" {{(pid=77589) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 05 10:12:07 devstack cinder-volume[77589]: DEBUG oslo_concurrency.lockutils [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] Acquired lock "singleton_lock" {{(pid=77589) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 05 10:12:07 devstack cinder-volume[77589]: DEBUG oslo_concurrency.lockutils [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] Releasing lock "singleton_lock" {{(pid=77589) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 05 10:12:07 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] Stop services. {{(pid=77589) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Aug 05 10:12:07 devstack cinder-volume[77589]: DEBUG oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] Killing children. {{(pid=77589) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Aug 05 10:12:07 devstack cinder-volume[77589]: INFO oslo_service.backend._eventlet.service [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] Waiting on 1 children to exit Aug 05 10:12:12 devstack cinder-volume[77734]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Aug 05 10:12:12 devstack cinder-volume[87862]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 05 10:12:12 devstack cinder-volume[87862]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 05 10:12:12 devstack cinder-volume[87862]: we strongly recommend against using it for new projects. Aug 05 10:12:12 devstack cinder-volume[87862]: If you are already using Eventlet, we recommend migrating to a different Aug 05 10:12:12 devstack cinder-volume[87862]: framework. For more detail see Aug 05 10:12:12 devstack cinder-volume[87862]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 05 10:12:12 devstack cinder-volume[87862]: import eventlet # noqa Aug 05 10:12:14 devstack cinder-volume[87862]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87862) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 05 10:12:14 devstack cinder-volume[87862]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87862) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 05 10:12:14 devstack cinder-volume[87862]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87862) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 05 10:12:15 devstack cinder-volume[87862]: INFO dbcounter [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] Registered counter for database cinder Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_db.sqlalchemy.engines [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87862) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG dbcounter [-] [87862] Writer thread running {{(pid=87862) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 05 10:12:15 devstack cinder-volume[87862]: INFO cinder.rpc [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 05 10:12:15 devstack cinder-volume[87862]: INFO cinder.rpc [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_db.sqlalchemy.engines [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87862) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 05 10:12:15 devstack cinder-volume[87862]: INFO cinder.volume.manager [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] Determined volume DB was empty at startup. Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG cinder.volume.manager [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87862) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 05 10:12:15 devstack cinder-volume[87862]: INFO cinder.volume.manager [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] Service not found for updating active_backend_id, assuming default for driver init. Aug 05 10:12:15 devstack cinder-volume[87862]: WARNING stevedore.named [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 05 10:12:15 devstack cinder-volume[87862]: WARNING castellan.key_manager [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 05 10:12:15 devstack cinder-volume[87862]: WARNING cinder.keymgr.conf_key_mgr [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 05 10:12:15 devstack cinder-volume[87862]: INFO cinder.volume.manager [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] Image-volume cache disabled for host devstack@QuobyteHD. Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_db.sqlalchemy.engines [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87862) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 05 10:12:15 devstack cinder-volume[87862]: INFO oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] Starting 1 workers Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] Started child 88081 {{(pid=87862) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] Full set of CONF: {{(pid=87862) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] ******************************************************************************** {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3518}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] Configuration options gathered from: {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3519}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3520}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3521}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] ================================================================================ {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3526}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] allow_availability_zone_fallback = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] allow_compression_on_image_upload = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] allowed_direct_url_schemes = [] {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] api_rate_limit = True {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] auth_strategy = keystone {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_availability_zone = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_host = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_name = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_stats_polling_interval = 60 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backup_api_class = cinder.backup.api.API {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backup_name_template = backup-%s {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backup_use_same_host = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backup_use_temp_snapshot = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] chap_password = **** {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] chap_username = {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] cinder_internal_tenant_project_id = 6d2fed8e7ffd410f8cbe5d4e9d2b4a18 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] cinder_internal_tenant_user_id = 28eee46bde1947bf8755d3e409ed5fec {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] cluster = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] compression_format = gzip {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] compute_api_class = cinder.compute.nova.API {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] config_dir = [] {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] config_source = [] {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] control_exchange = openstack {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] debug = True {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] default_availability_zone = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] default_group_type = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] default_volume_type = QuobyteHD {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] disk_geometry = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] driver_client_cert = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] driver_client_cert_key = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[88081]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] driver_data_namespace = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] driver_ssl_cert_path = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] driver_ssl_cert_verify = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] driver_use_ssl = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] enable_new_services = True {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] enable_unsupported_driver = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] enabled_backends = ['QuobyteHD'] {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] enforce_multipath_for_image_xfer = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] filter_function = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] glance_api_insecure = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] glance_api_servers = ['http://192.168.122.9/image'] {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] glance_api_ssl_compression = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] glance_ca_certificates_file = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] glance_catalog_info = image:glance:publicURL {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] glance_certfile = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] glance_keyfile = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] glance_num_retries = 3 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] glance_request_timeout = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] goodness_function = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] graceful_shutdown_timeout = 5 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] group_api_class = cinder.group.api.API {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] host = devstack {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] image_compress_on_upload = True {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] image_conversion_address_space_limit = 1 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] image_conversion_cpu_limit = 60 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] image_conversion_disable = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] image_upload_use_cinder_backend = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] image_upload_use_internal_tenant = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] image_volume_cache_enabled = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] image_volume_cache_max_count = 0 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] image_volume_cache_max_size_gb = 0 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] init_host_max_objects_retrieval = 0 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] instance_format = [instance: %(uuid)s] {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] iscsi_target_flags = {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] iscsi_write_cache = on {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] iser_helper = tgtadm {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] iser_ip_address = 192.168.122.9 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] iser_port = 3260 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] log_color = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] log_config_append = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] log_dir = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] log_file = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] log_options = True {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] log_rotate_interval = 1 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] log_rotate_interval_type = days {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] log_rotation_type = none {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] max_age = 0 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] max_logfile_count = 30 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] max_logfile_size_mb = 200 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] max_over_subscription_ratio = 20.0 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] message_reap_interval = 86400 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] message_ttl = 2592000 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] migration_create_volume_timeout_secs = 300 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] monkey_patch = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] monkey_patch_modules = [] {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] my_ip = 192.168.122.9 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] no_snapshot_gb_quota = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] num_iser_scan_tries = 3 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] num_shell_tries = 3 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] num_volume_device_scan_tries = 3 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] nvmeof_conn_info_version = 1 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] nvmet_ns_id = 10 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] nvmet_port_id = 1 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] osapi_max_limit = 1000 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] osapi_volume_ext_list = [] {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] osapi_volume_listen = 0.0.0.0 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] osapi_volume_listen_port = 8776 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] osapi_volume_use_ssl = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] osapi_volume_workers = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[88081]: INFO cinder.volume.manager [None req-b77a07b8-24eb-447c-8974-541d104340b3 None None] Starting volume driver QuobyteDriver (1.2) Aug 05 10:12:15 devstack cinder-volume[88081]: DEBUG cinder.volume.drivers.remotefs [None req-b77a07b8-24eb-447c-8974-541d104340b3 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=88081) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] per_volume_size_limit = -1 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] periodic_fuzzy_delay = 60 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] periodic_interval = 60 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] project_id_regex = [0-9a-f\-]+ {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] public_endpoint = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] publish_errors = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] quota_backup_gigabytes = 1000 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] quota_backups = 10 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] quota_gigabytes = 1000 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] quota_groups = 10 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] quota_snapshots = 10 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] quota_volumes = 10 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] rate_limit_burst = 0 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] rate_limit_except_level = CRITICAL {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] rate_limit_interval = 0 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] reinit_driver_count = 3 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] replication_device = **** {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] report_discard_supported = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] report_interval = 120 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] reservation_clean_interval = 86400 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] reservation_expire = 86400 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] reserved_image_namespaces = [] {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] reserved_percentage = 0 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] rpc_response_timeout = 120 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] run_external_periodic_tasks = True {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] scst_target_driver = iscsi {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] scst_target_iqn_name = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] service_down_time = 720 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] shell_completion = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] snapshot_name_template = snapshot-%s {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] split_loggers = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] state_path = /opt/stack/data/cinder {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] storage_availability_zone = nova {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] storage_protocol = iSCSI {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] syslog_log_facility = LOG_USER {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] target_helper = lioadm {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] target_ip_address = 192.168.122.9 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] target_port = 3260 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] target_protocol = iscsi {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] target_secondary_ip_addresses = [] {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] trace_flags = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] transfer_api_class = cinder.transfer.api.API {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] transport_url = **** {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] until_refresh = 0 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] use_chap_auth = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] use_default_quota_class = True {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] use_journal = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] use_json = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] use_multipath_for_image_xfer = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] use_stderr = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] use_syslog = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] verify_glance_signatures = enabled {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] volume_api_class = cinder.volume.api.API {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] volume_backend_name = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] volume_clear = zero {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] volume_clear_ionice = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] volume_clear_size = 0 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] volume_copy_bps_limit = 0 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] volume_dd_blocksize = 1M {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] volume_name_template = volume-%s {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] volume_service_inithost_offload = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] volume_usage_audit_period = month {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] zoning_mode = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] oslo_concurrency.disable_process_locking = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] keystone_authtoken.auth_section = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] keystone_authtoken.auth_type = password {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] keystone_authtoken.auth_version = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] keystone_authtoken.cache = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] keystone_authtoken.certfile = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] keystone_authtoken.include_service_catalog = True {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[88081]: DEBUG cinder.volume.drivers.quobyte [None req-b77a07b8-24eb-447c-8974-541d104340b3 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=88081) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Aug 05 10:12:15 devstack cinder-volume[88081]: WARNING cinder.volume.drivers.quobyte [None req-b77a07b8-24eb-447c-8974-541d104340b3 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Aug 05 10:12:15 devstack cinder-volume[88081]: WARNING cinder.volume.drivers.quobyte [None req-b77a07b8-24eb-447c-8974-541d104340b3 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Aug 05 10:12:15 devstack cinder-volume[88081]: DEBUG oslo_concurrency.processutils [None req-b77a07b8-24eb-447c-8974-541d104340b3 None None] Running cmd (subprocess): mount.quobyte {{(pid=88081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] keystone_authtoken.insecure = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] keystone_authtoken.interface = public {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] keystone_authtoken.keyfile = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] keystone_authtoken.memcache_password = {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] keystone_authtoken.memcache_username = {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] keystone_authtoken.region_name = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] keystone_authtoken.service_type = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.9/identity {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] cache.backend = dogpile.cache.null {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] cache.backend_argument = **** {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] cache.backend_expiration_time = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] cache.config_prefix = cache.oslo {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] cache.debug_cache_backend = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] cache.enable_retry_client = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] cache.enable_socket_keepalive = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] cache.enabled = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] cache.expiration_time = 600 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] cache.hashclient_retry_attempts = 2 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] cache.memcache_dead_retry = 300 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] cache.memcache_pool_maxsize = 10 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] cache.memcache_sasl_enabled = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] cache.password = **** {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] cache.proxies = [] {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] cache.redis_db = 0 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] cache.redis_server = localhost:6379 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] cache.retry_attempts = 2 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] cache.retry_delay = 0.0 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] cache.socket_keepalive_count = 1 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] cache.socket_keepalive_idle = 1 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] cache.socket_keepalive_interval = 1 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] cache.socket_timeout = 1.0 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] cache.tls_allowed_ciphers = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] cache.tls_cafile = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] cache.tls_certfile = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] cache.tls_enabled = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] cache.tls_keyfile = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] cache.username = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] coordination.backend_url = **** {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] database.asyncio_connection = **** {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] database.asyncio_slave_connection = **** {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] database.backend = sqlalchemy {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] database.connection = **** {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] database.connection_debug = 0 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] database.connection_parameters = {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] database.connection_recycle_time = 3600 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] database.connection_trace = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] database.db_inc_retry_interval = True {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] database.db_max_retries = 20 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] database.db_max_retry_interval = 10 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] database.db_retry_interval = 1 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] database.max_overflow = 50 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[77734]: DEBUG oslo_concurrency.lockutils [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] Acquiring lock "singleton_lock" {{(pid=77734) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 05 10:12:15 devstack cinder-volume[77734]: DEBUG oslo_concurrency.lockutils [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] Acquired lock "singleton_lock" {{(pid=77734) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] database.max_pool_size = 5 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] database.max_retries = 10 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] database.mysql_wsrep_sync_wait = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] database.pool_timeout = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] database.retry_interval = 10 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] database.slave_connection = **** {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[77734]: DEBUG oslo_concurrency.lockutils [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] Releasing lock "singleton_lock" {{(pid=77734) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] database.sqlite_synchronous = True {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] database.synchronous_reader = True {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] database.use_db_reconnect = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] profiler.connection_string = messaging:// {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] profiler.enabled = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] profiler.es_doc_type = notification {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] profiler.es_scroll_size = 10000 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] profiler.es_scroll_time = 2m {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] profiler.filter_error_trace = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] profiler.hmac_keys = **** {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] profiler.sentinel_service_name = mymaster {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] profiler.socket_timeout = 0.1 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] profiler.trace_requests = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] profiler.trace_sqlalchemy = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] profiler_jaeger.process_tags = {} {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] profiler_jaeger.service_name_prefix = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] profiler_otlp.service_name_prefix = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] oslo_policy.enforce_new_defaults = True {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] oslo_policy.policy_default_rule = default {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] oslo_policy.policy_file = policy.yaml {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] oslo_policy.remote_timeout = 60.0 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] privsep_osbrick.group = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] privsep_osbrick.helper_command = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] privsep_osbrick.user = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] cinder_sys_admin.group = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] cinder_sys_admin.helper_command = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] cinder_sys_admin.user = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] service_user.auth_section = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[77734]: WARNING amqp [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] service_user.auth_type = password {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] service_user.cafile = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] service_user.certfile = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] service_user.collect_timing = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] service_user.insecure = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] service_user.keyfile = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] service_user.send_service_user_token = True {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] service_user.split_loggers = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] service_user.timeout = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] glance.auth_section = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] glance.auth_type = password {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] glance.certfile = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] glance.collect_timing = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] glance.insecure = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] glance.keyfile = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] glance.region_name = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] glance.split_loggers = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] glance.timeout = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_defaults.backend_availability_zone = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_defaults.chap_password = **** {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_defaults.chap_username = {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_defaults.disk_geometry = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_defaults.driver_client_cert = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_defaults.driver_client_cert_key = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_defaults.driver_data_namespace = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_defaults.driver_use_ssl = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_defaults.extra_capabilities = {} {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_defaults.filter_function = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_defaults.goodness_function = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_defaults.iscsi_target_flags = {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_defaults.iscsi_write_cache = on {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_defaults.iser_helper = tgtadm {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_defaults.iser_ip_address = 192.168.122.9 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_defaults.iser_port = 3260 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_defaults.nas_host = {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_defaults.nas_login = admin {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_defaults.nas_mount_options = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_defaults.nas_password = **** {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_defaults.nas_private_key = {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_defaults.nas_share_path = {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_defaults.nas_ssh_port = 22 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_defaults.num_shell_tries = 3 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:15 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[77734]: WARNING amqp [None req-59a04407-0044-4fda-adb7-811f8ff92f39 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_defaults.quobyte_volume_url = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_defaults.replication_device = **** {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_defaults.report_discard_supported = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_defaults.reserved_percentage = 0 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_defaults.target_helper = tgtadm {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_defaults.target_ip_address = 192.168.122.9 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_defaults.target_port = 3260 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_defaults.target_protocol = iscsi {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_defaults.trace_flags = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_defaults.unique_fqdn_network = True {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_defaults.use_chap_auth = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_defaults.volume_backend_name = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_defaults.volume_clear = zero {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_defaults.volume_clear_ionice = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_defaults.volume_clear_size = 0 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] oslo_reports.file_event_handler = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] oslo_reports.log_dir = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] QuobyteHD.backend_availability_zone = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] QuobyteHD.backend_host = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] QuobyteHD.chap_password = **** {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] QuobyteHD.chap_username = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] QuobyteHD.chiscsi_conf = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] QuobyteHD.disk_geometry = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] QuobyteHD.driver_client_cert = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] QuobyteHD.driver_data_namespace = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] QuobyteHD.driver_use_ssl = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] QuobyteHD.extra_capabilities = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] QuobyteHD.filter_function = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] QuobyteHD.goodness_function = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack quobyte-client[88082]: Reading configuration file: /etc/quobyte/client.cfg Aug 05 10:12:16 devstack quobyte-client[88082]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] QuobyteHD.iscsi_target_flags = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] QuobyteHD.iscsi_write_cache = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] QuobyteHD.iser_helper = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] QuobyteHD.iser_ip_address = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] QuobyteHD.iser_port = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] QuobyteHD.iser_target_prefix = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] QuobyteHD.nas_host = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] QuobyteHD.nas_login = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] QuobyteHD.nas_mount_options = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] QuobyteHD.nas_password = **** {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] QuobyteHD.nas_private_key = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] QuobyteHD.nas_share_path = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[88081]: DEBUG oslo_concurrency.processutils [None req-b77a07b8-24eb-447c-8974-541d104340b3 None None] CMD "mount.quobyte" returned: 1 in 0.184s {{(pid=88081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] QuobyteHD.nas_ssh_port = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[88081]: DEBUG oslo_concurrency.lockutils [None req-b77a07b8-24eb-447c-8974-541d104340b3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:12:16 devstack cinder-volume[88081]: DEBUG oslo_concurrency.lockutils [None req-b77a07b8-24eb-447c-8974-541d104340b3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] QuobyteHD.num_shell_tries = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] QuobyteHD.nvmet_ns_id = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] QuobyteHD.nvmet_port_id = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] QuobyteHD.replication_device = **** {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] QuobyteHD.report_discard_supported = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[88081]: DEBUG cinder.volume.drivers.quobyte [None req-b77a07b8-24eb-447c-8974-541d104340b3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] QuobyteHD.reserved_percentage = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[88081]: INFO cinder.volume.drivers.quobyte [None req-b77a07b8-24eb-447c-8974-541d104340b3 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 ... Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] QuobyteHD.scst_target_driver = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[88081]: DEBUG oslo_concurrency.processutils [None req-b77a07b8-24eb-447c-8974-541d104340b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde -c /etc/quobyte/client-cinder.cfg {{(pid=88081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] QuobyteHD.storage_protocol = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] QuobyteHD.target_helper = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] QuobyteHD.target_ip_address = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] QuobyteHD.target_port = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] QuobyteHD.target_prefix = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] QuobyteHD.target_protocol = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] QuobyteHD.trace_flags = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] QuobyteHD.unique_fqdn_network = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] QuobyteHD.use_chap_auth = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] QuobyteHD.volume_clear = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] QuobyteHD.volume_clear_ionice = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] QuobyteHD.volume_clear_size = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] QuobyteHD.volumes_dir = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] oslo_messaging_rabbit.ssl = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] oslo_messaging_rabbit.ssl_version = {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] oslo_messaging_notifications.driver = [] {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] oslo_messaging_notifications.retry = -1 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack sudo[88093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde -c /etc/quobyte/client-cinder.cfg Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] key_manager.fixed_key = **** {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] barbican.barbican_api_version = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] barbican.barbican_endpoint = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack sudo[88093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] barbican.barbican_endpoint_type = public {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] barbican.barbican_region_name = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] barbican.cafile = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] barbican.certfile = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] barbican.collect_timing = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] barbican.insecure = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] barbican.keyfile = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] barbican.number_of_retries = 60 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] barbican.retry_delay = 1 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] barbican.send_service_user_token = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] barbican.split_loggers = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] barbican.timeout = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] barbican.verify_ssl = True {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] barbican.verify_ssl_path = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] barbican_service_user.auth_section = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] barbican_service_user.auth_type = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] barbican_service_user.cafile = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] barbican_service_user.certfile = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] barbican_service_user.collect_timing = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] barbican_service_user.insecure = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] barbican_service_user.keyfile = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] barbican_service_user.split_loggers = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] barbican_service_user.timeout = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] vault.approle_role_id = **** {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] vault.approle_secret_id = **** {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] vault.auth_method = approle {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] vault.auth_path = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] vault.kv_mountpoint = secret {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] vault.kv_path = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] vault.kv_version = 2 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] vault.namespace = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] vault.root_token_id = **** {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] vault.ssl_ca_crt_file = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] vault.timeout = 60.0 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] vault.token_file = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] vault.token_role = None {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] vault.use_ssl = False {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:16 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] ******************************************************************************** {{(pid=87862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3552}} Aug 05 10:12:16 devstack sudo[88093]: pam_unix(sudo:session): session closed for user root Aug 05 10:12:16 devstack cinder-volume[88081]: DEBUG oslo_concurrency.processutils [None req-b77a07b8-24eb-447c-8974-541d104340b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.411s {{(pid=88081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:12:16 devstack cinder-volume[88081]: INFO cinder.volume.drivers.quobyte [None req-b77a07b8-24eb-447c-8974-541d104340b3 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 succeeded Aug 05 10:12:16 devstack cinder-volume[88081]: DEBUG cinder.volume.drivers.quobyte [None req-b77a07b8-24eb-447c-8974-541d104340b3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:12:16 devstack cinder-volume[88081]: DEBUG oslo_concurrency.lockutils [None req-b77a07b8-24eb-447c-8974-541d104340b3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.440s {{(pid=88081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:12:16 devstack cinder-volume[88081]: DEBUG oslo_concurrency.processutils [None req-b77a07b8-24eb-447c-8974-541d104340b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:12:16 devstack sudo[88162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:12:16 devstack sudo[88162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:12:16 devstack sudo[88162]: pam_unix(sudo:session): session closed for user root Aug 05 10:12:16 devstack cinder-volume[88081]: DEBUG oslo_concurrency.processutils [None req-b77a07b8-24eb-447c-8974-541d104340b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.275s {{(pid=88081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:12:16 devstack cinder-volume[88081]: INFO cinder.volume.driver [None req-b77a07b8-24eb-447c-8974-541d104340b3 None None] Driver hasn't implemented _init_vendor_properties() Aug 05 10:12:16 devstack cinder-volume[88081]: DEBUG cinder.volume.driver [None req-b77a07b8-24eb-447c-8974-541d104340b3 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7310066223145, 'free_capacity_gb': 1775.7310066223145, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88081) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 05 10:12:16 devstack cinder-volume[88081]: DEBUG oslo_db.sqlalchemy.engines [None req-b77a07b8-24eb-447c-8974-541d104340b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88081) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 05 10:12:16 devstack cinder-volume[88081]: DEBUG dbcounter [-] [88081] Writer thread running {{(pid=88081) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 05 10:12:16 devstack cinder-volume[88081]: DEBUG cinder.db.api [None req-b77a07b8-24eb-447c-8974-541d104340b3 None None] Building query based on filter {{(pid=88081) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 05 10:12:16 devstack cinder-volume[88081]: DEBUG cinder.image.image_utils [None req-b77a07b8-24eb-447c-8974-541d104340b3 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=88081) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 05 10:12:16 devstack cinder-volume[88081]: INFO cinder.keymgr.migration [None req-ba19cf0f-8b44-4361-bdd7-3e8cdcc6f2c7 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 05 10:12:16 devstack cinder-volume[88081]: DEBUG oslo_concurrency.lockutils [None req-b77a07b8-24eb-447c-8974-541d104340b3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:12:16 devstack cinder-volume[88081]: DEBUG oslo_concurrency.lockutils [None req-b77a07b8-24eb-447c-8974-541d104340b3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:12:16 devstack cinder-volume[88081]: DEBUG cinder.volume.drivers.quobyte [None req-b77a07b8-24eb-447c-8974-541d104340b3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:12:16 devstack cinder-volume[88081]: DEBUG cinder.volume.drivers.quobyte [None req-b77a07b8-24eb-447c-8974-541d104340b3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:12:16 devstack cinder-volume[88081]: DEBUG oslo_concurrency.lockutils [None req-b77a07b8-24eb-447c-8974-541d104340b3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:12:16 devstack cinder-volume[88081]: DEBUG oslo_concurrency.processutils [None req-b77a07b8-24eb-447c-8974-541d104340b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:12:16 devstack sudo[88182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:12:16 devstack sudo[88182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:12:17 devstack sudo[88182]: pam_unix(sudo:session): session closed for user root Aug 05 10:12:17 devstack cinder-volume[88081]: DEBUG oslo_concurrency.processutils [None req-b77a07b8-24eb-447c-8974-541d104340b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.349s {{(pid=88081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:12:17 devstack cinder-volume[88081]: DEBUG cinder.manager [None req-b77a07b8-24eb-447c-8974-541d104340b3 None None] Notifying Schedulers of capabilities ... {{(pid=88081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:12:17 devstack cinder-volume[88081]: INFO cinder.volume.manager [None req-b77a07b8-24eb-447c-8974-541d104340b3 None None] Driver initialization completed successfully. Aug 05 10:12:17 devstack cinder-volume[88081]: INFO cinder.manager [None req-b77a07b8-24eb-447c-8974-541d104340b3 None None] Initiating service 3 cleanup Aug 05 10:12:17 devstack cinder-volume[88081]: INFO cinder.manager [None req-b77a07b8-24eb-447c-8974-541d104340b3 None None] Service 3 cleanup completed. Aug 05 10:12:17 devstack cinder-volume[88081]: DEBUG cinder.service [None req-b77a07b8-24eb-447c-8974-541d104340b3 None None] Creating RPC server for service cinder-volume {{(pid=88081) start /opt/stack/cinder/cinder/service.py:231}} Aug 05 10:12:17 devstack cinder-volume[88081]: DEBUG cinder.service [None req-b77a07b8-24eb-447c-8974-541d104340b3 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=88081) start /opt/stack/cinder/cinder/service.py:237}} Aug 05 10:12:17 devstack cinder-volume[88081]: INFO cinder.volume.manager [None req-b77a07b8-24eb-447c-8974-541d104340b3 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Aug 05 10:12:17 devstack cinder-volume[88081]: DEBUG oslo_concurrency.lockutils [None req-b77a07b8-24eb-447c-8974-541d104340b3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:12:17 devstack cinder-volume[88081]: DEBUG oslo_concurrency.lockutils [None req-b77a07b8-24eb-447c-8974-541d104340b3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:12:17 devstack cinder-volume[88081]: DEBUG cinder.volume.drivers.quobyte [None req-b77a07b8-24eb-447c-8974-541d104340b3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:12:17 devstack cinder-volume[88081]: DEBUG cinder.volume.drivers.quobyte [None req-b77a07b8-24eb-447c-8974-541d104340b3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:12:17 devstack cinder-volume[88081]: DEBUG oslo_concurrency.lockutils [None req-b77a07b8-24eb-447c-8974-541d104340b3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:12:17 devstack cinder-volume[88081]: DEBUG oslo_concurrency.processutils [None req-b77a07b8-24eb-447c-8974-541d104340b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:12:17 devstack sudo[88193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:12:17 devstack sudo[88193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:12:18 devstack sudo[88193]: pam_unix(sudo:session): session closed for user root Aug 05 10:12:18 devstack cinder-volume[88081]: DEBUG oslo_concurrency.processutils [None req-b77a07b8-24eb-447c-8974-541d104340b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.501s {{(pid=88081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:12:18 devstack cinder-volume[88081]: INFO cinder.volume.manager [None req-b77a07b8-24eb-447c-8974-541d104340b3 None None] Driver post RPC initialization completed successfully. Aug 05 10:12:21 devstack cinder-volume[87862]: INFO oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] Caught SIGTERM, stopping children Aug 05 10:12:21 devstack cinder-volume[87862]: DEBUG oslo_concurrency.lockutils [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] Acquiring lock "singleton_lock" {{(pid=87862) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 05 10:12:21 devstack cinder-volume[87862]: DEBUG oslo_concurrency.lockutils [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] Acquired lock "singleton_lock" {{(pid=87862) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 05 10:12:21 devstack cinder-volume[87862]: DEBUG oslo_concurrency.lockutils [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] Releasing lock "singleton_lock" {{(pid=87862) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 05 10:12:21 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] Stop services. {{(pid=87862) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Aug 05 10:12:21 devstack cinder-volume[87862]: DEBUG oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] Killing children. {{(pid=87862) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Aug 05 10:12:21 devstack cinder-volume[87862]: INFO oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] Waiting on 1 children to exit Aug 05 10:12:21 devstack cinder-volume[88081]: DEBUG oslo_concurrency.lockutils [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] Acquiring lock "singleton_lock" {{(pid=88081) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 05 10:12:21 devstack cinder-volume[88081]: DEBUG oslo_concurrency.lockutils [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] Acquired lock "singleton_lock" {{(pid=88081) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 05 10:12:21 devstack cinder-volume[88081]: DEBUG oslo_concurrency.lockutils [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] Releasing lock "singleton_lock" {{(pid=88081) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 05 10:12:21 devstack cinder-volume[88081]: WARNING amqp [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 05 10:12:21 devstack cinder-volume[88081]: WARNING amqp [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 05 10:12:21 devstack cinder-volume[87862]: INFO oslo_service.backend._eventlet.service [None req-eefa63b3-6a51-42dc-a842-332e08954af1 None None] Child 88081 exited with status 0 Aug 05 10:12:22 devstack cinder-volume[88356]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 05 10:12:22 devstack cinder-volume[88356]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 05 10:12:22 devstack cinder-volume[88356]: we strongly recommend against using it for new projects. Aug 05 10:12:22 devstack cinder-volume[88356]: If you are already using Eventlet, we recommend migrating to a different Aug 05 10:12:22 devstack cinder-volume[88356]: framework. For more detail see Aug 05 10:12:22 devstack cinder-volume[88356]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 05 10:12:22 devstack cinder-volume[88356]: import eventlet # noqa Aug 05 10:12:24 devstack cinder-volume[88356]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=88356) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 05 10:12:24 devstack cinder-volume[88356]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=88356) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 05 10:12:24 devstack cinder-volume[88356]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=88356) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 05 10:12:25 devstack cinder-volume[88356]: INFO dbcounter [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] Registered counter for database cinder Aug 05 10:12:25 devstack cinder-volume[88356]: DEBUG oslo_db.sqlalchemy.engines [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88356) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG dbcounter [-] [88356] Writer thread running {{(pid=88356) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 05 10:12:26 devstack cinder-volume[88356]: INFO cinder.rpc [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 05 10:12:26 devstack cinder-volume[88356]: INFO cinder.rpc [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_db.sqlalchemy.engines [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88356) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 05 10:12:26 devstack cinder-volume[88356]: INFO cinder.volume.manager [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] Determined volume DB was empty at startup. Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG cinder.volume.manager [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] Cinder Volume DB check: vol_db_empty=True {{(pid=88356) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 05 10:12:26 devstack cinder-volume[88356]: WARNING stevedore.named [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 05 10:12:26 devstack cinder-volume[88356]: WARNING castellan.key_manager [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 05 10:12:26 devstack cinder-volume[88356]: WARNING cinder.keymgr.conf_key_mgr [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 05 10:12:26 devstack cinder-volume[88356]: INFO cinder.volume.manager [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] Image-volume cache disabled for host devstack@QuobyteHD. Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_db.sqlalchemy.engines [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88356) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 05 10:12:26 devstack cinder-volume[88356]: INFO oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] Starting 1 workers Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] Started child 88613 {{(pid=88356) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] Full set of CONF: {{(pid=88356) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] ******************************************************************************** {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3518}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] Configuration options gathered from: {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3519}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3520}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3521}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] ================================================================================ {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3526}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] allow_availability_zone_fallback = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] allow_compression_on_image_upload = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] allowed_direct_url_schemes = [] {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] api_rate_limit = True {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88613]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] auth_strategy = keystone {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_availability_zone = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_host = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_name = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_stats_polling_interval = 60 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backup_api_class = cinder.backup.api.API {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backup_name_template = backup-%s {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backup_use_same_host = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backup_use_temp_snapshot = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] chap_password = **** {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] chap_username = {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] cinder_internal_tenant_project_id = 6d2fed8e7ffd410f8cbe5d4e9d2b4a18 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] cinder_internal_tenant_user_id = 28eee46bde1947bf8755d3e409ed5fec {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] cluster = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] compression_format = gzip {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] compute_api_class = cinder.compute.nova.API {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] config_dir = [] {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] config_source = [] {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] control_exchange = openstack {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] debug = True {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] default_availability_zone = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] default_group_type = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] default_volume_type = QuobyteHD {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] disk_geometry = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] driver_client_cert = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] driver_client_cert_key = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] driver_data_namespace = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] driver_ssl_cert_path = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] driver_ssl_cert_verify = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] driver_use_ssl = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] enable_new_services = True {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] enable_unsupported_driver = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] enabled_backends = ['QuobyteHD'] {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] enforce_multipath_for_image_xfer = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] filter_function = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] glance_api_insecure = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] glance_api_servers = ['http://192.168.122.9/image'] {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] glance_api_ssl_compression = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] glance_ca_certificates_file = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] glance_catalog_info = image:glance:publicURL {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] glance_certfile = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] glance_keyfile = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] glance_num_retries = 3 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] glance_request_timeout = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] goodness_function = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] graceful_shutdown_timeout = 5 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] group_api_class = cinder.group.api.API {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] host = devstack {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] image_compress_on_upload = True {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] image_conversion_address_space_limit = 1 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] image_conversion_cpu_limit = 60 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-7fc53b9d-7bdb-4e35-a3cd-6043f7537cb7 None None] Starting volume driver QuobyteDriver (1.2) Aug 05 10:12:26 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-7fc53b9d-7bdb-4e35-a3cd-6043f7537cb7 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=88613) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] image_conversion_disable = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] image_upload_use_cinder_backend = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] image_upload_use_internal_tenant = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] image_volume_cache_enabled = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] image_volume_cache_max_count = 0 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] image_volume_cache_max_size_gb = 0 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] init_host_max_objects_retrieval = 0 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] instance_format = [instance: %(uuid)s] {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] iscsi_target_flags = {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] iscsi_write_cache = on {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] iser_helper = tgtadm {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] iser_ip_address = 192.168.122.9 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] iser_port = 3260 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] log_color = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] log_config_append = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] log_dir = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] log_file = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] log_options = True {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] log_rotate_interval = 1 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] log_rotate_interval_type = days {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] log_rotation_type = none {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] max_age = 0 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] max_logfile_count = 30 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] max_logfile_size_mb = 200 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] max_over_subscription_ratio = 20.0 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] message_reap_interval = 86400 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] message_ttl = 2592000 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] migration_create_volume_timeout_secs = 300 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] monkey_patch = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] monkey_patch_modules = [] {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] my_ip = 192.168.122.9 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] no_snapshot_gb_quota = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] num_iser_scan_tries = 3 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] num_shell_tries = 3 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] num_volume_device_scan_tries = 3 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] nvmeof_conn_info_version = 1 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] nvmet_ns_id = 10 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] nvmet_port_id = 1 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] osapi_max_limit = 1000 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] osapi_volume_ext_list = [] {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] osapi_volume_listen = 0.0.0.0 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] osapi_volume_listen_port = 8776 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] osapi_volume_use_ssl = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] osapi_volume_workers = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] per_volume_size_limit = -1 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] periodic_fuzzy_delay = 60 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] periodic_interval = 60 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] project_id_regex = [0-9a-f\-]+ {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] public_endpoint = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] publish_errors = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] quota_backup_gigabytes = 1000 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] quota_backups = 10 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] quota_gigabytes = 1000 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] quota_groups = 10 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] quota_snapshots = 10 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] quota_volumes = 10 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] rate_limit_burst = 0 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] rate_limit_except_level = CRITICAL {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] rate_limit_interval = 0 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] reinit_driver_count = 3 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] replication_device = **** {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] report_discard_supported = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] report_interval = 120 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] reservation_clean_interval = 86400 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] reservation_expire = 86400 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] reserved_image_namespaces = [] {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] reserved_percentage = 0 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] rpc_response_timeout = 120 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] run_external_periodic_tasks = True {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] scst_target_driver = iscsi {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] scst_target_iqn_name = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] service_down_time = 720 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] shell_completion = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] snapshot_name_template = snapshot-%s {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] split_loggers = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] state_path = /opt/stack/data/cinder {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] storage_availability_zone = nova {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] storage_protocol = iSCSI {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] syslog_log_facility = LOG_USER {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] target_helper = lioadm {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] target_ip_address = 192.168.122.9 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] target_port = 3260 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] target_protocol = iscsi {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] target_secondary_ip_addresses = [] {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] trace_flags = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] transfer_api_class = cinder.transfer.api.API {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] transport_url = **** {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] until_refresh = 0 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] use_chap_auth = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] use_default_quota_class = True {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] use_journal = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] use_json = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] use_multipath_for_image_xfer = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] use_stderr = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] use_syslog = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] verify_glance_signatures = enabled {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] volume_api_class = cinder.volume.api.API {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] volume_backend_name = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] volume_clear = zero {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] volume_clear_ionice = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] volume_clear_size = 0 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] volume_copy_bps_limit = 0 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] volume_dd_blocksize = 1M {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] volume_name_template = volume-%s {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] volume_service_inithost_offload = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] volume_usage_audit_period = month {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] zoning_mode = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] oslo_concurrency.disable_process_locking = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] os_brick.lightos_discovery_client_address = localhost {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] os_brick.wait_mpath_device_interval = 1 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] keystone_authtoken.auth_section = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] keystone_authtoken.auth_type = password {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] keystone_authtoken.auth_version = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] keystone_authtoken.cache = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] keystone_authtoken.certfile = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] keystone_authtoken.delay_auth_decision = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] keystone_authtoken.http_connect_timeout = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] keystone_authtoken.include_service_catalog = True {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] keystone_authtoken.insecure = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] keystone_authtoken.interface = public {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] keystone_authtoken.keyfile = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] keystone_authtoken.memcache_password = {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] keystone_authtoken.memcache_secret_key = **** {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] keystone_authtoken.memcache_security_strategy = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] keystone_authtoken.memcache_username = {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] keystone_authtoken.region_name = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] keystone_authtoken.service_token_roles_required = True {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] keystone_authtoken.service_type = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-7fc53b9d-7bdb-4e35-a3cd-6043f7537cb7 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=88613) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Aug 05 10:12:26 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.quobyte [None req-7fc53b9d-7bdb-4e35-a3cd-6043f7537cb7 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Aug 05 10:12:26 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.quobyte [None req-7fc53b9d-7bdb-4e35-a3cd-6043f7537cb7 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] keystone_authtoken.token_cache_time = 300 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.9/identity {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] cache.backend = dogpile.cache.null {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] cache.backend_argument = **** {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7fc53b9d-7bdb-4e35-a3cd-6043f7537cb7 None None] Running cmd (subprocess): mount.quobyte {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] cache.backend_expiration_time = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] cache.config_prefix = cache.oslo {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] cache.debug_cache_backend = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] cache.enable_retry_client = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] cache.enable_socket_keepalive = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] cache.enabled = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] cache.expiration_time = 600 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] cache.hashclient_dead_timeout = 60.0 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] cache.hashclient_retry_attempts = 2 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] cache.hashclient_retry_timeout = 1.0 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] cache.memcache_dead_retry = 300 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] cache.memcache_pool_maxsize = 10 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] cache.memcache_pool_unused_timeout = 60 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] cache.memcache_sasl_enabled = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] cache.memcache_servers = ['localhost:11211'] {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] cache.password = **** {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] cache.proxies = [] {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] cache.redis_db = 0 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] cache.redis_sentinel_service_name = mymaster {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] cache.redis_server = localhost:6379 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] cache.retry_attempts = 2 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] cache.retry_delay = 0.0 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] cache.socket_keepalive_count = 1 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] cache.socket_keepalive_idle = 1 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] cache.socket_keepalive_interval = 1 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] cache.socket_timeout = 1.0 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] cache.tls_allowed_ciphers = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] cache.tls_cafile = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] cache.tls_certfile = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] cache.tls_enabled = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] cache.tls_keyfile = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] cache.username = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] coordination.backend_url = **** {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] database.asyncio_connection = **** {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] database.asyncio_slave_connection = **** {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] database.backend = sqlalchemy {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] database.connection = **** {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] database.connection_debug = 0 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] database.connection_parameters = {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] database.connection_recycle_time = 3600 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] database.connection_trace = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] database.db_inc_retry_interval = True {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] database.db_max_retries = 20 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] database.db_max_retry_interval = 10 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] database.db_retry_interval = 1 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] database.max_overflow = 50 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] database.max_pool_size = 5 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] database.max_retries = 10 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] database.mysql_sql_mode = TRADITIONAL {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] database.mysql_wsrep_sync_wait = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] database.pool_timeout = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] database.retry_interval = 10 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] database.slave_connection = **** {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] database.sqlite_synchronous = True {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] database.synchronous_reader = True {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] database.use_db_reconnect = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] oslo_messaging_metrics.metrics_process_name = {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] profiler.connection_string = messaging:// {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] profiler.enabled = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] profiler.es_doc_type = notification {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] profiler.es_scroll_size = 10000 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] profiler.es_scroll_time = 2m {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] profiler.filter_error_trace = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] profiler.hmac_keys = **** {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] profiler.sentinel_service_name = mymaster {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] profiler.socket_timeout = 0.1 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] profiler.trace_requests = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] profiler.trace_sqlalchemy = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] profiler_jaeger.process_tags = {} {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] profiler_jaeger.service_name_prefix = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] profiler_otlp.service_name_prefix = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] oslo_policy.enforce_new_defaults = True {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] oslo_policy.policy_default_rule = default {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] oslo_policy.policy_file = policy.yaml {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] oslo_policy.remote_timeout = 60.0 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] privsep_osbrick.capabilities = [21, 2] {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] privsep_osbrick.group = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] privsep_osbrick.helper_command = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] privsep_osbrick.log_daemon_traceback = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] privsep_osbrick.thread_pool_size = 4 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] privsep_osbrick.user = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] cinder_sys_admin.group = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] cinder_sys_admin.helper_command = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7fc53b9d-7bdb-4e35-a3cd-6043f7537cb7 None None] CMD "mount.quobyte" returned: 1 in 0.115s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:12:26 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-7fc53b9d-7bdb-4e35-a3cd-6043f7537cb7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:12:26 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-7fc53b9d-7bdb-4e35-a3cd-6043f7537cb7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:12:26 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-7fc53b9d-7bdb-4e35-a3cd-6043f7537cb7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] cinder_sys_admin.user = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] service_user.auth_section = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] service_user.auth_type = password {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] service_user.cafile = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] service_user.certfile = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] service_user.collect_timing = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] service_user.insecure = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] service_user.keyfile = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] service_user.send_service_user_token = True {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] service_user.split_loggers = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] service_user.timeout = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] glance.auth_section = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] glance.auth_type = password {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] glance.certfile = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-7fc53b9d-7bdb-4e35-a3cd-6043f7537cb7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] glance.collect_timing = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] glance.insecure = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] glance.keyfile = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] glance.region_name = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] glance.split_loggers = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] glance.timeout = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_defaults.backend_availability_zone = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_defaults.chap_password = **** {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_defaults.chap_username = {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-7fc53b9d-7bdb-4e35-a3cd-6043f7537cb7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:12:26 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7fc53b9d-7bdb-4e35-a3cd-6043f7537cb7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_defaults.disk_geometry = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_defaults.driver_client_cert = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_defaults.driver_client_cert_key = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_defaults.driver_data_namespace = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_defaults.driver_ssl_cert_path = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_defaults.driver_use_ssl = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_defaults.enable_unsupported_driver = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_defaults.extra_capabilities = {} {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_defaults.filter_function = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:26 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_defaults.goodness_function = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_defaults.image_volume_cache_enabled = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_defaults.iscsi_target_flags = {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_defaults.iscsi_write_cache = on {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_defaults.iser_helper = tgtadm {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_defaults.iser_ip_address = 192.168.122.9 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_defaults.iser_port = 3260 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_defaults.nas_host = {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_defaults.nas_login = admin {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_defaults.nas_mount_options = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_defaults.nas_password = **** {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_defaults.nas_private_key = {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_defaults.nas_secure_file_operations = auto {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_defaults.nas_share_path = {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_defaults.nas_ssh_port = 22 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_defaults.nas_volume_prov_type = thin {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_defaults.num_shell_tries = 3 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_defaults.nvmet_ns_id = 10 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_defaults.nvmet_port_id = 1 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_defaults.quobyte_client_cfg = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_defaults.quobyte_volume_url = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_defaults.replication_device = **** {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_defaults.report_discard_supported = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_defaults.reserved_percentage = 0 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_defaults.scst_target_driver = iscsi {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_defaults.scst_target_iqn_name = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_defaults.storage_protocol = iSCSI {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_defaults.target_helper = tgtadm {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_defaults.target_ip_address = 192.168.122.9 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack sudo[88618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:12:27 devstack sudo[88618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_defaults.target_port = 3260 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_defaults.target_protocol = iscsi {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_defaults.trace_flags = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_defaults.unique_fqdn_network = True {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_defaults.use_chap_auth = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_defaults.volume_backend_name = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_defaults.volume_clear = zero {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_defaults.volume_clear_ionice = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_defaults.volume_clear_size = 0 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] oslo_reports.file_event_handler = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] oslo_reports.file_event_handler_interval = 1 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] oslo_reports.log_dir = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] QuobyteHD.backend_availability_zone = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] QuobyteHD.backend_host = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] QuobyteHD.chap_password = **** {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] QuobyteHD.chap_username = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] QuobyteHD.chiscsi_conf = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] QuobyteHD.disk_geometry = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] QuobyteHD.driver_client_cert = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] QuobyteHD.driver_client_cert_key = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] QuobyteHD.driver_data_namespace = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] QuobyteHD.driver_use_ssl = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] QuobyteHD.enable_unsupported_driver = True {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] QuobyteHD.extra_capabilities = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] QuobyteHD.filter_function = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] QuobyteHD.goodness_function = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] QuobyteHD.iscsi_target_flags = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] QuobyteHD.iscsi_write_cache = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] QuobyteHD.iser_helper = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] QuobyteHD.iser_ip_address = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] QuobyteHD.iser_port = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] QuobyteHD.iser_target_prefix = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] QuobyteHD.nas_host = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] QuobyteHD.nas_login = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] QuobyteHD.nas_mount_options = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] QuobyteHD.nas_password = **** {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] QuobyteHD.nas_private_key = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] QuobyteHD.nas_secure_file_operations = false {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] QuobyteHD.nas_share_path = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] QuobyteHD.nas_ssh_port = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] QuobyteHD.nas_volume_prov_type = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] QuobyteHD.num_iser_scan_tries = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] QuobyteHD.num_shell_tries = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] QuobyteHD.nvmet_ns_id = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] QuobyteHD.nvmet_port_id = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] QuobyteHD.replication_device = **** {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] QuobyteHD.report_discard_supported = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] QuobyteHD.reserved_percentage = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] QuobyteHD.scst_target_driver = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] QuobyteHD.scst_target_iqn_name = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] QuobyteHD.storage_protocol = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] QuobyteHD.target_helper = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] QuobyteHD.target_ip_address = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] QuobyteHD.target_port = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] QuobyteHD.target_prefix = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] QuobyteHD.target_protocol = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] QuobyteHD.trace_flags = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] QuobyteHD.unique_fqdn_network = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] QuobyteHD.use_chap_auth = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] QuobyteHD.volume_clear = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] QuobyteHD.volume_clear_ionice = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] QuobyteHD.volume_clear_size = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] QuobyteHD.volume_dd_blocksize = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] QuobyteHD.volumes_dir = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] oslo_messaging_rabbit.hostname = devstack {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] oslo_messaging_rabbit.ssl = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] oslo_messaging_rabbit.ssl_version = {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] oslo_messaging_notifications.driver = [] {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] oslo_messaging_notifications.retry = -1 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] oslo_messaging_notifications.transport_url = **** {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] key_manager.fixed_key = **** {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] barbican.barbican_api_version = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] barbican.barbican_endpoint = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] barbican.barbican_endpoint_type = public {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] barbican.barbican_region_name = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] barbican.cafile = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] barbican.certfile = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] barbican.collect_timing = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] barbican.insecure = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] barbican.keyfile = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] barbican.number_of_retries = 60 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] barbican.retry_delay = 1 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] barbican.send_service_user_token = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] barbican.split_loggers = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] barbican.timeout = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] barbican.verify_ssl = True {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] barbican.verify_ssl_path = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] barbican_service_user.auth_section = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] barbican_service_user.auth_type = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] barbican_service_user.cafile = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] barbican_service_user.certfile = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] barbican_service_user.collect_timing = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] barbican_service_user.insecure = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] barbican_service_user.keyfile = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] barbican_service_user.split_loggers = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] barbican_service_user.timeout = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] vault.approle_role_id = **** {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] vault.approle_secret_id = **** {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] vault.auth_method = approle {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] vault.auth_path = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] vault.kv_mountpoint = secret {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] vault.kv_path = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] vault.kv_version = 2 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] vault.namespace = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] vault.root_token_id = **** {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] vault.ssl_ca_crt_file = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] vault.timeout = 60.0 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] vault.token_file = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] vault.token_role = None {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] vault.use_ssl = False {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:12:27 devstack cinder-volume[88356]: DEBUG oslo_service.backend._eventlet.service [None req-d540061a-5cae-4f57-b935-1f3d7c2841eb None None] ******************************************************************************** {{(pid=88356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3552}} Aug 05 10:12:27 devstack sudo[88618]: pam_unix(sudo:session): session closed for user root Aug 05 10:12:27 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7fc53b9d-7bdb-4e35-a3cd-6043f7537cb7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.546s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:12:27 devstack cinder-volume[88613]: INFO cinder.volume.driver [None req-7fc53b9d-7bdb-4e35-a3cd-6043f7537cb7 None None] Driver hasn't implemented _init_vendor_properties() Aug 05 10:12:27 devstack cinder-volume[88613]: DEBUG cinder.volume.driver [None req-7fc53b9d-7bdb-4e35-a3cd-6043f7537cb7 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7257652282715, 'free_capacity_gb': 1775.7257652282715, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88613) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 05 10:12:27 devstack cinder-volume[88613]: DEBUG oslo_db.sqlalchemy.engines [None req-7fc53b9d-7bdb-4e35-a3cd-6043f7537cb7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88613) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 05 10:12:27 devstack cinder-volume[88613]: DEBUG dbcounter [-] [88613] Writer thread running {{(pid=88613) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 05 10:12:27 devstack cinder-volume[88613]: DEBUG cinder.db.api [None req-7fc53b9d-7bdb-4e35-a3cd-6043f7537cb7 None None] Building query based on filter {{(pid=88613) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 05 10:12:27 devstack cinder-volume[88613]: DEBUG cinder.image.image_utils [None req-7fc53b9d-7bdb-4e35-a3cd-6043f7537cb7 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=88613) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 05 10:12:27 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-7fc53b9d-7bdb-4e35-a3cd-6043f7537cb7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:12:27 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-7fc53b9d-7bdb-4e35-a3cd-6043f7537cb7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:12:27 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-7fc53b9d-7bdb-4e35-a3cd-6043f7537cb7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:12:27 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-7fc53b9d-7bdb-4e35-a3cd-6043f7537cb7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:12:27 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-7fc53b9d-7bdb-4e35-a3cd-6043f7537cb7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:12:27 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7fc53b9d-7bdb-4e35-a3cd-6043f7537cb7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:12:27 devstack cinder-volume[88613]: INFO cinder.keymgr.migration [None req-31dbabd2-22ad-40ca-8b8b-931826e22ae1 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 05 10:12:27 devstack sudo[88637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:12:27 devstack sudo[88637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:12:28 devstack sudo[88637]: pam_unix(sudo:session): session closed for user root Aug 05 10:12:28 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7fc53b9d-7bdb-4e35-a3cd-6043f7537cb7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.294s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:12:28 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-7fc53b9d-7bdb-4e35-a3cd-6043f7537cb7 None None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:12:28 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-7fc53b9d-7bdb-4e35-a3cd-6043f7537cb7 None None] Driver initialization completed successfully. Aug 05 10:12:28 devstack cinder-volume[88613]: INFO cinder.manager [None req-7fc53b9d-7bdb-4e35-a3cd-6043f7537cb7 None None] Initiating service 3 cleanup Aug 05 10:12:28 devstack cinder-volume[88613]: INFO cinder.manager [None req-7fc53b9d-7bdb-4e35-a3cd-6043f7537cb7 None None] Service 3 cleanup completed. Aug 05 10:12:28 devstack cinder-volume[88613]: DEBUG cinder.service [None req-7fc53b9d-7bdb-4e35-a3cd-6043f7537cb7 None None] Creating RPC server for service cinder-volume {{(pid=88613) start /opt/stack/cinder/cinder/service.py:231}} Aug 05 10:12:28 devstack cinder-volume[88613]: DEBUG cinder.service [None req-7fc53b9d-7bdb-4e35-a3cd-6043f7537cb7 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=88613) start /opt/stack/cinder/cinder/service.py:237}} Aug 05 10:12:28 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-7fc53b9d-7bdb-4e35-a3cd-6043f7537cb7 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Aug 05 10:12:28 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-7fc53b9d-7bdb-4e35-a3cd-6043f7537cb7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:12:28 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-7fc53b9d-7bdb-4e35-a3cd-6043f7537cb7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:12:28 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-7fc53b9d-7bdb-4e35-a3cd-6043f7537cb7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:12:28 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-7fc53b9d-7bdb-4e35-a3cd-6043f7537cb7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:12:28 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-7fc53b9d-7bdb-4e35-a3cd-6043f7537cb7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:12:28 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7fc53b9d-7bdb-4e35-a3cd-6043f7537cb7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:12:28 devstack sudo[88642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:12:28 devstack sudo[88642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:12:28 devstack sudo[88642]: pam_unix(sudo:session): session closed for user root Aug 05 10:12:28 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7fc53b9d-7bdb-4e35-a3cd-6043f7537cb7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.361s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:12:28 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-7fc53b9d-7bdb-4e35-a3cd-6043f7537cb7 None None] Driver post RPC initialization completed successfully. Aug 05 10:12:36 devstack cinder-volume[88356]: DEBUG dbcounter [-] [88356] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=88356) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:12:38 devstack cinder-volume[88613]: DEBUG dbcounter [-] [88613] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=88613) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:12:38 devstack cinder-volume[88613]: DEBUG dbcounter [-] [88613] Writing DB stats cinder:SELECT=3 {{(pid=88613) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:13:21 devstack cinder-volume[88613]: DEBUG oslo_service.periodic_task [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Running periodic task VolumeManager._thread_info {{(pid=88613) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:13:21 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] thread count: 6 {{(pid=88613) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 10:13:21 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] thread info: [<_MainThread(MainThread, started 126173666128000)>, , , , , ] {{(pid=88613) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 10:13:30 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c5c00ed-b6fa-467a-b307-567ff4f61920 tempest-TaggedAttachmentsTest-2059137617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:13:30 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3c5c00ed-b6fa-467a-b307-567ff4f61920 tempest-TaggedAttachmentsTest-2059137617 None] Flow 'volume_create_manager' (609cba88-acc2-49dd-88ee-da1be110bc08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:13:30 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3c5c00ed-b6fa-467a-b307-567ff4f61920 tempest-TaggedAttachmentsTest-2059137617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0207e0b4-7562-4189-ae39-7c9ec3acea2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:13:30 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3c5c00ed-b6fa-467a-b307-567ff4f61920 tempest-TaggedAttachmentsTest-2059137617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0207e0b4-7562-4189-ae39-7c9ec3acea2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:13:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-2012905223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad85ce5a-008e-4aeb-964e-93c121aefd8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a14001aab6844cc7844591bdd605205b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:13:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:13:30Z,use_quota=True,user_id='e340e1f1464a45e5a79983a00248f290',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:13:30 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3c5c00ed-b6fa-467a-b307-567ff4f61920 tempest-TaggedAttachmentsTest-2059137617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d0fecd3-0b5c-4e78-9c2c-d85d244c13a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:13:30 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3c5c00ed-b6fa-467a-b307-567ff4f61920 tempest-TaggedAttachmentsTest-2059137617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d0fecd3-0b5c-4e78-9c2c-d85d244c13a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:13:30 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3c5c00ed-b6fa-467a-b307-567ff4f61920 tempest-TaggedAttachmentsTest-2059137617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b76401b-d0c7-49a8-891f-5e46f38e9525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:13:30 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3c5c00ed-b6fa-467a-b307-567ff4f61920 tempest-TaggedAttachmentsTest-2059137617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b76401b-d0c7-49a8-891f-5e46f38e9525) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad85ce5a-008e-4aeb-964e-93c121aefd8b', 'volume_name': 'volume-ad85ce5a-008e-4aeb-964e-93c121aefd8b', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:13:30 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3c5c00ed-b6fa-467a-b307-567ff4f61920 tempest-TaggedAttachmentsTest-2059137617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d03f4ca5-62a1-4eb3-baa2-d1f32c95e1d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:13:30 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3c5c00ed-b6fa-467a-b307-567ff4f61920 tempest-TaggedAttachmentsTest-2059137617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d03f4ca5-62a1-4eb3-baa2-d1f32c95e1d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:13:30 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3c5c00ed-b6fa-467a-b307-567ff4f61920 tempest-TaggedAttachmentsTest-2059137617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ea56194-1cc9-4eec-9c93-6f25a8ddb3b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:13:30 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-3c5c00ed-b6fa-467a-b307-567ff4f61920 tempest-TaggedAttachmentsTest-2059137617 None] Volume ad85ce5a-008e-4aeb-964e-93c121aefd8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad85ce5a-008e-4aeb-964e-93c121aefd8b', 'volume_size': 1} Aug 05 10:13:30 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-3c5c00ed-b6fa-467a-b307-567ff4f61920 tempest-TaggedAttachmentsTest-2059137617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:13:30 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-3c5c00ed-b6fa-467a-b307-567ff4f61920 tempest-TaggedAttachmentsTest-2059137617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:13:30 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-3c5c00ed-b6fa-467a-b307-567ff4f61920 tempest-TaggedAttachmentsTest-2059137617 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:13:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-2012905223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad85ce5a-008e-4aeb-964e-93c121aefd8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a14001aab6844cc7844591bdd605205b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:13:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:13:30Z,use_quota=True,user_id='e340e1f1464a45e5a79983a00248f290',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:13:30 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-3c5c00ed-b6fa-467a-b307-567ff4f61920 tempest-TaggedAttachmentsTest-2059137617 None] Creating volume ad85ce5a-008e-4aeb-964e-93c121aefd8b {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:13:30 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-3c5c00ed-b6fa-467a-b307-567ff4f61920 tempest-TaggedAttachmentsTest-2059137617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:13:30 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-3c5c00ed-b6fa-467a-b307-567ff4f61920 tempest-TaggedAttachmentsTest-2059137617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:13:30 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-3c5c00ed-b6fa-467a-b307-567ff4f61920 tempest-TaggedAttachmentsTest-2059137617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:13:30 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-3c5c00ed-b6fa-467a-b307-567ff4f61920 tempest-TaggedAttachmentsTest-2059137617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:13:30 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-3c5c00ed-b6fa-467a-b307-567ff4f61920 tempest-TaggedAttachmentsTest-2059137617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:13:30 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-3c5c00ed-b6fa-467a-b307-567ff4f61920 tempest-TaggedAttachmentsTest-2059137617 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:13:30 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-3c5c00ed-b6fa-467a-b307-567ff4f61920 tempest-TaggedAttachmentsTest-2059137617 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:13:30 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3c5c00ed-b6fa-467a-b307-567ff4f61920 tempest-TaggedAttachmentsTest-2059137617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ad85ce5a-008e-4aeb-964e-93c121aefd8b 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:13:30 devstack sudo[89066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ad85ce5a-008e-4aeb-964e-93c121aefd8b 1073741824 Aug 05 10:13:30 devstack sudo[89066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:13:31 devstack sudo[89066]: pam_unix(sudo:session): session closed for user root Aug 05 10:13:31 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3c5c00ed-b6fa-467a-b307-567ff4f61920 tempest-TaggedAttachmentsTest-2059137617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ad85ce5a-008e-4aeb-964e-93c121aefd8b 1073741824" returned: 0 in 0.715s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:13:31 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3c5c00ed-b6fa-467a-b307-567ff4f61920 tempest-TaggedAttachmentsTest-2059137617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ad85ce5a-008e-4aeb-964e-93c121aefd8b {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:13:31 devstack sudo[89399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ad85ce5a-008e-4aeb-964e-93c121aefd8b Aug 05 10:13:31 devstack sudo[89399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:13:31 devstack sudo[89399]: pam_unix(sudo:session): session closed for user root Aug 05 10:13:31 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3c5c00ed-b6fa-467a-b307-567ff4f61920 tempest-TaggedAttachmentsTest-2059137617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ad85ce5a-008e-4aeb-964e-93c121aefd8b" returned: 0 in 0.423s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:13:31 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-3c5c00ed-b6fa-467a-b307-567ff4f61920 tempest-TaggedAttachmentsTest-2059137617 None] <== create_volume: return (1216ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:13:31 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-3c5c00ed-b6fa-467a-b307-567ff4f61920 tempest-TaggedAttachmentsTest-2059137617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.219s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:13:31 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3c5c00ed-b6fa-467a-b307-567ff4f61920 tempest-TaggedAttachmentsTest-2059137617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ea56194-1cc9-4eec-9c93-6f25a8ddb3b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad85ce5a-008e-4aeb-964e-93c121aefd8b', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:13:31 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3c5c00ed-b6fa-467a-b307-567ff4f61920 tempest-TaggedAttachmentsTest-2059137617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7eb2dc6d-a832-4a3d-9a3a-1efef2848336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:13:31 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-3c5c00ed-b6fa-467a-b307-567ff4f61920 tempest-TaggedAttachmentsTest-2059137617 None] Volume volume-ad85ce5a-008e-4aeb-964e-93c121aefd8b (ad85ce5a-008e-4aeb-964e-93c121aefd8b): created successfully Aug 05 10:13:31 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3c5c00ed-b6fa-467a-b307-567ff4f61920 tempest-TaggedAttachmentsTest-2059137617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7eb2dc6d-a832-4a3d-9a3a-1efef2848336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:13:31 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3c5c00ed-b6fa-467a-b307-567ff4f61920 tempest-TaggedAttachmentsTest-2059137617 None] Flow 'volume_create_manager' (609cba88-acc2-49dd-88ee-da1be110bc08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:13:31 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-3c5c00ed-b6fa-467a-b307-567ff4f61920 tempest-TaggedAttachmentsTest-2059137617 None] Created volume successfully. Aug 05 10:13:41 devstack cinder-volume[88613]: DEBUG dbcounter [-] [88613] Writing DB stats cinder:UPDATE=4,cinder:SELECT=3,cinder:INSERT=1 {{(pid=88613) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:13:41 devstack cinder-volume[88613]: DEBUG dbcounter [-] [88613] Writing DB stats cinder:SELECT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=88613) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:13:49 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c9ef709-1b7d-4a0f-9389-00ae8365fc12 tempest-VolumesAdminNegativeTest-1176183163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:13:49 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3c9ef709-1b7d-4a0f-9389-00ae8365fc12 tempest-VolumesAdminNegativeTest-1176183163 None] Flow 'volume_create_manager' (8071b2ce-61a6-4e98-bcf7-7cf1594002d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:13:49 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3c9ef709-1b7d-4a0f-9389-00ae8365fc12 tempest-VolumesAdminNegativeTest-1176183163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66709f0d-97db-40fe-8451-b6bad4f48499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:13:49 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3c9ef709-1b7d-4a0f-9389-00ae8365fc12 tempest-VolumesAdminNegativeTest-1176183163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66709f0d-97db-40fe-8451-b6bad4f48499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:13:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1538038125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50cc5b0f-f62f-40e6-955f-976435bfd24a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d83d55655d2344d7a24432a0bf597fd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:13:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:13:49Z,use_quota=True,user_id='f44078adec0d45b888db8e1b9ac51851',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:13:49 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3c9ef709-1b7d-4a0f-9389-00ae8365fc12 tempest-VolumesAdminNegativeTest-1176183163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f865c55d-2aaa-475f-9764-3c9d1357efa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:13:49 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3c9ef709-1b7d-4a0f-9389-00ae8365fc12 tempest-VolumesAdminNegativeTest-1176183163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f865c55d-2aaa-475f-9764-3c9d1357efa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:13:49 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3c9ef709-1b7d-4a0f-9389-00ae8365fc12 tempest-VolumesAdminNegativeTest-1176183163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cff17fb-7ab6-4e3f-acdc-63a21eab0a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:13:49 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3c9ef709-1b7d-4a0f-9389-00ae8365fc12 tempest-VolumesAdminNegativeTest-1176183163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cff17fb-7ab6-4e3f-acdc-63a21eab0a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50cc5b0f-f62f-40e6-955f-976435bfd24a', 'volume_name': 'volume-50cc5b0f-f62f-40e6-955f-976435bfd24a', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:13:49 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3c9ef709-1b7d-4a0f-9389-00ae8365fc12 tempest-VolumesAdminNegativeTest-1176183163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c510bd5-71e4-4fad-9d27-6a17d75d4082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:13:49 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3c9ef709-1b7d-4a0f-9389-00ae8365fc12 tempest-VolumesAdminNegativeTest-1176183163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c510bd5-71e4-4fad-9d27-6a17d75d4082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:13:49 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3c9ef709-1b7d-4a0f-9389-00ae8365fc12 tempest-VolumesAdminNegativeTest-1176183163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79c6496c-cafc-4f5c-ade8-215df0f77cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:13:49 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-3c9ef709-1b7d-4a0f-9389-00ae8365fc12 tempest-VolumesAdminNegativeTest-1176183163 None] Volume 50cc5b0f-f62f-40e6-955f-976435bfd24a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50cc5b0f-f62f-40e6-955f-976435bfd24a', 'volume_size': 1} Aug 05 10:13:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-3c9ef709-1b7d-4a0f-9389-00ae8365fc12 tempest-VolumesAdminNegativeTest-1176183163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:13:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-3c9ef709-1b7d-4a0f-9389-00ae8365fc12 tempest-VolumesAdminNegativeTest-1176183163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:13:49 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-3c9ef709-1b7d-4a0f-9389-00ae8365fc12 tempest-VolumesAdminNegativeTest-1176183163 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:13:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1538038125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50cc5b0f-f62f-40e6-955f-976435bfd24a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d83d55655d2344d7a24432a0bf597fd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:13:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:13:49Z,use_quota=True,user_id='f44078adec0d45b888db8e1b9ac51851',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:13:49 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-3c9ef709-1b7d-4a0f-9389-00ae8365fc12 tempest-VolumesAdminNegativeTest-1176183163 None] Creating volume 50cc5b0f-f62f-40e6-955f-976435bfd24a {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:13:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-3c9ef709-1b7d-4a0f-9389-00ae8365fc12 tempest-VolumesAdminNegativeTest-1176183163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:13:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-3c9ef709-1b7d-4a0f-9389-00ae8365fc12 tempest-VolumesAdminNegativeTest-1176183163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:13:49 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-3c9ef709-1b7d-4a0f-9389-00ae8365fc12 tempest-VolumesAdminNegativeTest-1176183163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:13:49 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-3c9ef709-1b7d-4a0f-9389-00ae8365fc12 tempest-VolumesAdminNegativeTest-1176183163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:13:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-3c9ef709-1b7d-4a0f-9389-00ae8365fc12 tempest-VolumesAdminNegativeTest-1176183163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:13:49 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-3c9ef709-1b7d-4a0f-9389-00ae8365fc12 tempest-VolumesAdminNegativeTest-1176183163 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:13:49 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-3c9ef709-1b7d-4a0f-9389-00ae8365fc12 tempest-VolumesAdminNegativeTest-1176183163 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:13:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3c9ef709-1b7d-4a0f-9389-00ae8365fc12 tempest-VolumesAdminNegativeTest-1176183163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50cc5b0f-f62f-40e6-955f-976435bfd24a 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:13:49 devstack sudo[89784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50cc5b0f-f62f-40e6-955f-976435bfd24a 1073741824 Aug 05 10:13:49 devstack sudo[89784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:13:50 devstack sudo[89784]: pam_unix(sudo:session): session closed for user root Aug 05 10:13:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3c9ef709-1b7d-4a0f-9389-00ae8365fc12 tempest-VolumesAdminNegativeTest-1176183163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50cc5b0f-f62f-40e6-955f-976435bfd24a 1073741824" returned: 0 in 0.811s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:13:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3c9ef709-1b7d-4a0f-9389-00ae8365fc12 tempest-VolumesAdminNegativeTest-1176183163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50cc5b0f-f62f-40e6-955f-976435bfd24a {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:13:50 devstack sudo[89792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50cc5b0f-f62f-40e6-955f-976435bfd24a Aug 05 10:13:50 devstack sudo[89792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:13:50 devstack sudo[89792]: pam_unix(sudo:session): session closed for user root Aug 05 10:13:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3c9ef709-1b7d-4a0f-9389-00ae8365fc12 tempest-VolumesAdminNegativeTest-1176183163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50cc5b0f-f62f-40e6-955f-976435bfd24a" returned: 0 in 0.310s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:13:50 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-3c9ef709-1b7d-4a0f-9389-00ae8365fc12 tempest-VolumesAdminNegativeTest-1176183163 None] <== create_volume: return (1180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:13:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-3c9ef709-1b7d-4a0f-9389-00ae8365fc12 tempest-VolumesAdminNegativeTest-1176183163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.191s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:13:50 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3c9ef709-1b7d-4a0f-9389-00ae8365fc12 tempest-VolumesAdminNegativeTest-1176183163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79c6496c-cafc-4f5c-ade8-215df0f77cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50cc5b0f-f62f-40e6-955f-976435bfd24a', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:13:50 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3c9ef709-1b7d-4a0f-9389-00ae8365fc12 tempest-VolumesAdminNegativeTest-1176183163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (036102a9-9898-4c9f-9e20-d62d79d20edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:13:50 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-3c9ef709-1b7d-4a0f-9389-00ae8365fc12 tempest-VolumesAdminNegativeTest-1176183163 None] Volume volume-50cc5b0f-f62f-40e6-955f-976435bfd24a (50cc5b0f-f62f-40e6-955f-976435bfd24a): created successfully Aug 05 10:13:50 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3c9ef709-1b7d-4a0f-9389-00ae8365fc12 tempest-VolumesAdminNegativeTest-1176183163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (036102a9-9898-4c9f-9e20-d62d79d20edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:13:50 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3c9ef709-1b7d-4a0f-9389-00ae8365fc12 tempest-VolumesAdminNegativeTest-1176183163 None] Flow 'volume_create_manager' (8071b2ce-61a6-4e98-bcf7-7cf1594002d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:13:50 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-3c9ef709-1b7d-4a0f-9389-00ae8365fc12 tempest-VolumesAdminNegativeTest-1176183163 None] Created volume successfully. Aug 05 10:13:51 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-c85071c2-2155-44aa-97e8-3f2c373e18cb tempest-VolumesAdminNegativeTest-1176183163 None] Acquiring lock "cinder-50cc5b0f-f62f-40e6-955f-976435bfd24a-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:13:51 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-c85071c2-2155-44aa-97e8-3f2c373e18cb tempest-VolumesAdminNegativeTest-1176183163 None] Lock "cinder-50cc5b0f-f62f-40e6-955f-976435bfd24a-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:13:52 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-c85071c2-2155-44aa-97e8-3f2c373e18cb tempest-VolumesAdminNegativeTest-1176183163 None] Acquiring lock "cinder-quobyte-50cc5b0f-f62f-40e6-955f-976435bfd24a" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:13:52 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-c85071c2-2155-44aa-97e8-3f2c373e18cb tempest-VolumesAdminNegativeTest-1176183163 None] Lock "cinder-quobyte-50cc5b0f-f62f-40e6-955f-976435bfd24a" acquired by "delete_volume" :: waited 0.021s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:13:52 devstack cinder-volume[88613]: INFO oslo.privsep.daemon [None req-c85071c2-2155-44aa-97e8-3f2c373e18cb tempest-VolumesAdminNegativeTest-1176183163 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpj1fiwgo_/privsep.sock'] Aug 05 10:13:52 devstack sudo[89797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpj1fiwgo_/privsep.sock Aug 05 10:13:52 devstack sudo[89797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:13:53 devstack cinder-volume[88613]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Aug 05 10:13:53 devstack cinder-volume[88613]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 05 10:13:53 devstack cinder-volume[88613]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Aug 05 10:13:53 devstack cinder-volume[88613]: WARNING oslo.privsep.daemon [-] privsep log: Aug 05 10:13:53 devstack cinder-volume[88613]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Aug 05 10:13:53 devstack cinder-volume[88613]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Aug 05 10:13:53 devstack cinder-volume[88613]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 05 10:13:53 devstack cinder-volume[88613]: WARNING oslo.privsep.daemon [-] privsep log: Aug 05 10:13:53 devstack cinder-volume[88613]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Aug 05 10:13:53 devstack sudo[89797]: pam_unix(sudo:session): session closed for user root Aug 05 10:13:53 devstack cinder-volume[88613]: INFO oslo.privsep.daemon [None req-c85071c2-2155-44aa-97e8-3f2c373e18cb tempest-VolumesAdminNegativeTest-1176183163 None] Spawned new privsep daemon via rootwrap Aug 05 10:13:53 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [None req-c85071c2-2155-44aa-97e8-3f2c373e18cb tempest-VolumesAdminNegativeTest-1176183163 None] Accepted privsep connection to /tmp/tmpj1fiwgo_/privsep.sock {{(pid=88613) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Aug 05 10:13:53 devstack cinder-volume[88613]: INFO oslo.privsep.daemon [-] privsep daemon starting Aug 05 10:13:53 devstack cinder-volume[88613]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Aug 05 10:13:53 devstack cinder-volume[88613]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Aug 05 10:13:53 devstack cinder-volume[88613]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 89803 Aug 05 10:13:53 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c1c0b7-6e1f-4f86-b21b-05cb7f64a726]: (2,) {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:13:53 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf766b9-31a9-48b9-b3cc-60a5bb6c5485]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:13:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c85071c2-2155-44aa-97e8-3f2c373e18cb tempest-VolumesAdminNegativeTest-1176183163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50cc5b0f-f62f-40e6-955f-976435bfd24a {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:13:54 devstack sudo[89810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50cc5b0f-f62f-40e6-955f-976435bfd24a Aug 05 10:13:54 devstack sudo[89810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:13:54 devstack sudo[89810]: pam_unix(sudo:session): session closed for user root Aug 05 10:13:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c85071c2-2155-44aa-97e8-3f2c373e18cb tempest-VolumesAdminNegativeTest-1176183163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50cc5b0f-f62f-40e6-955f-976435bfd24a" returned: 0 in 1.067s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:13:55 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c85071c2-2155-44aa-97e8-3f2c373e18cb tempest-VolumesAdminNegativeTest-1176183163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50cc5b0f-f62f-40e6-955f-976435bfd24a {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:13:55 devstack sudo[89853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50cc5b0f-f62f-40e6-955f-976435bfd24a Aug 05 10:13:55 devstack sudo[89853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:13:55 devstack sudo[89853]: pam_unix(sudo:session): session closed for user root Aug 05 10:13:55 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c85071c2-2155-44aa-97e8-3f2c373e18cb tempest-VolumesAdminNegativeTest-1176183163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50cc5b0f-f62f-40e6-955f-976435bfd24a" returned: 0 in 0.670s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:13:55 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-c85071c2-2155-44aa-97e8-3f2c373e18cb tempest-VolumesAdminNegativeTest-1176183163 None] Lock "cinder-quobyte-50cc5b0f-f62f-40e6-955f-976435bfd24a" released by "delete_volume" :: held 3.630s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:13:55 devstack cinder-volume[88613]: WARNING cinder.quota [None req-c85071c2-2155-44aa-97e8-3f2c373e18cb tempest-VolumesAdminNegativeTest-1176183163 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 05 10:13:55 devstack cinder-volume[88613]: WARNING cinder.quota [None req-c85071c2-2155-44aa-97e8-3f2c373e18cb tempest-VolumesAdminNegativeTest-1176183163 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 05 10:13:55 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-c85071c2-2155-44aa-97e8-3f2c373e18cb tempest-VolumesAdminNegativeTest-1176183163 None] Created reservations ['5324fb19-cfcf-4d1e-999b-93495da95b72', '5a0ba632-556e-4755-bf99-ba05287961bb', 'c884e12b-815a-4c39-be9b-72d91f5b2da8', 'e2e95dd5-20d3-443b-bc4f-e2014b5ad6ba'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:13:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c85071c2-2155-44aa-97e8-3f2c373e18cb tempest-VolumesAdminNegativeTest-1176183163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:13:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c85071c2-2155-44aa-97e8-3f2c373e18cb tempest-VolumesAdminNegativeTest-1176183163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:13:56 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-c85071c2-2155-44aa-97e8-3f2c373e18cb tempest-VolumesAdminNegativeTest-1176183163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:13:56 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-c85071c2-2155-44aa-97e8-3f2c373e18cb tempest-VolumesAdminNegativeTest-1176183163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:13:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c85071c2-2155-44aa-97e8-3f2c373e18cb tempest-VolumesAdminNegativeTest-1176183163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:13:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c85071c2-2155-44aa-97e8-3f2c373e18cb tempest-VolumesAdminNegativeTest-1176183163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:13:56 devstack sudo[89883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:13:56 devstack sudo[89883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:13:56 devstack sudo[89883]: pam_unix(sudo:session): session closed for user root Aug 05 10:13:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c85071c2-2155-44aa-97e8-3f2c373e18cb tempest-VolumesAdminNegativeTest-1176183163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.753s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:13:56 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-c85071c2-2155-44aa-97e8-3f2c373e18cb tempest-VolumesAdminNegativeTest-1176183163 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:13:57 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-c85071c2-2155-44aa-97e8-3f2c373e18cb tempest-VolumesAdminNegativeTest-1176183163 None] Deleted volume successfully. Aug 05 10:13:57 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-c85071c2-2155-44aa-97e8-3f2c373e18cb tempest-VolumesAdminNegativeTest-1176183163 None] Lock "cinder-50cc5b0f-f62f-40e6-955f-976435bfd24a-delete_volume" released by "delete_volume" :: held 5.098s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:14:06 devstack cinder-volume[88613]: DEBUG dbcounter [-] [88613] Writing DB stats cinder:SELECT=7,cinder:UPDATE=14,cinder:INSERT=5 {{(pid=88613) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:14:07 devstack cinder-volume[88613]: DEBUG dbcounter [-] [88613] Writing DB stats cinder:SELECT=7,cinder:UPDATE=8,cinder:DELETE=2 {{(pid=88613) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:14:10 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-697c699a-4849-4d8d-b8f4-f2258d859f7a tempest-ServersNegativeTestJSON-1136974689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:14:10 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-697c699a-4849-4d8d-b8f4-f2258d859f7a tempest-ServersNegativeTestJSON-1136974689 None] Flow 'volume_create_manager' (8a0fffba-5af2-48d8-ad59-1bfb1a91c40a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:14:10 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-697c699a-4849-4d8d-b8f4-f2258d859f7a tempest-ServersNegativeTestJSON-1136974689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea9edf0e-8da6-46a2-b0ae-c3d17b9d4081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:14:10 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-697c699a-4849-4d8d-b8f4-f2258d859f7a tempest-ServersNegativeTestJSON-1136974689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea9edf0e-8da6-46a2-b0ae-c3d17b9d4081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:14:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1641719523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=790f6330-fa86-40e4-a20b-7286dbaa0e6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98db462775ae409d9349213a7867b143',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:14:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:14:10Z,use_quota=True,user_id='9c7d17d1e72f4ec6abe2465afc3297cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:14:10 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-697c699a-4849-4d8d-b8f4-f2258d859f7a tempest-ServersNegativeTestJSON-1136974689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0210816b-bf07-4387-a590-25cdc2e886a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:14:10 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-697c699a-4849-4d8d-b8f4-f2258d859f7a tempest-ServersNegativeTestJSON-1136974689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0210816b-bf07-4387-a590-25cdc2e886a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:14:10 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-697c699a-4849-4d8d-b8f4-f2258d859f7a tempest-ServersNegativeTestJSON-1136974689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7faff41-cf13-46ee-8e4b-e4ec4d4e7333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:14:10 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-697c699a-4849-4d8d-b8f4-f2258d859f7a tempest-ServersNegativeTestJSON-1136974689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7faff41-cf13-46ee-8e4b-e4ec4d4e7333) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '790f6330-fa86-40e4-a20b-7286dbaa0e6f', 'volume_name': 'volume-790f6330-fa86-40e4-a20b-7286dbaa0e6f', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:14:10 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-697c699a-4849-4d8d-b8f4-f2258d859f7a tempest-ServersNegativeTestJSON-1136974689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b2a4073-4a62-4e4d-89e1-cc644043a233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:14:10 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-697c699a-4849-4d8d-b8f4-f2258d859f7a tempest-ServersNegativeTestJSON-1136974689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b2a4073-4a62-4e4d-89e1-cc644043a233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:14:10 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-697c699a-4849-4d8d-b8f4-f2258d859f7a tempest-ServersNegativeTestJSON-1136974689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (053e7996-9dce-4b0a-81e7-6dc113c9daf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:14:10 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-697c699a-4849-4d8d-b8f4-f2258d859f7a tempest-ServersNegativeTestJSON-1136974689 None] Volume 790f6330-fa86-40e4-a20b-7286dbaa0e6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-790f6330-fa86-40e4-a20b-7286dbaa0e6f', 'volume_size': 1} Aug 05 10:14:10 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-697c699a-4849-4d8d-b8f4-f2258d859f7a tempest-ServersNegativeTestJSON-1136974689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:14:10 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-697c699a-4849-4d8d-b8f4-f2258d859f7a tempest-ServersNegativeTestJSON-1136974689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:14:10 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-697c699a-4849-4d8d-b8f4-f2258d859f7a tempest-ServersNegativeTestJSON-1136974689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:14:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1641719523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=790f6330-fa86-40e4-a20b-7286dbaa0e6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98db462775ae409d9349213a7867b143',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:14:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:14:10Z,use_quota=True,user_id='9c7d17d1e72f4ec6abe2465afc3297cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:14:10 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-697c699a-4849-4d8d-b8f4-f2258d859f7a tempest-ServersNegativeTestJSON-1136974689 None] Creating volume 790f6330-fa86-40e4-a20b-7286dbaa0e6f {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:14:10 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-697c699a-4849-4d8d-b8f4-f2258d859f7a tempest-ServersNegativeTestJSON-1136974689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:14:10 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-697c699a-4849-4d8d-b8f4-f2258d859f7a tempest-ServersNegativeTestJSON-1136974689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:14:10 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-697c699a-4849-4d8d-b8f4-f2258d859f7a tempest-ServersNegativeTestJSON-1136974689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:14:10 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-697c699a-4849-4d8d-b8f4-f2258d859f7a tempest-ServersNegativeTestJSON-1136974689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:14:10 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-697c699a-4849-4d8d-b8f4-f2258d859f7a tempest-ServersNegativeTestJSON-1136974689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:14:10 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-697c699a-4849-4d8d-b8f4-f2258d859f7a tempest-ServersNegativeTestJSON-1136974689 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:14:10 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-697c699a-4849-4d8d-b8f4-f2258d859f7a tempest-ServersNegativeTestJSON-1136974689 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:14:10 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-697c699a-4849-4d8d-b8f4-f2258d859f7a tempest-ServersNegativeTestJSON-1136974689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-790f6330-fa86-40e4-a20b-7286dbaa0e6f 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:14:10 devstack sudo[90062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-790f6330-fa86-40e4-a20b-7286dbaa0e6f 1073741824 Aug 05 10:14:10 devstack sudo[90062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:14:11 devstack sudo[90062]: pam_unix(sudo:session): session closed for user root Aug 05 10:14:11 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-697c699a-4849-4d8d-b8f4-f2258d859f7a tempest-ServersNegativeTestJSON-1136974689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-790f6330-fa86-40e4-a20b-7286dbaa0e6f 1073741824" returned: 0 in 0.820s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:14:11 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-697c699a-4849-4d8d-b8f4-f2258d859f7a tempest-ServersNegativeTestJSON-1136974689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-790f6330-fa86-40e4-a20b-7286dbaa0e6f {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:14:11 devstack sudo[90070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-790f6330-fa86-40e4-a20b-7286dbaa0e6f Aug 05 10:14:11 devstack sudo[90070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:14:11 devstack sudo[90070]: pam_unix(sudo:session): session closed for user root Aug 05 10:14:11 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-697c699a-4849-4d8d-b8f4-f2258d859f7a tempest-ServersNegativeTestJSON-1136974689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-790f6330-fa86-40e4-a20b-7286dbaa0e6f" returned: 0 in 0.329s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:14:11 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-697c699a-4849-4d8d-b8f4-f2258d859f7a tempest-ServersNegativeTestJSON-1136974689 None] <== create_volume: return (1211ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:14:11 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-697c699a-4849-4d8d-b8f4-f2258d859f7a tempest-ServersNegativeTestJSON-1136974689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.213s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:14:11 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-697c699a-4849-4d8d-b8f4-f2258d859f7a tempest-ServersNegativeTestJSON-1136974689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (053e7996-9dce-4b0a-81e7-6dc113c9daf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-790f6330-fa86-40e4-a20b-7286dbaa0e6f', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:14:11 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-697c699a-4849-4d8d-b8f4-f2258d859f7a tempest-ServersNegativeTestJSON-1136974689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f630229a-845b-4d5c-a9b6-13c4ab574a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:14:11 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-697c699a-4849-4d8d-b8f4-f2258d859f7a tempest-ServersNegativeTestJSON-1136974689 None] Volume volume-790f6330-fa86-40e4-a20b-7286dbaa0e6f (790f6330-fa86-40e4-a20b-7286dbaa0e6f): created successfully Aug 05 10:14:11 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-697c699a-4849-4d8d-b8f4-f2258d859f7a tempest-ServersNegativeTestJSON-1136974689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f630229a-845b-4d5c-a9b6-13c4ab574a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:14:11 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-697c699a-4849-4d8d-b8f4-f2258d859f7a tempest-ServersNegativeTestJSON-1136974689 None] Flow 'volume_create_manager' (8a0fffba-5af2-48d8-ad59-1bfb1a91c40a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:14:11 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-697c699a-4849-4d8d-b8f4-f2258d859f7a tempest-ServersNegativeTestJSON-1136974689 None] Created volume successfully. Aug 05 10:14:18 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c352aeb-eccf-4cb1-85ed-1ef30c234984 tempest-ServersNegativeTestJSON-1136974689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:14:18 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-4c352aeb-eccf-4cb1-85ed-1ef30c234984 tempest-ServersNegativeTestJSON-1136974689 None] Flow 'volume_create_manager' (653efca8-583e-4f78-b66a-ca0bf96d0b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:14:18 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-4c352aeb-eccf-4cb1-85ed-1ef30c234984 tempest-ServersNegativeTestJSON-1136974689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb7df7f5-943b-42c7-abfd-296b266549b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:14:18 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-4c352aeb-eccf-4cb1-85ed-1ef30c234984 tempest-ServersNegativeTestJSON-1136974689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb7df7f5-943b-42c7-abfd-296b266549b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1438854839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d60e0b9e-34fb-480a-afab-effa52566cbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98db462775ae409d9349213a7867b143',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:14:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:14:18Z,use_quota=True,user_id='9c7d17d1e72f4ec6abe2465afc3297cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:14:18 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-4c352aeb-eccf-4cb1-85ed-1ef30c234984 tempest-ServersNegativeTestJSON-1136974689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (febd34d9-1a67-4d04-b718-1cf843d9f370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:14:18 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-4c352aeb-eccf-4cb1-85ed-1ef30c234984 tempest-ServersNegativeTestJSON-1136974689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (febd34d9-1a67-4d04-b718-1cf843d9f370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:14:18 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-4c352aeb-eccf-4cb1-85ed-1ef30c234984 tempest-ServersNegativeTestJSON-1136974689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92bcd06d-307b-4f94-bcd4-782581ffc49c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:14:18 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-4c352aeb-eccf-4cb1-85ed-1ef30c234984 tempest-ServersNegativeTestJSON-1136974689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92bcd06d-307b-4f94-bcd4-782581ffc49c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd60e0b9e-34fb-480a-afab-effa52566cbb', 'volume_name': 'volume-d60e0b9e-34fb-480a-afab-effa52566cbb', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:14:18 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-4c352aeb-eccf-4cb1-85ed-1ef30c234984 tempest-ServersNegativeTestJSON-1136974689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cdb1380-0f01-4c51-8be0-656cfb015473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:14:18 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-4c352aeb-eccf-4cb1-85ed-1ef30c234984 tempest-ServersNegativeTestJSON-1136974689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cdb1380-0f01-4c51-8be0-656cfb015473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:14:18 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-4c352aeb-eccf-4cb1-85ed-1ef30c234984 tempest-ServersNegativeTestJSON-1136974689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbbcb61e-b472-45b0-a5b3-00fa7ff74a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:14:18 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-4c352aeb-eccf-4cb1-85ed-1ef30c234984 tempest-ServersNegativeTestJSON-1136974689 None] Volume d60e0b9e-34fb-480a-afab-effa52566cbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d60e0b9e-34fb-480a-afab-effa52566cbb', 'volume_size': 1} Aug 05 10:14:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-4c352aeb-eccf-4cb1-85ed-1ef30c234984 tempest-ServersNegativeTestJSON-1136974689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:14:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-4c352aeb-eccf-4cb1-85ed-1ef30c234984 tempest-ServersNegativeTestJSON-1136974689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:14:18 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-4c352aeb-eccf-4cb1-85ed-1ef30c234984 tempest-ServersNegativeTestJSON-1136974689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1438854839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d60e0b9e-34fb-480a-afab-effa52566cbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98db462775ae409d9349213a7867b143',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:14:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:14:18Z,use_quota=True,user_id='9c7d17d1e72f4ec6abe2465afc3297cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:14:18 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-4c352aeb-eccf-4cb1-85ed-1ef30c234984 tempest-ServersNegativeTestJSON-1136974689 None] Creating volume d60e0b9e-34fb-480a-afab-effa52566cbb {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:14:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-4c352aeb-eccf-4cb1-85ed-1ef30c234984 tempest-ServersNegativeTestJSON-1136974689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:14:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-4c352aeb-eccf-4cb1-85ed-1ef30c234984 tempest-ServersNegativeTestJSON-1136974689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:14:18 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-4c352aeb-eccf-4cb1-85ed-1ef30c234984 tempest-ServersNegativeTestJSON-1136974689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:14:18 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-4c352aeb-eccf-4cb1-85ed-1ef30c234984 tempest-ServersNegativeTestJSON-1136974689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:14:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-4c352aeb-eccf-4cb1-85ed-1ef30c234984 tempest-ServersNegativeTestJSON-1136974689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:14:18 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-4c352aeb-eccf-4cb1-85ed-1ef30c234984 tempest-ServersNegativeTestJSON-1136974689 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:14:18 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-4c352aeb-eccf-4cb1-85ed-1ef30c234984 tempest-ServersNegativeTestJSON-1136974689 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:14:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4c352aeb-eccf-4cb1-85ed-1ef30c234984 tempest-ServersNegativeTestJSON-1136974689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d60e0b9e-34fb-480a-afab-effa52566cbb 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:14:18 devstack sudo[90098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d60e0b9e-34fb-480a-afab-effa52566cbb 1073741824 Aug 05 10:14:18 devstack sudo[90098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:14:19 devstack sudo[90098]: pam_unix(sudo:session): session closed for user root Aug 05 10:14:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4c352aeb-eccf-4cb1-85ed-1ef30c234984 tempest-ServersNegativeTestJSON-1136974689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d60e0b9e-34fb-480a-afab-effa52566cbb 1073741824" returned: 0 in 0.589s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:14:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4c352aeb-eccf-4cb1-85ed-1ef30c234984 tempest-ServersNegativeTestJSON-1136974689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d60e0b9e-34fb-480a-afab-effa52566cbb {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:14:19 devstack sudo[90104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d60e0b9e-34fb-480a-afab-effa52566cbb Aug 05 10:14:19 devstack sudo[90104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:14:19 devstack sudo[90104]: pam_unix(sudo:session): session closed for user root Aug 05 10:14:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4c352aeb-eccf-4cb1-85ed-1ef30c234984 tempest-ServersNegativeTestJSON-1136974689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d60e0b9e-34fb-480a-afab-effa52566cbb" returned: 0 in 0.375s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:14:19 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-4c352aeb-eccf-4cb1-85ed-1ef30c234984 tempest-ServersNegativeTestJSON-1136974689 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:14:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-4c352aeb-eccf-4cb1-85ed-1ef30c234984 tempest-ServersNegativeTestJSON-1136974689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:14:19 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-4c352aeb-eccf-4cb1-85ed-1ef30c234984 tempest-ServersNegativeTestJSON-1136974689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbbcb61e-b472-45b0-a5b3-00fa7ff74a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d60e0b9e-34fb-480a-afab-effa52566cbb', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:14:19 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-4c352aeb-eccf-4cb1-85ed-1ef30c234984 tempest-ServersNegativeTestJSON-1136974689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48bbf484-8cd7-4e18-adef-90ef619fad63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:14:19 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-4c352aeb-eccf-4cb1-85ed-1ef30c234984 tempest-ServersNegativeTestJSON-1136974689 None] Volume volume-d60e0b9e-34fb-480a-afab-effa52566cbb (d60e0b9e-34fb-480a-afab-effa52566cbb): created successfully Aug 05 10:14:19 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-4c352aeb-eccf-4cb1-85ed-1ef30c234984 tempest-ServersNegativeTestJSON-1136974689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48bbf484-8cd7-4e18-adef-90ef619fad63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:14:19 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-4c352aeb-eccf-4cb1-85ed-1ef30c234984 tempest-ServersNegativeTestJSON-1136974689 None] Flow 'volume_create_manager' (653efca8-583e-4f78-b66a-ca0bf96d0b50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:14:19 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-4c352aeb-eccf-4cb1-85ed-1ef30c234984 tempest-ServersNegativeTestJSON-1136974689 None] Created volume successfully. Aug 05 10:14:21 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-08d7ec31-935f-4b17-b503-f2544e99c0f5 tempest-ServersNegativeTestJSON-1136974689 None] Acquiring lock "cinder-d60e0b9e-34fb-480a-afab-effa52566cbb-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:14:21 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-08d7ec31-935f-4b17-b503-f2544e99c0f5 tempest-ServersNegativeTestJSON-1136974689 None] Lock "cinder-d60e0b9e-34fb-480a-afab-effa52566cbb-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:14:21 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-08d7ec31-935f-4b17-b503-f2544e99c0f5 tempest-ServersNegativeTestJSON-1136974689 None] Acquiring lock "cinder-quobyte-d60e0b9e-34fb-480a-afab-effa52566cbb" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:14:21 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-08d7ec31-935f-4b17-b503-f2544e99c0f5 tempest-ServersNegativeTestJSON-1136974689 None] Lock "cinder-quobyte-d60e0b9e-34fb-480a-afab-effa52566cbb" acquired by "delete_volume" :: waited 0.045s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:14:21 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[21afbb38-3a10-4f7d-b149-2e1cbd8d1a2c]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:14:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-08d7ec31-935f-4b17-b503-f2544e99c0f5 tempest-ServersNegativeTestJSON-1136974689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d60e0b9e-34fb-480a-afab-effa52566cbb {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:14:21 devstack sudo[90108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d60e0b9e-34fb-480a-afab-effa52566cbb Aug 05 10:14:21 devstack sudo[90108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:14:21 devstack cinder-volume[88613]: DEBUG oslo_service.periodic_task [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88613) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:14:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:14:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:14:21 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:14:21 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:14:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:14:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:14:21 devstack sudo[90110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:14:21 devstack sudo[90110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:14:22 devstack sudo[90108]: pam_unix(sudo:session): session closed for user root Aug 05 10:14:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-08d7ec31-935f-4b17-b503-f2544e99c0f5 tempest-ServersNegativeTestJSON-1136974689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d60e0b9e-34fb-480a-afab-effa52566cbb" returned: 0 in 0.538s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:14:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-08d7ec31-935f-4b17-b503-f2544e99c0f5 tempest-ServersNegativeTestJSON-1136974689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d60e0b9e-34fb-480a-afab-effa52566cbb {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:14:22 devstack sudo[90115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d60e0b9e-34fb-480a-afab-effa52566cbb Aug 05 10:14:22 devstack sudo[90115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:14:22 devstack sudo[90110]: pam_unix(sudo:session): session closed for user root Aug 05 10:14:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.402s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:14:22 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:14:22 devstack cinder-volume[88613]: DEBUG oslo_service.periodic_task [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Running periodic task VolumeManager._thread_info {{(pid=88613) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:14:22 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] thread count: 8 {{(pid=88613) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 10:14:22 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] thread info: [<_MainThread(MainThread, started 126173666128000)>, , , , , , , ] {{(pid=88613) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 10:14:22 devstack sudo[90115]: pam_unix(sudo:session): session closed for user root Aug 05 10:14:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-08d7ec31-935f-4b17-b503-f2544e99c0f5 tempest-ServersNegativeTestJSON-1136974689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d60e0b9e-34fb-480a-afab-effa52566cbb" returned: 0 in 0.296s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:14:22 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-08d7ec31-935f-4b17-b503-f2544e99c0f5 tempest-ServersNegativeTestJSON-1136974689 None] Lock "cinder-quobyte-d60e0b9e-34fb-480a-afab-effa52566cbb" released by "delete_volume" :: held 0.925s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:14:22 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-08d7ec31-935f-4b17-b503-f2544e99c0f5 tempest-ServersNegativeTestJSON-1136974689 None] Created reservations ['808ac081-b80e-4aca-aaeb-107af0582b2a', 'e0d224f6-a597-43a2-a3bb-af34995a14eb', '1f16e0ae-f305-4b86-984c-ce0f62cc0718', 'bfcec0b4-dcda-40c4-8887-b21a77a500f4'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:14:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-08d7ec31-935f-4b17-b503-f2544e99c0f5 tempest-ServersNegativeTestJSON-1136974689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:14:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-08d7ec31-935f-4b17-b503-f2544e99c0f5 tempest-ServersNegativeTestJSON-1136974689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:14:22 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-08d7ec31-935f-4b17-b503-f2544e99c0f5 tempest-ServersNegativeTestJSON-1136974689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:14:22 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-08d7ec31-935f-4b17-b503-f2544e99c0f5 tempest-ServersNegativeTestJSON-1136974689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:14:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-08d7ec31-935f-4b17-b503-f2544e99c0f5 tempest-ServersNegativeTestJSON-1136974689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:14:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-08d7ec31-935f-4b17-b503-f2544e99c0f5 tempest-ServersNegativeTestJSON-1136974689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:14:22 devstack sudo[90119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:14:22 devstack sudo[90119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:14:22 devstack sudo[90119]: pam_unix(sudo:session): session closed for user root Aug 05 10:14:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-08d7ec31-935f-4b17-b503-f2544e99c0f5 tempest-ServersNegativeTestJSON-1136974689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.275s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:14:22 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-08d7ec31-935f-4b17-b503-f2544e99c0f5 tempest-ServersNegativeTestJSON-1136974689 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:14:22 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-08d7ec31-935f-4b17-b503-f2544e99c0f5 tempest-ServersNegativeTestJSON-1136974689 None] Deleted volume successfully. Aug 05 10:14:22 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-08d7ec31-935f-4b17-b503-f2544e99c0f5 tempest-ServersNegativeTestJSON-1136974689 None] Lock "cinder-d60e0b9e-34fb-480a-afab-effa52566cbb-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:14:23 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-0456777a-373c-4136-b5bb-26fa10f1a0f4 tempest-ServersNegativeTestJSON-1136974689 None] Acquiring lock "cinder-790f6330-fa86-40e4-a20b-7286dbaa0e6f-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:14:23 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-0456777a-373c-4136-b5bb-26fa10f1a0f4 tempest-ServersNegativeTestJSON-1136974689 None] Lock "cinder-790f6330-fa86-40e4-a20b-7286dbaa0e6f-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:14:23 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-0456777a-373c-4136-b5bb-26fa10f1a0f4 tempest-ServersNegativeTestJSON-1136974689 None] Acquiring lock "cinder-quobyte-790f6330-fa86-40e4-a20b-7286dbaa0e6f" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:14:23 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-0456777a-373c-4136-b5bb-26fa10f1a0f4 tempest-ServersNegativeTestJSON-1136974689 None] Lock "cinder-quobyte-790f6330-fa86-40e4-a20b-7286dbaa0e6f" acquired by "delete_volume" :: waited 0.021s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:14:23 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b08459d-cb55-4b5c-a90d-86b73d15e104]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:14:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-0456777a-373c-4136-b5bb-26fa10f1a0f4 tempest-ServersNegativeTestJSON-1136974689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-790f6330-fa86-40e4-a20b-7286dbaa0e6f {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:14:23 devstack sudo[90123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-790f6330-fa86-40e4-a20b-7286dbaa0e6f Aug 05 10:14:23 devstack sudo[90123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:14:24 devstack sudo[90123]: pam_unix(sudo:session): session closed for user root Aug 05 10:14:24 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-0456777a-373c-4136-b5bb-26fa10f1a0f4 tempest-ServersNegativeTestJSON-1136974689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-790f6330-fa86-40e4-a20b-7286dbaa0e6f" returned: 0 in 0.525s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:14:24 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-0456777a-373c-4136-b5bb-26fa10f1a0f4 tempest-ServersNegativeTestJSON-1136974689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-790f6330-fa86-40e4-a20b-7286dbaa0e6f {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:14:24 devstack sudo[90132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-790f6330-fa86-40e4-a20b-7286dbaa0e6f Aug 05 10:14:24 devstack sudo[90132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:14:24 devstack sudo[90132]: pam_unix(sudo:session): session closed for user root Aug 05 10:14:24 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-0456777a-373c-4136-b5bb-26fa10f1a0f4 tempest-ServersNegativeTestJSON-1136974689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-790f6330-fa86-40e4-a20b-7286dbaa0e6f" returned: 0 in 0.279s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:14:24 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-0456777a-373c-4136-b5bb-26fa10f1a0f4 tempest-ServersNegativeTestJSON-1136974689 None] Lock "cinder-quobyte-790f6330-fa86-40e4-a20b-7286dbaa0e6f" released by "delete_volume" :: held 0.860s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:14:24 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-0456777a-373c-4136-b5bb-26fa10f1a0f4 tempest-ServersNegativeTestJSON-1136974689 None] Created reservations ['5748b964-c253-4cbc-9b75-4ab618f31d18', '2bda400a-8d0e-4788-bbb5-badff21bfc19', '586eedf9-d191-4bfb-a272-25a79ff1eef1', 'e17d01ad-7b7f-4065-b02a-33a8753a504a'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:14:24 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-0456777a-373c-4136-b5bb-26fa10f1a0f4 tempest-ServersNegativeTestJSON-1136974689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:14:24 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-0456777a-373c-4136-b5bb-26fa10f1a0f4 tempest-ServersNegativeTestJSON-1136974689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:14:24 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-0456777a-373c-4136-b5bb-26fa10f1a0f4 tempest-ServersNegativeTestJSON-1136974689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:14:24 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-0456777a-373c-4136-b5bb-26fa10f1a0f4 tempest-ServersNegativeTestJSON-1136974689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:14:24 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-0456777a-373c-4136-b5bb-26fa10f1a0f4 tempest-ServersNegativeTestJSON-1136974689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:14:24 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-0456777a-373c-4136-b5bb-26fa10f1a0f4 tempest-ServersNegativeTestJSON-1136974689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:14:24 devstack sudo[90137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:14:24 devstack sudo[90137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:14:24 devstack sudo[90137]: pam_unix(sudo:session): session closed for user root Aug 05 10:14:24 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-0456777a-373c-4136-b5bb-26fa10f1a0f4 tempest-ServersNegativeTestJSON-1136974689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.260s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:14:24 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-0456777a-373c-4136-b5bb-26fa10f1a0f4 tempest-ServersNegativeTestJSON-1136974689 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:14:25 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-0456777a-373c-4136-b5bb-26fa10f1a0f4 tempest-ServersNegativeTestJSON-1136974689 None] Deleted volume successfully. Aug 05 10:14:25 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-0456777a-373c-4136-b5bb-26fa10f1a0f4 tempest-ServersNegativeTestJSON-1136974689 None] Lock "cinder-790f6330-fa86-40e4-a20b-7286dbaa0e6f-delete_volume" released by "delete_volume" :: held 1.411s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:14:38 devstack cinder-volume[88613]: DEBUG dbcounter [-] [88613] Writing DB stats cinder:SELECT=16,cinder:UPDATE=20,cinder:DELETE=2,cinder:INSERT=3 {{(pid=88613) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:14:38 devstack cinder-volume[88613]: DEBUG dbcounter [-] [88613] Writing DB stats cinder:UPDATE=25,cinder:SELECT=13,cinder:INSERT=7,cinder:DELETE=2 {{(pid=88613) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:14:43 devstack cinder-volume[88613]: WARNING py.warnings [req-2c5059ad-fe31-480e-b575-2e6a5291f096 req-3a74ebfd-be82-41da-9371-1ebdbe176637 tempest-TaggedAttachmentsTest-2059137617 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Aug 05 10:14:43 devstack cinder-volume[88613]: .first() Aug 05 10:14:43 devstack cinder-volume[88613]: Aug 05 10:14:43 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-2c5059ad-fe31-480e-b575-2e6a5291f096 req-3a74ebfd-be82-41da-9371-1ebdbe176637 tempest-TaggedAttachmentsTest-2059137617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:14:43 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-2c5059ad-fe31-480e-b575-2e6a5291f096 req-3a74ebfd-be82-41da-9371-1ebdbe176637 tempest-TaggedAttachmentsTest-2059137617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:14:43 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-2c5059ad-fe31-480e-b575-2e6a5291f096 req-3a74ebfd-be82-41da-9371-1ebdbe176637 tempest-TaggedAttachmentsTest-2059137617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:14:43 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [req-2c5059ad-fe31-480e-b575-2e6a5291f096 req-3a74ebfd-be82-41da-9371-1ebdbe176637 tempest-TaggedAttachmentsTest-2059137617 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1', 'name': 'volume-ad85ce5a-008e-4aeb-964e-93c121aefd8b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c5a60bd8-ffb8-4edf-8fd1-b49e886b5648', 'enforce_multipath': True} {{(pid=88613) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 10:14:43 devstack cinder-volume[88613]: INFO cinder.volume.manager [req-2c5059ad-fe31-480e-b575-2e6a5291f096 req-3a74ebfd-be82-41da-9371-1ebdbe176637 tempest-TaggedAttachmentsTest-2059137617 None] attachment_update completed successfully. Aug 05 10:14:49 devstack cinder-volume[88613]: INFO cinder.volume.manager [req-3f8f1346-6f8c-4322-9d59-c5a0724bafe7 req-04cde8db-0ae7-4dd6-a7de-3b089a7d30eb tempest-TaggedAttachmentsTest-2059137617 None] Terminate volume connection completed successfully. Aug 05 10:14:49 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [req-3f8f1346-6f8c-4322-9d59-c5a0724bafe7 req-04cde8db-0ae7-4dd6-a7de-3b089a7d30eb tempest-TaggedAttachmentsTest-2059137617 None] Deleting attachment c5a60bd8-ffb8-4edf-8fd1-b49e886b5648. {{(pid=88613) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 10:14:54 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-7178c679-9af4-4391-b175-e9a4770194a2 tempest-DeleteServersTestJSON-1459358758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:14:54 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-7178c679-9af4-4391-b175-e9a4770194a2 tempest-DeleteServersTestJSON-1459358758 None] Flow 'volume_create_manager' (b663d326-c9b3-4250-8d06-573a099f7ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:14:54 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-7178c679-9af4-4391-b175-e9a4770194a2 tempest-DeleteServersTestJSON-1459358758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f80149b-d64d-4175-86b5-c3d98b22ca43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:14:54 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-7178c679-9af4-4391-b175-e9a4770194a2 tempest-DeleteServersTestJSON-1459358758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f80149b-d64d-4175-86b5-c3d98b22ca43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:14:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1667840046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed51e6bc-1c12-48c4-8e66-d784f3618ca0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40a0a93567224270b392947271052349',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:14:54Z,use_quota=True,user_id='5b1c6ea987e449829ed62fd63d547f92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:14:54 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-7178c679-9af4-4391-b175-e9a4770194a2 tempest-DeleteServersTestJSON-1459358758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6296f28-e35e-4123-a9fe-68015fac3d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:14:54 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-7178c679-9af4-4391-b175-e9a4770194a2 tempest-DeleteServersTestJSON-1459358758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6296f28-e35e-4123-a9fe-68015fac3d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:14:54 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-7178c679-9af4-4391-b175-e9a4770194a2 tempest-DeleteServersTestJSON-1459358758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f47ecb20-df8d-487e-b1a8-806718b523aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:14:54 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-7178c679-9af4-4391-b175-e9a4770194a2 tempest-DeleteServersTestJSON-1459358758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f47ecb20-df8d-487e-b1a8-806718b523aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed51e6bc-1c12-48c4-8e66-d784f3618ca0', 'volume_name': 'volume-ed51e6bc-1c12-48c4-8e66-d784f3618ca0', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:14:54 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-7178c679-9af4-4391-b175-e9a4770194a2 tempest-DeleteServersTestJSON-1459358758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa1afa48-723f-4887-b455-3b697d1c4ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:14:54 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-7178c679-9af4-4391-b175-e9a4770194a2 tempest-DeleteServersTestJSON-1459358758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa1afa48-723f-4887-b455-3b697d1c4ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:14:54 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-7178c679-9af4-4391-b175-e9a4770194a2 tempest-DeleteServersTestJSON-1459358758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7412eed4-035c-43fa-a41e-bf220e9536a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:14:54 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-7178c679-9af4-4391-b175-e9a4770194a2 tempest-DeleteServersTestJSON-1459358758 None] Volume ed51e6bc-1c12-48c4-8e66-d784f3618ca0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed51e6bc-1c12-48c4-8e66-d784f3618ca0', 'volume_size': 1} Aug 05 10:14:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-7178c679-9af4-4391-b175-e9a4770194a2 tempest-DeleteServersTestJSON-1459358758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:14:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-7178c679-9af4-4391-b175-e9a4770194a2 tempest-DeleteServersTestJSON-1459358758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:14:54 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-7178c679-9af4-4391-b175-e9a4770194a2 tempest-DeleteServersTestJSON-1459358758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:14:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1667840046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed51e6bc-1c12-48c4-8e66-d784f3618ca0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40a0a93567224270b392947271052349',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:14:54Z,use_quota=True,user_id='5b1c6ea987e449829ed62fd63d547f92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:14:54 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-7178c679-9af4-4391-b175-e9a4770194a2 tempest-DeleteServersTestJSON-1459358758 None] Creating volume ed51e6bc-1c12-48c4-8e66-d784f3618ca0 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:14:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-7178c679-9af4-4391-b175-e9a4770194a2 tempest-DeleteServersTestJSON-1459358758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:14:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-7178c679-9af4-4391-b175-e9a4770194a2 tempest-DeleteServersTestJSON-1459358758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:14:54 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-7178c679-9af4-4391-b175-e9a4770194a2 tempest-DeleteServersTestJSON-1459358758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:14:54 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-7178c679-9af4-4391-b175-e9a4770194a2 tempest-DeleteServersTestJSON-1459358758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:14:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-7178c679-9af4-4391-b175-e9a4770194a2 tempest-DeleteServersTestJSON-1459358758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:14:54 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-7178c679-9af4-4391-b175-e9a4770194a2 tempest-DeleteServersTestJSON-1459358758 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:14:54 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-7178c679-9af4-4391-b175-e9a4770194a2 tempest-DeleteServersTestJSON-1459358758 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:14:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7178c679-9af4-4391-b175-e9a4770194a2 tempest-DeleteServersTestJSON-1459358758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ed51e6bc-1c12-48c4-8e66-d784f3618ca0 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:14:54 devstack sudo[90981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ed51e6bc-1c12-48c4-8e66-d784f3618ca0 1073741824 Aug 05 10:14:54 devstack sudo[90981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:14:54 devstack sudo[90981]: pam_unix(sudo:session): session closed for user root Aug 05 10:14:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7178c679-9af4-4391-b175-e9a4770194a2 tempest-DeleteServersTestJSON-1459358758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ed51e6bc-1c12-48c4-8e66-d784f3618ca0 1073741824" returned: 0 in 0.510s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:14:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7178c679-9af4-4391-b175-e9a4770194a2 tempest-DeleteServersTestJSON-1459358758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ed51e6bc-1c12-48c4-8e66-d784f3618ca0 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:14:54 devstack sudo[90987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ed51e6bc-1c12-48c4-8e66-d784f3618ca0 Aug 05 10:14:54 devstack sudo[90987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:14:55 devstack sudo[90987]: pam_unix(sudo:session): session closed for user root Aug 05 10:14:55 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7178c679-9af4-4391-b175-e9a4770194a2 tempest-DeleteServersTestJSON-1459358758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ed51e6bc-1c12-48c4-8e66-d784f3618ca0" returned: 0 in 0.385s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:14:55 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-7178c679-9af4-4391-b175-e9a4770194a2 tempest-DeleteServersTestJSON-1459358758 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:14:55 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-7178c679-9af4-4391-b175-e9a4770194a2 tempest-DeleteServersTestJSON-1459358758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:14:55 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-7178c679-9af4-4391-b175-e9a4770194a2 tempest-DeleteServersTestJSON-1459358758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7412eed4-035c-43fa-a41e-bf220e9536a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed51e6bc-1c12-48c4-8e66-d784f3618ca0', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:14:55 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-7178c679-9af4-4391-b175-e9a4770194a2 tempest-DeleteServersTestJSON-1459358758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6138c9b6-2a34-4643-b4bc-885cbc4a2867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:14:55 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-7178c679-9af4-4391-b175-e9a4770194a2 tempest-DeleteServersTestJSON-1459358758 None] Volume volume-ed51e6bc-1c12-48c4-8e66-d784f3618ca0 (ed51e6bc-1c12-48c4-8e66-d784f3618ca0): created successfully Aug 05 10:14:55 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-7178c679-9af4-4391-b175-e9a4770194a2 tempest-DeleteServersTestJSON-1459358758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6138c9b6-2a34-4643-b4bc-885cbc4a2867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:14:55 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-7178c679-9af4-4391-b175-e9a4770194a2 tempest-DeleteServersTestJSON-1459358758 None] Flow 'volume_create_manager' (b663d326-c9b3-4250-8d06-573a099f7ae6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:14:55 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-7178c679-9af4-4391-b175-e9a4770194a2 tempest-DeleteServersTestJSON-1459358758 None] Created volume successfully. Aug 05 10:14:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-031844b3-91c6-44e5-a9f6-29984626bb7b req-680a3f79-b2f2-47d6-b3e8-0c4740029c3e tempest-DeleteServersTestJSON-1459358758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:14:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-031844b3-91c6-44e5-a9f6-29984626bb7b req-680a3f79-b2f2-47d6-b3e8-0c4740029c3e tempest-DeleteServersTestJSON-1459358758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:14:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-031844b3-91c6-44e5-a9f6-29984626bb7b req-680a3f79-b2f2-47d6-b3e8-0c4740029c3e tempest-DeleteServersTestJSON-1459358758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:14:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [req-031844b3-91c6-44e5-a9f6-29984626bb7b req-680a3f79-b2f2-47d6-b3e8-0c4740029c3e tempest-DeleteServersTestJSON-1459358758 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1', 'name': 'volume-ed51e6bc-1c12-48c4-8e66-d784f3618ca0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '14a33a2e-6054-43cc-acc4-0d21afe23efc', 'enforce_multipath': True} {{(pid=88613) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 10:14:57 devstack cinder-volume[88613]: INFO cinder.volume.manager [req-031844b3-91c6-44e5-a9f6-29984626bb7b req-680a3f79-b2f2-47d6-b3e8-0c4740029c3e tempest-DeleteServersTestJSON-1459358758 None] attachment_update completed successfully. Aug 05 10:15:03 devstack cinder-volume[88613]: INFO cinder.volume.manager [req-b6367b06-5de5-473d-bcb0-5fe820dd6eee req-3006ee4d-d80f-4b72-89d8-704051686325 tempest-DeleteServersTestJSON-1459358758 None] Terminate volume connection completed successfully. Aug 05 10:15:03 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [req-b6367b06-5de5-473d-bcb0-5fe820dd6eee req-3006ee4d-d80f-4b72-89d8-704051686325 tempest-DeleteServersTestJSON-1459358758 None] Deleting attachment 14a33a2e-6054-43cc-acc4-0d21afe23efc. {{(pid=88613) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 10:15:04 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9a07e80-7cfd-4426-8f89-d7d157214bdd tempest-ServerActionsTestOtherA-221436279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:15:04 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a9a07e80-7cfd-4426-8f89-d7d157214bdd tempest-ServerActionsTestOtherA-221436279 None] Flow 'volume_create_manager' (e025ce9c-cac1-4600-86d8-a21d5af5f862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:15:04 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a9a07e80-7cfd-4426-8f89-d7d157214bdd tempest-ServerActionsTestOtherA-221436279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c111979-b515-4c9e-a6f5-1a4042418ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:15:04 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a9a07e80-7cfd-4426-8f89-d7d157214bdd tempest-ServerActionsTestOtherA-221436279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c111979-b515-4c9e-a6f5-1a4042418ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:15:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1292052773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c2702d5-1ec9-441b-b550-a2b8ae9ab27f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb2123cb3a264e81af054be93978d988',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:15:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:15:05Z,use_quota=True,user_id='7edfc3ff0f5e4ad68dfe369f13101f15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:15:04 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a9a07e80-7cfd-4426-8f89-d7d157214bdd tempest-ServerActionsTestOtherA-221436279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a91326ae-d387-4f8d-95e2-52633611b911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:15:04 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a9a07e80-7cfd-4426-8f89-d7d157214bdd tempest-ServerActionsTestOtherA-221436279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a91326ae-d387-4f8d-95e2-52633611b911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:15:04 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a9a07e80-7cfd-4426-8f89-d7d157214bdd tempest-ServerActionsTestOtherA-221436279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5dc5503-7ebb-416f-a8d8-0644ac6f3d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:15:04 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a9a07e80-7cfd-4426-8f89-d7d157214bdd tempest-ServerActionsTestOtherA-221436279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5dc5503-7ebb-416f-a8d8-0644ac6f3d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c2702d5-1ec9-441b-b550-a2b8ae9ab27f', 'volume_name': 'volume-7c2702d5-1ec9-441b-b550-a2b8ae9ab27f', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:15:04 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a9a07e80-7cfd-4426-8f89-d7d157214bdd tempest-ServerActionsTestOtherA-221436279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dc599c2-cbf1-4902-833e-ebeb3729dc3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:15:04 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a9a07e80-7cfd-4426-8f89-d7d157214bdd tempest-ServerActionsTestOtherA-221436279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dc599c2-cbf1-4902-833e-ebeb3729dc3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:15:04 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a9a07e80-7cfd-4426-8f89-d7d157214bdd tempest-ServerActionsTestOtherA-221436279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2749e6f-c2a2-4558-a6a3-40f6e401d759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:15:04 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-a9a07e80-7cfd-4426-8f89-d7d157214bdd tempest-ServerActionsTestOtherA-221436279 None] Volume 7c2702d5-1ec9-441b-b550-a2b8ae9ab27f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c2702d5-1ec9-441b-b550-a2b8ae9ab27f', 'volume_size': 1} Aug 05 10:15:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a9a07e80-7cfd-4426-8f89-d7d157214bdd tempest-ServerActionsTestOtherA-221436279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:15:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a9a07e80-7cfd-4426-8f89-d7d157214bdd tempest-ServerActionsTestOtherA-221436279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:15:04 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-a9a07e80-7cfd-4426-8f89-d7d157214bdd tempest-ServerActionsTestOtherA-221436279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:15:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1292052773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c2702d5-1ec9-441b-b550-a2b8ae9ab27f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb2123cb3a264e81af054be93978d988',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:15:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:15:05Z,use_quota=True,user_id='7edfc3ff0f5e4ad68dfe369f13101f15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:15:04 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-a9a07e80-7cfd-4426-8f89-d7d157214bdd tempest-ServerActionsTestOtherA-221436279 None] Creating volume 7c2702d5-1ec9-441b-b550-a2b8ae9ab27f {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:15:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a9a07e80-7cfd-4426-8f89-d7d157214bdd tempest-ServerActionsTestOtherA-221436279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:15:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a9a07e80-7cfd-4426-8f89-d7d157214bdd tempest-ServerActionsTestOtherA-221436279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:15:04 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-a9a07e80-7cfd-4426-8f89-d7d157214bdd tempest-ServerActionsTestOtherA-221436279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:15:05 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-a9a07e80-7cfd-4426-8f89-d7d157214bdd tempest-ServerActionsTestOtherA-221436279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:15:05 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a9a07e80-7cfd-4426-8f89-d7d157214bdd tempest-ServerActionsTestOtherA-221436279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:15:05 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-a9a07e80-7cfd-4426-8f89-d7d157214bdd tempest-ServerActionsTestOtherA-221436279 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:15:05 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-a9a07e80-7cfd-4426-8f89-d7d157214bdd tempest-ServerActionsTestOtherA-221436279 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:15:05 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a9a07e80-7cfd-4426-8f89-d7d157214bdd tempest-ServerActionsTestOtherA-221436279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7c2702d5-1ec9-441b-b550-a2b8ae9ab27f 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:15:05 devstack sudo[91481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7c2702d5-1ec9-441b-b550-a2b8ae9ab27f 1073741824 Aug 05 10:15:05 devstack sudo[91481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:15:05 devstack sudo[91481]: pam_unix(sudo:session): session closed for user root Aug 05 10:15:05 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a9a07e80-7cfd-4426-8f89-d7d157214bdd tempest-ServerActionsTestOtherA-221436279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7c2702d5-1ec9-441b-b550-a2b8ae9ab27f 1073741824" returned: 0 in 0.620s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:15:05 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a9a07e80-7cfd-4426-8f89-d7d157214bdd tempest-ServerActionsTestOtherA-221436279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7c2702d5-1ec9-441b-b550-a2b8ae9ab27f {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:15:05 devstack sudo[91491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7c2702d5-1ec9-441b-b550-a2b8ae9ab27f Aug 05 10:15:05 devstack sudo[91491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:15:05 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-8117634e-efe1-4954-82e5-4361b3d3e463 tempest-DeleteServersTestJSON-1459358758 None] Acquiring lock "cinder-ed51e6bc-1c12-48c4-8e66-d784f3618ca0-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:15:05 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-8117634e-efe1-4954-82e5-4361b3d3e463 tempest-DeleteServersTestJSON-1459358758 None] Lock "cinder-ed51e6bc-1c12-48c4-8e66-d784f3618ca0-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:15:05 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-8117634e-efe1-4954-82e5-4361b3d3e463 tempest-DeleteServersTestJSON-1459358758 None] Acquiring lock "cinder-quobyte-ed51e6bc-1c12-48c4-8e66-d784f3618ca0" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:15:05 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-8117634e-efe1-4954-82e5-4361b3d3e463 tempest-DeleteServersTestJSON-1459358758 None] Lock "cinder-quobyte-ed51e6bc-1c12-48c4-8e66-d784f3618ca0" acquired by "delete_volume" :: waited 0.024s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:15:05 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[865804b8-bcf6-41ed-b470-412efac5b0a3]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:15:05 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-8117634e-efe1-4954-82e5-4361b3d3e463 tempest-DeleteServersTestJSON-1459358758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ed51e6bc-1c12-48c4-8e66-d784f3618ca0 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:15:06 devstack sudo[91493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ed51e6bc-1c12-48c4-8e66-d784f3618ca0 Aug 05 10:15:06 devstack sudo[91493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:15:06 devstack sudo[91491]: pam_unix(sudo:session): session closed for user root Aug 05 10:15:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a9a07e80-7cfd-4426-8f89-d7d157214bdd tempest-ServerActionsTestOtherA-221436279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7c2702d5-1ec9-441b-b550-a2b8ae9ab27f" returned: 0 in 0.500s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:15:06 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-a9a07e80-7cfd-4426-8f89-d7d157214bdd tempest-ServerActionsTestOtherA-221436279 None] <== create_volume: return (1169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:15:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a9a07e80-7cfd-4426-8f89-d7d157214bdd tempest-ServerActionsTestOtherA-221436279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.171s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:15:06 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a9a07e80-7cfd-4426-8f89-d7d157214bdd tempest-ServerActionsTestOtherA-221436279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2749e6f-c2a2-4558-a6a3-40f6e401d759) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c2702d5-1ec9-441b-b550-a2b8ae9ab27f', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:15:06 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a9a07e80-7cfd-4426-8f89-d7d157214bdd tempest-ServerActionsTestOtherA-221436279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b4ba0c6-ee19-4289-b45f-3e212384dc36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:15:06 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-a9a07e80-7cfd-4426-8f89-d7d157214bdd tempest-ServerActionsTestOtherA-221436279 None] Volume volume-7c2702d5-1ec9-441b-b550-a2b8ae9ab27f (7c2702d5-1ec9-441b-b550-a2b8ae9ab27f): created successfully Aug 05 10:15:06 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a9a07e80-7cfd-4426-8f89-d7d157214bdd tempest-ServerActionsTestOtherA-221436279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b4ba0c6-ee19-4289-b45f-3e212384dc36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:15:06 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a9a07e80-7cfd-4426-8f89-d7d157214bdd tempest-ServerActionsTestOtherA-221436279 None] Flow 'volume_create_manager' (e025ce9c-cac1-4600-86d8-a21d5af5f862) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:15:06 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-a9a07e80-7cfd-4426-8f89-d7d157214bdd tempest-ServerActionsTestOtherA-221436279 None] Created volume successfully. Aug 05 10:15:06 devstack sudo[91493]: pam_unix(sudo:session): session closed for user root Aug 05 10:15:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-8117634e-efe1-4954-82e5-4361b3d3e463 tempest-DeleteServersTestJSON-1459358758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ed51e6bc-1c12-48c4-8e66-d784f3618ca0" returned: 0 in 0.659s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:15:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-8117634e-efe1-4954-82e5-4361b3d3e463 tempest-DeleteServersTestJSON-1459358758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ed51e6bc-1c12-48c4-8e66-d784f3618ca0 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:15:06 devstack sudo[91508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ed51e6bc-1c12-48c4-8e66-d784f3618ca0 Aug 05 10:15:06 devstack sudo[91508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:15:06 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-12a218fb-d9ce-4f7d-aa62-269c4631cc0c tempest-TaggedAttachmentsTest-2059137617 None] Acquiring lock "cinder-ad85ce5a-008e-4aeb-964e-93c121aefd8b-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:15:06 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-12a218fb-d9ce-4f7d-aa62-269c4631cc0c tempest-TaggedAttachmentsTest-2059137617 None] Lock "cinder-ad85ce5a-008e-4aeb-964e-93c121aefd8b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:15:06 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-12a218fb-d9ce-4f7d-aa62-269c4631cc0c tempest-TaggedAttachmentsTest-2059137617 None] Acquiring lock "cinder-quobyte-ad85ce5a-008e-4aeb-964e-93c121aefd8b" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:15:06 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-12a218fb-d9ce-4f7d-aa62-269c4631cc0c tempest-TaggedAttachmentsTest-2059137617 None] Lock "cinder-quobyte-ad85ce5a-008e-4aeb-964e-93c121aefd8b" acquired by "delete_volume" :: waited 0.034s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:15:06 devstack sudo[91508]: pam_unix(sudo:session): session closed for user root Aug 05 10:15:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-8117634e-efe1-4954-82e5-4361b3d3e463 tempest-DeleteServersTestJSON-1459358758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ed51e6bc-1c12-48c4-8e66-d784f3618ca0" returned: 0 in 0.382s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:15:06 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c2d4c7-4945-4973-9142-9d697d662d8c]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:15:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-12a218fb-d9ce-4f7d-aa62-269c4631cc0c tempest-TaggedAttachmentsTest-2059137617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ad85ce5a-008e-4aeb-964e-93c121aefd8b {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:15:06 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-8117634e-efe1-4954-82e5-4361b3d3e463 tempest-DeleteServersTestJSON-1459358758 None] Lock "cinder-quobyte-ed51e6bc-1c12-48c4-8e66-d784f3618ca0" released by "delete_volume" :: held 1.131s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:15:07 devstack sudo[91511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ad85ce5a-008e-4aeb-964e-93c121aefd8b Aug 05 10:15:07 devstack sudo[91511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:15:07 devstack sudo[91511]: pam_unix(sudo:session): session closed for user root Aug 05 10:15:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-12a218fb-d9ce-4f7d-aa62-269c4631cc0c tempest-TaggedAttachmentsTest-2059137617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ad85ce5a-008e-4aeb-964e-93c121aefd8b" returned: 0 in 0.369s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:15:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-12a218fb-d9ce-4f7d-aa62-269c4631cc0c tempest-TaggedAttachmentsTest-2059137617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ad85ce5a-008e-4aeb-964e-93c121aefd8b {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:15:07 devstack sudo[91516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ad85ce5a-008e-4aeb-964e-93c121aefd8b Aug 05 10:15:07 devstack sudo[91516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:15:07 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-8117634e-efe1-4954-82e5-4361b3d3e463 tempest-DeleteServersTestJSON-1459358758 None] Created reservations ['f969bf21-e33c-471c-b032-03e9ff948f4b', 'e6cfcfd2-f437-4065-bef5-b331ae7b5d7c', 'e6d858e9-4111-486c-a3ea-540d8fc6e3fe', '1df8f12d-7598-4f71-a55c-a6a3053a1f33'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:15:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-8117634e-efe1-4954-82e5-4361b3d3e463 tempest-DeleteServersTestJSON-1459358758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:15:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-8117634e-efe1-4954-82e5-4361b3d3e463 tempest-DeleteServersTestJSON-1459358758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:15:07 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-8117634e-efe1-4954-82e5-4361b3d3e463 tempest-DeleteServersTestJSON-1459358758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:15:07 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-8117634e-efe1-4954-82e5-4361b3d3e463 tempest-DeleteServersTestJSON-1459358758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:15:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-8117634e-efe1-4954-82e5-4361b3d3e463 tempest-DeleteServersTestJSON-1459358758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:15:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-8117634e-efe1-4954-82e5-4361b3d3e463 tempest-DeleteServersTestJSON-1459358758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:15:07 devstack sudo[91518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:15:07 devstack sudo[91518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:15:07 devstack sudo[91516]: pam_unix(sudo:session): session closed for user root Aug 05 10:15:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-12a218fb-d9ce-4f7d-aa62-269c4631cc0c tempest-TaggedAttachmentsTest-2059137617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ad85ce5a-008e-4aeb-964e-93c121aefd8b" returned: 0 in 0.252s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:15:07 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-12a218fb-d9ce-4f7d-aa62-269c4631cc0c tempest-TaggedAttachmentsTest-2059137617 None] Lock "cinder-quobyte-ad85ce5a-008e-4aeb-964e-93c121aefd8b" released by "delete_volume" :: held 0.691s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:15:07 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-12a218fb-d9ce-4f7d-aa62-269c4631cc0c tempest-TaggedAttachmentsTest-2059137617 None] Created reservations ['5ab7b399-8342-4adb-9b7c-6ee7c35898c3', '2830c3db-3d23-46ea-8be5-c09c4bbb81fb', 'be19bd98-5b16-4c38-ad61-1d774bcc6749', 'a0710d99-fa78-48e6-8bdb-11ab182eee6d'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:15:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-12a218fb-d9ce-4f7d-aa62-269c4631cc0c tempest-TaggedAttachmentsTest-2059137617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:15:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-12a218fb-d9ce-4f7d-aa62-269c4631cc0c tempest-TaggedAttachmentsTest-2059137617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:15:07 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-12a218fb-d9ce-4f7d-aa62-269c4631cc0c tempest-TaggedAttachmentsTest-2059137617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:15:07 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-12a218fb-d9ce-4f7d-aa62-269c4631cc0c tempest-TaggedAttachmentsTest-2059137617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:15:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-12a218fb-d9ce-4f7d-aa62-269c4631cc0c tempest-TaggedAttachmentsTest-2059137617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:15:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-12a218fb-d9ce-4f7d-aa62-269c4631cc0c tempest-TaggedAttachmentsTest-2059137617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:15:07 devstack sudo[91518]: pam_unix(sudo:session): session closed for user root Aug 05 10:15:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-8117634e-efe1-4954-82e5-4361b3d3e463 tempest-DeleteServersTestJSON-1459358758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.290s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:15:07 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-8117634e-efe1-4954-82e5-4361b3d3e463 tempest-DeleteServersTestJSON-1459358758 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:15:07 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-8117634e-efe1-4954-82e5-4361b3d3e463 tempest-DeleteServersTestJSON-1459358758 None] Deleted volume successfully. Aug 05 10:15:07 devstack sudo[91522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:15:07 devstack sudo[91522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:15:07 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-8117634e-efe1-4954-82e5-4361b3d3e463 tempest-DeleteServersTestJSON-1459358758 None] Lock "cinder-ed51e6bc-1c12-48c4-8e66-d784f3618ca0-delete_volume" released by "delete_volume" :: held 2.047s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:15:08 devstack sudo[91522]: pam_unix(sudo:session): session closed for user root Aug 05 10:15:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-12a218fb-d9ce-4f7d-aa62-269c4631cc0c tempest-TaggedAttachmentsTest-2059137617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.421s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:15:08 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-12a218fb-d9ce-4f7d-aa62-269c4631cc0c tempest-TaggedAttachmentsTest-2059137617 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:15:08 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-12a218fb-d9ce-4f7d-aa62-269c4631cc0c tempest-TaggedAttachmentsTest-2059137617 None] Deleted volume successfully. Aug 05 10:15:08 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-12a218fb-d9ce-4f7d-aa62-269c4631cc0c tempest-TaggedAttachmentsTest-2059137617 None] Lock "cinder-ad85ce5a-008e-4aeb-964e-93c121aefd8b-delete_volume" released by "delete_volume" :: held 1.433s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:15:17 devstack cinder-volume[88613]: DEBUG dbcounter [-] [88613] Writing DB stats cinder:SELECT=26,cinder:UPDATE=26,cinder:INSERT=5,cinder:DELETE=2 {{(pid=88613) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:15:18 devstack cinder-volume[88613]: DEBUG dbcounter [-] [88613] Writing DB stats cinder:SELECT=32,cinder:UPDATE=24,cinder:DELETE=2,cinder:INSERT=5 {{(pid=88613) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:15:18 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ac1f373-3db0-44be-8c98-d44a91178a3a tempest-VolumesTestJSON-1266886198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:15:18 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9ac1f373-3db0-44be-8c98-d44a91178a3a tempest-VolumesTestJSON-1266886198 None] Flow 'volume_create_manager' (73b91921-0553-443b-ad59-a56de149d54f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:15:19 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9ac1f373-3db0-44be-8c98-d44a91178a3a tempest-VolumesTestJSON-1266886198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d358fc0e-e7b7-4583-99ad-8a593b114e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:15:19 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9ac1f373-3db0-44be-8c98-d44a91178a3a tempest-VolumesTestJSON-1266886198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d358fc0e-e7b7-4583-99ad-8a593b114e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:15:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1201038941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6773a519-9e69-4286-8a96-9d8dcfed1672,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='087c8e801962497090301f56671c91ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:15:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:15:19Z,use_quota=True,user_id='9db6c1de2de847f5a8c2e64c23b0b721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:15:19 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9ac1f373-3db0-44be-8c98-d44a91178a3a tempest-VolumesTestJSON-1266886198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0f9dd96-0c15-44d2-a3b0-2e8b1172b217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:15:19 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9ac1f373-3db0-44be-8c98-d44a91178a3a tempest-VolumesTestJSON-1266886198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0f9dd96-0c15-44d2-a3b0-2e8b1172b217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:15:19 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9ac1f373-3db0-44be-8c98-d44a91178a3a tempest-VolumesTestJSON-1266886198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (256e60e7-fe4e-42cb-9ae8-7bec5d5058e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:15:19 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9ac1f373-3db0-44be-8c98-d44a91178a3a tempest-VolumesTestJSON-1266886198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (256e60e7-fe4e-42cb-9ae8-7bec5d5058e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6773a519-9e69-4286-8a96-9d8dcfed1672', 'volume_name': 'volume-6773a519-9e69-4286-8a96-9d8dcfed1672', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:15:19 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9ac1f373-3db0-44be-8c98-d44a91178a3a tempest-VolumesTestJSON-1266886198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e840f57-b236-4d6d-a21a-5f4200481cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:15:19 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9ac1f373-3db0-44be-8c98-d44a91178a3a tempest-VolumesTestJSON-1266886198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e840f57-b236-4d6d-a21a-5f4200481cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:15:19 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9ac1f373-3db0-44be-8c98-d44a91178a3a tempest-VolumesTestJSON-1266886198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81e3fb01-88c5-4807-94d6-ea3fefba0d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:15:19 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-9ac1f373-3db0-44be-8c98-d44a91178a3a tempest-VolumesTestJSON-1266886198 None] Volume 6773a519-9e69-4286-8a96-9d8dcfed1672: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6773a519-9e69-4286-8a96-9d8dcfed1672', 'volume_size': 1} Aug 05 10:15:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-9ac1f373-3db0-44be-8c98-d44a91178a3a tempest-VolumesTestJSON-1266886198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:15:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-9ac1f373-3db0-44be-8c98-d44a91178a3a tempest-VolumesTestJSON-1266886198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:15:19 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-9ac1f373-3db0-44be-8c98-d44a91178a3a tempest-VolumesTestJSON-1266886198 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:15:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1201038941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6773a519-9e69-4286-8a96-9d8dcfed1672,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='087c8e801962497090301f56671c91ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:15:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:15:19Z,use_quota=True,user_id='9db6c1de2de847f5a8c2e64c23b0b721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:15:19 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-9ac1f373-3db0-44be-8c98-d44a91178a3a tempest-VolumesTestJSON-1266886198 None] Creating volume 6773a519-9e69-4286-8a96-9d8dcfed1672 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:15:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-9ac1f373-3db0-44be-8c98-d44a91178a3a tempest-VolumesTestJSON-1266886198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:15:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-9ac1f373-3db0-44be-8c98-d44a91178a3a tempest-VolumesTestJSON-1266886198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:15:19 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-9ac1f373-3db0-44be-8c98-d44a91178a3a tempest-VolumesTestJSON-1266886198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:15:19 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-9ac1f373-3db0-44be-8c98-d44a91178a3a tempest-VolumesTestJSON-1266886198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:15:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-9ac1f373-3db0-44be-8c98-d44a91178a3a tempest-VolumesTestJSON-1266886198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:15:19 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-9ac1f373-3db0-44be-8c98-d44a91178a3a tempest-VolumesTestJSON-1266886198 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:15:19 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-9ac1f373-3db0-44be-8c98-d44a91178a3a tempest-VolumesTestJSON-1266886198 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:15:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9ac1f373-3db0-44be-8c98-d44a91178a3a tempest-VolumesTestJSON-1266886198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6773a519-9e69-4286-8a96-9d8dcfed1672 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:15:19 devstack sudo[91658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6773a519-9e69-4286-8a96-9d8dcfed1672 1073741824 Aug 05 10:15:19 devstack sudo[91658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:15:20 devstack sudo[91658]: pam_unix(sudo:session): session closed for user root Aug 05 10:15:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9ac1f373-3db0-44be-8c98-d44a91178a3a tempest-VolumesTestJSON-1266886198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6773a519-9e69-4286-8a96-9d8dcfed1672 1073741824" returned: 0 in 0.902s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:15:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9ac1f373-3db0-44be-8c98-d44a91178a3a tempest-VolumesTestJSON-1266886198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6773a519-9e69-4286-8a96-9d8dcfed1672 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:15:20 devstack sudo[91665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6773a519-9e69-4286-8a96-9d8dcfed1672 Aug 05 10:15:20 devstack sudo[91665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:15:20 devstack sudo[91665]: pam_unix(sudo:session): session closed for user root Aug 05 10:15:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9ac1f373-3db0-44be-8c98-d44a91178a3a tempest-VolumesTestJSON-1266886198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6773a519-9e69-4286-8a96-9d8dcfed1672" returned: 0 in 0.315s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:15:20 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-9ac1f373-3db0-44be-8c98-d44a91178a3a tempest-VolumesTestJSON-1266886198 None] <== create_volume: return (1313ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:15:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-9ac1f373-3db0-44be-8c98-d44a91178a3a tempest-VolumesTestJSON-1266886198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.317s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:15:20 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9ac1f373-3db0-44be-8c98-d44a91178a3a tempest-VolumesTestJSON-1266886198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81e3fb01-88c5-4807-94d6-ea3fefba0d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6773a519-9e69-4286-8a96-9d8dcfed1672', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:15:20 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9ac1f373-3db0-44be-8c98-d44a91178a3a tempest-VolumesTestJSON-1266886198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b64665e0-3024-4043-994f-06b4658ea6da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:15:20 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-9ac1f373-3db0-44be-8c98-d44a91178a3a tempest-VolumesTestJSON-1266886198 None] Volume volume-6773a519-9e69-4286-8a96-9d8dcfed1672 (6773a519-9e69-4286-8a96-9d8dcfed1672): created successfully Aug 05 10:15:20 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9ac1f373-3db0-44be-8c98-d44a91178a3a tempest-VolumesTestJSON-1266886198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b64665e0-3024-4043-994f-06b4658ea6da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:15:20 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9ac1f373-3db0-44be-8c98-d44a91178a3a tempest-VolumesTestJSON-1266886198 None] Flow 'volume_create_manager' (73b91921-0553-443b-ad59-a56de149d54f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:15:20 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-9ac1f373-3db0-44be-8c98-d44a91178a3a tempest-VolumesTestJSON-1266886198 None] Created volume successfully. Aug 05 10:15:21 devstack cinder-volume[88613]: DEBUG oslo_service.periodic_task [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88613) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:15:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:15:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:15:21 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:15:21 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:15:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.053s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:15:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:15:21 devstack sudo[91683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:15:21 devstack sudo[91683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:15:22 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1255f27-07bd-4fa8-bf75-4cb36050c9a4 tempest-VolumesTestJSON-1266886198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:15:22 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c1255f27-07bd-4fa8-bf75-4cb36050c9a4 tempest-VolumesTestJSON-1266886198 None] Flow 'volume_create_manager' (6e7e28e0-885c-4ea7-a64d-a5abaf43d9f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:15:22 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c1255f27-07bd-4fa8-bf75-4cb36050c9a4 tempest-VolumesTestJSON-1266886198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86452d92-d107-4c34-bcca-8dc434629558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:15:22 devstack sudo[91683]: pam_unix(sudo:session): session closed for user root Aug 05 10:15:22 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c1255f27-07bd-4fa8-bf75-4cb36050c9a4 tempest-VolumesTestJSON-1266886198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86452d92-d107-4c34-bcca-8dc434629558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:15:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1394266550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=032da57f-2e4d-4dbc-a962-4871e6f6623b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='087c8e801962497090301f56671c91ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:15:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:15:22Z,use_quota=True,user_id='9db6c1de2de847f5a8c2e64c23b0b721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:15:22 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c1255f27-07bd-4fa8-bf75-4cb36050c9a4 tempest-VolumesTestJSON-1266886198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc53eb19-9a40-4ee9-b8d4-f0649c0dca85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:15:22 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c1255f27-07bd-4fa8-bf75-4cb36050c9a4 tempest-VolumesTestJSON-1266886198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc53eb19-9a40-4ee9-b8d4-f0649c0dca85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:15:22 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c1255f27-07bd-4fa8-bf75-4cb36050c9a4 tempest-VolumesTestJSON-1266886198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c4ef98a-531f-41cb-b6d6-c83b4d0a76b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:15:22 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c1255f27-07bd-4fa8-bf75-4cb36050c9a4 tempest-VolumesTestJSON-1266886198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c4ef98a-531f-41cb-b6d6-c83b4d0a76b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '032da57f-2e4d-4dbc-a962-4871e6f6623b', 'volume_name': 'volume-032da57f-2e4d-4dbc-a962-4871e6f6623b', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:15:22 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c1255f27-07bd-4fa8-bf75-4cb36050c9a4 tempest-VolumesTestJSON-1266886198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d1fd9ce-34a5-4874-8e42-e68d28797de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:15:22 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c1255f27-07bd-4fa8-bf75-4cb36050c9a4 tempest-VolumesTestJSON-1266886198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d1fd9ce-34a5-4874-8e42-e68d28797de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:15:22 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c1255f27-07bd-4fa8-bf75-4cb36050c9a4 tempest-VolumesTestJSON-1266886198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70282696-7e84-4ca3-9cce-c0673d40eb1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:15:22 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-c1255f27-07bd-4fa8-bf75-4cb36050c9a4 tempest-VolumesTestJSON-1266886198 None] Volume 032da57f-2e4d-4dbc-a962-4871e6f6623b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-032da57f-2e4d-4dbc-a962-4871e6f6623b', 'volume_size': 1} Aug 05 10:15:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c1255f27-07bd-4fa8-bf75-4cb36050c9a4 tempest-VolumesTestJSON-1266886198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:15:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c1255f27-07bd-4fa8-bf75-4cb36050c9a4 tempest-VolumesTestJSON-1266886198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:15:22 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-c1255f27-07bd-4fa8-bf75-4cb36050c9a4 tempest-VolumesTestJSON-1266886198 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:15:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1394266550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=032da57f-2e4d-4dbc-a962-4871e6f6623b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='087c8e801962497090301f56671c91ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:15:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:15:22Z,use_quota=True,user_id='9db6c1de2de847f5a8c2e64c23b0b721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:15:22 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-c1255f27-07bd-4fa8-bf75-4cb36050c9a4 tempest-VolumesTestJSON-1266886198 None] Creating volume 032da57f-2e4d-4dbc-a962-4871e6f6623b {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:15:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c1255f27-07bd-4fa8-bf75-4cb36050c9a4 tempest-VolumesTestJSON-1266886198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:15:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c1255f27-07bd-4fa8-bf75-4cb36050c9a4 tempest-VolumesTestJSON-1266886198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:15:22 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-c1255f27-07bd-4fa8-bf75-4cb36050c9a4 tempest-VolumesTestJSON-1266886198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:15:22 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-c1255f27-07bd-4fa8-bf75-4cb36050c9a4 tempest-VolumesTestJSON-1266886198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:15:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c1255f27-07bd-4fa8-bf75-4cb36050c9a4 tempest-VolumesTestJSON-1266886198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:15:22 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-c1255f27-07bd-4fa8-bf75-4cb36050c9a4 tempest-VolumesTestJSON-1266886198 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:15:22 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-c1255f27-07bd-4fa8-bf75-4cb36050c9a4 tempest-VolumesTestJSON-1266886198 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:15:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c1255f27-07bd-4fa8-bf75-4cb36050c9a4 tempest-VolumesTestJSON-1266886198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-032da57f-2e4d-4dbc-a962-4871e6f6623b 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:15:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.956s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:15:22 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:15:22 devstack cinder-volume[88613]: DEBUG oslo_service.periodic_task [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Running periodic task VolumeManager._thread_info {{(pid=88613) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:15:22 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] thread count: 8 {{(pid=88613) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 10:15:22 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] thread info: [<_MainThread(MainThread, started 126173666128000)>, , , , , , , ] {{(pid=88613) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 10:15:22 devstack sudo[91703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-032da57f-2e4d-4dbc-a962-4871e6f6623b 1073741824 Aug 05 10:15:22 devstack sudo[91703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:15:23 devstack sudo[91703]: pam_unix(sudo:session): session closed for user root Aug 05 10:15:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c1255f27-07bd-4fa8-bf75-4cb36050c9a4 tempest-VolumesTestJSON-1266886198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-032da57f-2e4d-4dbc-a962-4871e6f6623b 1073741824" returned: 0 in 0.917s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:15:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c1255f27-07bd-4fa8-bf75-4cb36050c9a4 tempest-VolumesTestJSON-1266886198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-032da57f-2e4d-4dbc-a962-4871e6f6623b {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:15:23 devstack sudo[91737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-032da57f-2e4d-4dbc-a962-4871e6f6623b Aug 05 10:15:23 devstack sudo[91737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:15:24 devstack sudo[91737]: pam_unix(sudo:session): session closed for user root Aug 05 10:15:24 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c1255f27-07bd-4fa8-bf75-4cb36050c9a4 tempest-VolumesTestJSON-1266886198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-032da57f-2e4d-4dbc-a962-4871e6f6623b" returned: 0 in 0.357s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:15:24 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-c1255f27-07bd-4fa8-bf75-4cb36050c9a4 tempest-VolumesTestJSON-1266886198 None] <== create_volume: return (1329ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:15:24 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c1255f27-07bd-4fa8-bf75-4cb36050c9a4 tempest-VolumesTestJSON-1266886198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.333s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:15:24 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c1255f27-07bd-4fa8-bf75-4cb36050c9a4 tempest-VolumesTestJSON-1266886198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70282696-7e84-4ca3-9cce-c0673d40eb1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-032da57f-2e4d-4dbc-a962-4871e6f6623b', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:15:24 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c1255f27-07bd-4fa8-bf75-4cb36050c9a4 tempest-VolumesTestJSON-1266886198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de4b7187-6cd6-41d9-a6c0-322119fe7b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:15:24 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-c1255f27-07bd-4fa8-bf75-4cb36050c9a4 tempest-VolumesTestJSON-1266886198 None] Volume volume-032da57f-2e4d-4dbc-a962-4871e6f6623b (032da57f-2e4d-4dbc-a962-4871e6f6623b): created successfully Aug 05 10:15:24 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c1255f27-07bd-4fa8-bf75-4cb36050c9a4 tempest-VolumesTestJSON-1266886198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de4b7187-6cd6-41d9-a6c0-322119fe7b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:15:24 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c1255f27-07bd-4fa8-bf75-4cb36050c9a4 tempest-VolumesTestJSON-1266886198 None] Flow 'volume_create_manager' (6e7e28e0-885c-4ea7-a64d-a5abaf43d9f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:15:24 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-c1255f27-07bd-4fa8-bf75-4cb36050c9a4 tempest-VolumesTestJSON-1266886198 None] Created volume successfully. Aug 05 10:15:25 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a8480b8-a6b2-4923-a5de-690ea53e6ff9 tempest-VolumesTestJSON-1266886198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:15:25 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-7a8480b8-a6b2-4923-a5de-690ea53e6ff9 tempest-VolumesTestJSON-1266886198 None] Flow 'volume_create_manager' (f7762ed3-1b17-44a9-b8d2-23191dbbf565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:15:25 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-7a8480b8-a6b2-4923-a5de-690ea53e6ff9 tempest-VolumesTestJSON-1266886198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77e232dc-aedb-4b0c-b284-c113d98bf7ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:15:25 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-7a8480b8-a6b2-4923-a5de-690ea53e6ff9 tempest-VolumesTestJSON-1266886198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77e232dc-aedb-4b0c-b284-c113d98bf7ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:15:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-924633998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=720d7adf-e7e0-4e32-8046-db87facfa819,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='087c8e801962497090301f56671c91ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:15:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:15:25Z,use_quota=True,user_id='9db6c1de2de847f5a8c2e64c23b0b721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:15:25 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-7a8480b8-a6b2-4923-a5de-690ea53e6ff9 tempest-VolumesTestJSON-1266886198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00ecc065-8365-4da3-b336-9defe07d1e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:15:25 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-7a8480b8-a6b2-4923-a5de-690ea53e6ff9 tempest-VolumesTestJSON-1266886198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00ecc065-8365-4da3-b336-9defe07d1e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:15:25 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-7a8480b8-a6b2-4923-a5de-690ea53e6ff9 tempest-VolumesTestJSON-1266886198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9edfa339-6055-4911-b4ec-c2be4f5de281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:15:25 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-7a8480b8-a6b2-4923-a5de-690ea53e6ff9 tempest-VolumesTestJSON-1266886198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9edfa339-6055-4911-b4ec-c2be4f5de281) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '720d7adf-e7e0-4e32-8046-db87facfa819', 'volume_name': 'volume-720d7adf-e7e0-4e32-8046-db87facfa819', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:15:25 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-7a8480b8-a6b2-4923-a5de-690ea53e6ff9 tempest-VolumesTestJSON-1266886198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5e54b31-a7bd-4088-a10b-f58e6b8e3ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:15:25 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-7a8480b8-a6b2-4923-a5de-690ea53e6ff9 tempest-VolumesTestJSON-1266886198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5e54b31-a7bd-4088-a10b-f58e6b8e3ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:15:25 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-7a8480b8-a6b2-4923-a5de-690ea53e6ff9 tempest-VolumesTestJSON-1266886198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24328010-dcf1-4337-8cb4-11bec1b3b0b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:15:25 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-7a8480b8-a6b2-4923-a5de-690ea53e6ff9 tempest-VolumesTestJSON-1266886198 None] Volume 720d7adf-e7e0-4e32-8046-db87facfa819: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-720d7adf-e7e0-4e32-8046-db87facfa819', 'volume_size': 1} Aug 05 10:15:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-7a8480b8-a6b2-4923-a5de-690ea53e6ff9 tempest-VolumesTestJSON-1266886198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:15:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-7a8480b8-a6b2-4923-a5de-690ea53e6ff9 tempest-VolumesTestJSON-1266886198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:15:25 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-7a8480b8-a6b2-4923-a5de-690ea53e6ff9 tempest-VolumesTestJSON-1266886198 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:15:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-924633998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=720d7adf-e7e0-4e32-8046-db87facfa819,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='087c8e801962497090301f56671c91ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:15:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:15:25Z,use_quota=True,user_id='9db6c1de2de847f5a8c2e64c23b0b721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:15:25 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-7a8480b8-a6b2-4923-a5de-690ea53e6ff9 tempest-VolumesTestJSON-1266886198 None] Creating volume 720d7adf-e7e0-4e32-8046-db87facfa819 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:15:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-7a8480b8-a6b2-4923-a5de-690ea53e6ff9 tempest-VolumesTestJSON-1266886198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:15:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-7a8480b8-a6b2-4923-a5de-690ea53e6ff9 tempest-VolumesTestJSON-1266886198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:15:25 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-7a8480b8-a6b2-4923-a5de-690ea53e6ff9 tempest-VolumesTestJSON-1266886198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:15:25 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-7a8480b8-a6b2-4923-a5de-690ea53e6ff9 tempest-VolumesTestJSON-1266886198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:15:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-7a8480b8-a6b2-4923-a5de-690ea53e6ff9 tempest-VolumesTestJSON-1266886198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:15:25 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-7a8480b8-a6b2-4923-a5de-690ea53e6ff9 tempest-VolumesTestJSON-1266886198 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:15:25 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-7a8480b8-a6b2-4923-a5de-690ea53e6ff9 tempest-VolumesTestJSON-1266886198 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:15:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7a8480b8-a6b2-4923-a5de-690ea53e6ff9 tempest-VolumesTestJSON-1266886198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-720d7adf-e7e0-4e32-8046-db87facfa819 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:15:25 devstack sudo[91744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-720d7adf-e7e0-4e32-8046-db87facfa819 1073741824 Aug 05 10:15:25 devstack sudo[91744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:15:26 devstack sudo[91744]: pam_unix(sudo:session): session closed for user root Aug 05 10:15:26 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7a8480b8-a6b2-4923-a5de-690ea53e6ff9 tempest-VolumesTestJSON-1266886198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-720d7adf-e7e0-4e32-8046-db87facfa819 1073741824" returned: 0 in 0.805s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:15:26 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7a8480b8-a6b2-4923-a5de-690ea53e6ff9 tempest-VolumesTestJSON-1266886198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-720d7adf-e7e0-4e32-8046-db87facfa819 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:15:26 devstack sudo[91749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-720d7adf-e7e0-4e32-8046-db87facfa819 Aug 05 10:15:26 devstack sudo[91749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:15:26 devstack sudo[91749]: pam_unix(sudo:session): session closed for user root Aug 05 10:15:26 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7a8480b8-a6b2-4923-a5de-690ea53e6ff9 tempest-VolumesTestJSON-1266886198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-720d7adf-e7e0-4e32-8046-db87facfa819" returned: 0 in 0.547s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:15:26 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-7a8480b8-a6b2-4923-a5de-690ea53e6ff9 tempest-VolumesTestJSON-1266886198 None] <== create_volume: return (1426ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:15:26 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-7a8480b8-a6b2-4923-a5de-690ea53e6ff9 tempest-VolumesTestJSON-1266886198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.430s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:15:27 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-7a8480b8-a6b2-4923-a5de-690ea53e6ff9 tempest-VolumesTestJSON-1266886198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24328010-dcf1-4337-8cb4-11bec1b3b0b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-720d7adf-e7e0-4e32-8046-db87facfa819', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:15:27 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-7a8480b8-a6b2-4923-a5de-690ea53e6ff9 tempest-VolumesTestJSON-1266886198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdcb8954-648e-474a-a7b9-07eca3460a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:15:27 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-7a8480b8-a6b2-4923-a5de-690ea53e6ff9 tempest-VolumesTestJSON-1266886198 None] Volume volume-720d7adf-e7e0-4e32-8046-db87facfa819 (720d7adf-e7e0-4e32-8046-db87facfa819): created successfully Aug 05 10:15:27 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-7a8480b8-a6b2-4923-a5de-690ea53e6ff9 tempest-VolumesTestJSON-1266886198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdcb8954-648e-474a-a7b9-07eca3460a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:15:27 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-7a8480b8-a6b2-4923-a5de-690ea53e6ff9 tempest-VolumesTestJSON-1266886198 None] Flow 'volume_create_manager' (f7762ed3-1b17-44a9-b8d2-23191dbbf565) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:15:27 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-7a8480b8-a6b2-4923-a5de-690ea53e6ff9 tempest-VolumesTestJSON-1266886198 None] Created volume successfully. Aug 05 10:15:30 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-312b452d-b237-475f-81be-bfa4d6ac8818 tempest-VolumesTestJSON-1266886198 None] Acquiring lock "cinder-720d7adf-e7e0-4e32-8046-db87facfa819-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:15:30 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-312b452d-b237-475f-81be-bfa4d6ac8818 tempest-VolumesTestJSON-1266886198 None] Lock "cinder-720d7adf-e7e0-4e32-8046-db87facfa819-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:15:30 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-312b452d-b237-475f-81be-bfa4d6ac8818 tempest-VolumesTestJSON-1266886198 None] Acquiring lock "cinder-quobyte-720d7adf-e7e0-4e32-8046-db87facfa819" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:15:30 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-312b452d-b237-475f-81be-bfa4d6ac8818 tempest-VolumesTestJSON-1266886198 None] Lock "cinder-quobyte-720d7adf-e7e0-4e32-8046-db87facfa819" acquired by "delete_volume" :: waited 0.020s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:15:30 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eba603c-e66f-4348-b997-1f08d9046c28]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:15:30 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-312b452d-b237-475f-81be-bfa4d6ac8818 tempest-VolumesTestJSON-1266886198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-720d7adf-e7e0-4e32-8046-db87facfa819 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:15:30 devstack sudo[91791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-720d7adf-e7e0-4e32-8046-db87facfa819 Aug 05 10:15:30 devstack sudo[91791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:15:30 devstack sudo[91791]: pam_unix(sudo:session): session closed for user root Aug 05 10:15:30 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-312b452d-b237-475f-81be-bfa4d6ac8818 tempest-VolumesTestJSON-1266886198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-720d7adf-e7e0-4e32-8046-db87facfa819" returned: 0 in 0.779s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:15:31 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-312b452d-b237-475f-81be-bfa4d6ac8818 tempest-VolumesTestJSON-1266886198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-720d7adf-e7e0-4e32-8046-db87facfa819 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:15:31 devstack sudo[91798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-720d7adf-e7e0-4e32-8046-db87facfa819 Aug 05 10:15:31 devstack sudo[91798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:15:31 devstack sudo[91798]: pam_unix(sudo:session): session closed for user root Aug 05 10:15:31 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-312b452d-b237-475f-81be-bfa4d6ac8818 tempest-VolumesTestJSON-1266886198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-720d7adf-e7e0-4e32-8046-db87facfa819" returned: 0 in 0.356s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:15:31 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-312b452d-b237-475f-81be-bfa4d6ac8818 tempest-VolumesTestJSON-1266886198 None] Lock "cinder-quobyte-720d7adf-e7e0-4e32-8046-db87facfa819" released by "delete_volume" :: held 1.219s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:15:31 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-312b452d-b237-475f-81be-bfa4d6ac8818 tempest-VolumesTestJSON-1266886198 None] Created reservations ['bd118bd2-df8a-4e30-b4a3-3baa37315b26', '28aa7346-caad-4ca3-95c4-e5aeb136436e', 'b9803496-fd10-41db-8101-2fbe63309b7e', '9791312c-c424-4ade-942b-4e685d692d95'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:15:31 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-312b452d-b237-475f-81be-bfa4d6ac8818 tempest-VolumesTestJSON-1266886198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:15:31 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-312b452d-b237-475f-81be-bfa4d6ac8818 tempest-VolumesTestJSON-1266886198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:15:31 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-312b452d-b237-475f-81be-bfa4d6ac8818 tempest-VolumesTestJSON-1266886198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:15:31 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-312b452d-b237-475f-81be-bfa4d6ac8818 tempest-VolumesTestJSON-1266886198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:15:31 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-312b452d-b237-475f-81be-bfa4d6ac8818 tempest-VolumesTestJSON-1266886198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:15:31 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-312b452d-b237-475f-81be-bfa4d6ac8818 tempest-VolumesTestJSON-1266886198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:15:31 devstack sudo[91801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:15:31 devstack sudo[91801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:15:31 devstack sudo[91801]: pam_unix(sudo:session): session closed for user root Aug 05 10:15:31 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-312b452d-b237-475f-81be-bfa4d6ac8818 tempest-VolumesTestJSON-1266886198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.270s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:15:31 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-312b452d-b237-475f-81be-bfa4d6ac8818 tempest-VolumesTestJSON-1266886198 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:15:31 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-312b452d-b237-475f-81be-bfa4d6ac8818 tempest-VolumesTestJSON-1266886198 None] Deleted volume successfully. Aug 05 10:15:31 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-312b452d-b237-475f-81be-bfa4d6ac8818 tempest-VolumesTestJSON-1266886198 None] Lock "cinder-720d7adf-e7e0-4e32-8046-db87facfa819-delete_volume" released by "delete_volume" :: held 1.798s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:15:32 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-3a12c317-e50c-42a8-8539-f4fd6ffbb41c tempest-VolumesTestJSON-1266886198 None] Acquiring lock "cinder-032da57f-2e4d-4dbc-a962-4871e6f6623b-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:15:32 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-3a12c317-e50c-42a8-8539-f4fd6ffbb41c tempest-VolumesTestJSON-1266886198 None] Lock "cinder-032da57f-2e4d-4dbc-a962-4871e6f6623b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:15:32 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-3a12c317-e50c-42a8-8539-f4fd6ffbb41c tempest-VolumesTestJSON-1266886198 None] Acquiring lock "cinder-quobyte-032da57f-2e4d-4dbc-a962-4871e6f6623b" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:15:32 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-3a12c317-e50c-42a8-8539-f4fd6ffbb41c tempest-VolumesTestJSON-1266886198 None] Lock "cinder-quobyte-032da57f-2e4d-4dbc-a962-4871e6f6623b" acquired by "delete_volume" :: waited 0.020s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:15:32 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[e92fcd51-7f84-4ee2-9b59-6a1adaa882b0]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:15:32 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3a12c317-e50c-42a8-8539-f4fd6ffbb41c tempest-VolumesTestJSON-1266886198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-032da57f-2e4d-4dbc-a962-4871e6f6623b {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:15:32 devstack sudo[91804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-032da57f-2e4d-4dbc-a962-4871e6f6623b Aug 05 10:15:32 devstack sudo[91804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:15:32 devstack sudo[91804]: pam_unix(sudo:session): session closed for user root Aug 05 10:15:32 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3a12c317-e50c-42a8-8539-f4fd6ffbb41c tempest-VolumesTestJSON-1266886198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-032da57f-2e4d-4dbc-a962-4871e6f6623b" returned: 0 in 0.429s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:15:32 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3a12c317-e50c-42a8-8539-f4fd6ffbb41c tempest-VolumesTestJSON-1266886198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-032da57f-2e4d-4dbc-a962-4871e6f6623b {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:15:32 devstack sudo[91810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-032da57f-2e4d-4dbc-a962-4871e6f6623b Aug 05 10:15:32 devstack sudo[91810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:15:33 devstack sudo[91810]: pam_unix(sudo:session): session closed for user root Aug 05 10:15:33 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3a12c317-e50c-42a8-8539-f4fd6ffbb41c tempest-VolumesTestJSON-1266886198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-032da57f-2e4d-4dbc-a962-4871e6f6623b" returned: 0 in 0.351s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:15:33 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-3a12c317-e50c-42a8-8539-f4fd6ffbb41c tempest-VolumesTestJSON-1266886198 None] Lock "cinder-quobyte-032da57f-2e4d-4dbc-a962-4871e6f6623b" released by "delete_volume" :: held 0.837s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:15:33 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-3a12c317-e50c-42a8-8539-f4fd6ffbb41c tempest-VolumesTestJSON-1266886198 None] Created reservations ['238a1736-e470-4977-8ca4-26f693545537', 'cb4f2ff8-d7f3-4af6-8df5-d6f24e5075c7', 'dc9dc610-75c4-49ee-9d60-00b4fe4ab564', 'b59b0bdf-c44d-4a18-b843-9dccb6e5073a'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:15:33 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-3a12c317-e50c-42a8-8539-f4fd6ffbb41c tempest-VolumesTestJSON-1266886198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:15:33 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-3a12c317-e50c-42a8-8539-f4fd6ffbb41c tempest-VolumesTestJSON-1266886198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:15:33 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-3a12c317-e50c-42a8-8539-f4fd6ffbb41c tempest-VolumesTestJSON-1266886198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:15:33 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-3a12c317-e50c-42a8-8539-f4fd6ffbb41c tempest-VolumesTestJSON-1266886198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:15:33 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-3a12c317-e50c-42a8-8539-f4fd6ffbb41c tempest-VolumesTestJSON-1266886198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:15:33 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3a12c317-e50c-42a8-8539-f4fd6ffbb41c tempest-VolumesTestJSON-1266886198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:15:33 devstack sudo[91813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:15:33 devstack sudo[91813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:15:33 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-8e7df480-7700-47b3-a64a-92ac184841ca tempest-VolumesTestJSON-1266886198 None] Acquiring lock "cinder-6773a519-9e69-4286-8a96-9d8dcfed1672-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:15:33 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-8e7df480-7700-47b3-a64a-92ac184841ca tempest-VolumesTestJSON-1266886198 None] Lock "cinder-6773a519-9e69-4286-8a96-9d8dcfed1672-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:15:33 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-8e7df480-7700-47b3-a64a-92ac184841ca tempest-VolumesTestJSON-1266886198 None] Acquiring lock "cinder-quobyte-6773a519-9e69-4286-8a96-9d8dcfed1672" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:15:33 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-8e7df480-7700-47b3-a64a-92ac184841ca tempest-VolumesTestJSON-1266886198 None] Lock "cinder-quobyte-6773a519-9e69-4286-8a96-9d8dcfed1672" acquired by "delete_volume" :: waited 0.027s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:15:33 devstack sudo[91813]: pam_unix(sudo:session): session closed for user root Aug 05 10:15:33 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3a12c317-e50c-42a8-8539-f4fd6ffbb41c tempest-VolumesTestJSON-1266886198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.333s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:15:33 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-3a12c317-e50c-42a8-8539-f4fd6ffbb41c tempest-VolumesTestJSON-1266886198 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:15:33 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-3a12c317-e50c-42a8-8539-f4fd6ffbb41c tempest-VolumesTestJSON-1266886198 None] Deleted volume successfully. Aug 05 10:15:33 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbbafd0c-9e62-4f5a-bb81-4e9722281ac2]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:15:33 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-8e7df480-7700-47b3-a64a-92ac184841ca tempest-VolumesTestJSON-1266886198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6773a519-9e69-4286-8a96-9d8dcfed1672 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:15:33 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-3a12c317-e50c-42a8-8539-f4fd6ffbb41c tempest-VolumesTestJSON-1266886198 None] Lock "cinder-032da57f-2e4d-4dbc-a962-4871e6f6623b-delete_volume" released by "delete_volume" :: held 1.466s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:15:33 devstack sudo[91817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6773a519-9e69-4286-8a96-9d8dcfed1672 Aug 05 10:15:33 devstack sudo[91817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:15:34 devstack sudo[91817]: pam_unix(sudo:session): session closed for user root Aug 05 10:15:34 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-8e7df480-7700-47b3-a64a-92ac184841ca tempest-VolumesTestJSON-1266886198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6773a519-9e69-4286-8a96-9d8dcfed1672" returned: 0 in 0.467s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:15:34 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-8e7df480-7700-47b3-a64a-92ac184841ca tempest-VolumesTestJSON-1266886198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6773a519-9e69-4286-8a96-9d8dcfed1672 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:15:34 devstack sudo[91822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6773a519-9e69-4286-8a96-9d8dcfed1672 Aug 05 10:15:34 devstack sudo[91822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:15:34 devstack sudo[91822]: pam_unix(sudo:session): session closed for user root Aug 05 10:15:34 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-8e7df480-7700-47b3-a64a-92ac184841ca tempest-VolumesTestJSON-1266886198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6773a519-9e69-4286-8a96-9d8dcfed1672" returned: 0 in 0.251s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:15:34 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-8e7df480-7700-47b3-a64a-92ac184841ca tempest-VolumesTestJSON-1266886198 None] Lock "cinder-quobyte-6773a519-9e69-4286-8a96-9d8dcfed1672" released by "delete_volume" :: held 0.792s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:15:34 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-8e7df480-7700-47b3-a64a-92ac184841ca tempest-VolumesTestJSON-1266886198 None] Created reservations ['038f6a9a-6802-4661-9550-c80fcbccdd33', '7b756639-fa42-423c-8191-fe14ec213c11', '1bfc02c4-ca31-4b14-83f5-50079e4eafbe', '2c4840a4-a357-4154-a922-61bfc53ca88f'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:15:34 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-8e7df480-7700-47b3-a64a-92ac184841ca tempest-VolumesTestJSON-1266886198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:15:34 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-8e7df480-7700-47b3-a64a-92ac184841ca tempest-VolumesTestJSON-1266886198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:15:34 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-8e7df480-7700-47b3-a64a-92ac184841ca tempest-VolumesTestJSON-1266886198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:15:34 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-8e7df480-7700-47b3-a64a-92ac184841ca tempest-VolumesTestJSON-1266886198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:15:34 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-8e7df480-7700-47b3-a64a-92ac184841ca tempest-VolumesTestJSON-1266886198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:15:34 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-8e7df480-7700-47b3-a64a-92ac184841ca tempest-VolumesTestJSON-1266886198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:15:34 devstack sudo[91825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:15:34 devstack sudo[91825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:15:35 devstack sudo[91825]: pam_unix(sudo:session): session closed for user root Aug 05 10:15:35 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-8e7df480-7700-47b3-a64a-92ac184841ca tempest-VolumesTestJSON-1266886198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.318s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:15:35 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-8e7df480-7700-47b3-a64a-92ac184841ca tempest-VolumesTestJSON-1266886198 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:15:35 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-8e7df480-7700-47b3-a64a-92ac184841ca tempest-VolumesTestJSON-1266886198 None] Deleted volume successfully. Aug 05 10:15:35 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-8e7df480-7700-47b3-a64a-92ac184841ca tempest-VolumesTestJSON-1266886198 None] Lock "cinder-6773a519-9e69-4286-8a96-9d8dcfed1672-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:15:43 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7b135e4-bd04-46dc-abf6-5493fff57884 tempest-AttachVolumeTestJSON-1120766613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:15:43 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a7b135e4-bd04-46dc-abf6-5493fff57884 tempest-AttachVolumeTestJSON-1120766613 None] Flow 'volume_create_manager' (387bc0df-470d-4c0f-ba79-9786372cbda4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:15:43 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a7b135e4-bd04-46dc-abf6-5493fff57884 tempest-AttachVolumeTestJSON-1120766613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dafb9acf-dd03-4c65-85ac-de7cdec25164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:15:43 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a7b135e4-bd04-46dc-abf6-5493fff57884 tempest-AttachVolumeTestJSON-1120766613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dafb9acf-dd03-4c65-85ac-de7cdec25164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:15:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1043455257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bd911e2-d72e-4233-bfe3-79fe19722869,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55529e6fbfcc43c0b801e40e5d45472b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:15:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:15:44Z,use_quota=True,user_id='6a036a34de9d430b811b79242ff7f101',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:15:43 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a7b135e4-bd04-46dc-abf6-5493fff57884 tempest-AttachVolumeTestJSON-1120766613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f297728c-c64e-4421-ad5e-591b21a96ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:15:43 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a7b135e4-bd04-46dc-abf6-5493fff57884 tempest-AttachVolumeTestJSON-1120766613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f297728c-c64e-4421-ad5e-591b21a96ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:15:43 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a7b135e4-bd04-46dc-abf6-5493fff57884 tempest-AttachVolumeTestJSON-1120766613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfc7dded-01cd-4598-a34b-10cbad391e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:15:43 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a7b135e4-bd04-46dc-abf6-5493fff57884 tempest-AttachVolumeTestJSON-1120766613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfc7dded-01cd-4598-a34b-10cbad391e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bd911e2-d72e-4233-bfe3-79fe19722869', 'volume_name': 'volume-6bd911e2-d72e-4233-bfe3-79fe19722869', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:15:43 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a7b135e4-bd04-46dc-abf6-5493fff57884 tempest-AttachVolumeTestJSON-1120766613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97b98b0b-b08d-42ae-9c81-3f7f67c1c48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:15:43 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a7b135e4-bd04-46dc-abf6-5493fff57884 tempest-AttachVolumeTestJSON-1120766613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97b98b0b-b08d-42ae-9c81-3f7f67c1c48c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:15:43 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a7b135e4-bd04-46dc-abf6-5493fff57884 tempest-AttachVolumeTestJSON-1120766613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e440cad2-4dec-4cc5-a132-b5f942a43cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:15:43 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-a7b135e4-bd04-46dc-abf6-5493fff57884 tempest-AttachVolumeTestJSON-1120766613 None] Volume 6bd911e2-d72e-4233-bfe3-79fe19722869: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bd911e2-d72e-4233-bfe3-79fe19722869', 'volume_size': 1} Aug 05 10:15:43 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a7b135e4-bd04-46dc-abf6-5493fff57884 tempest-AttachVolumeTestJSON-1120766613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:15:43 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a7b135e4-bd04-46dc-abf6-5493fff57884 tempest-AttachVolumeTestJSON-1120766613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:15:43 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-a7b135e4-bd04-46dc-abf6-5493fff57884 tempest-AttachVolumeTestJSON-1120766613 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:15:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1043455257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bd911e2-d72e-4233-bfe3-79fe19722869,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55529e6fbfcc43c0b801e40e5d45472b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:15:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:15:44Z,use_quota=True,user_id='6a036a34de9d430b811b79242ff7f101',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:15:43 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-a7b135e4-bd04-46dc-abf6-5493fff57884 tempest-AttachVolumeTestJSON-1120766613 None] Creating volume 6bd911e2-d72e-4233-bfe3-79fe19722869 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:15:43 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a7b135e4-bd04-46dc-abf6-5493fff57884 tempest-AttachVolumeTestJSON-1120766613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:15:43 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a7b135e4-bd04-46dc-abf6-5493fff57884 tempest-AttachVolumeTestJSON-1120766613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:15:43 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-a7b135e4-bd04-46dc-abf6-5493fff57884 tempest-AttachVolumeTestJSON-1120766613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:15:44 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-a7b135e4-bd04-46dc-abf6-5493fff57884 tempest-AttachVolumeTestJSON-1120766613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:15:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a7b135e4-bd04-46dc-abf6-5493fff57884 tempest-AttachVolumeTestJSON-1120766613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:15:44 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-a7b135e4-bd04-46dc-abf6-5493fff57884 tempest-AttachVolumeTestJSON-1120766613 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:15:44 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-a7b135e4-bd04-46dc-abf6-5493fff57884 tempest-AttachVolumeTestJSON-1120766613 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:15:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a7b135e4-bd04-46dc-abf6-5493fff57884 tempest-AttachVolumeTestJSON-1120766613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6bd911e2-d72e-4233-bfe3-79fe19722869 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:15:44 devstack sudo[91870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6bd911e2-d72e-4233-bfe3-79fe19722869 1073741824 Aug 05 10:15:44 devstack sudo[91870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:15:44 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-b674f9a1-a7bf-46f6-a460-24cc0ce06f39 tempest-GroupSnapshotsV319Test-1138715458 None] Group tempest-GroupSnapshotsV319Test-Group-145110138: creating Aug 05 10:15:44 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-b674f9a1-a7bf-46f6-a460-24cc0ce06f39 tempest-GroupSnapshotsV319Test-1138715458 None] Group tempest-GroupSnapshotsV319Test-Group-145110138: created successfully Aug 05 10:15:44 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-b674f9a1-a7bf-46f6-a460-24cc0ce06f39 tempest-GroupSnapshotsV319Test-1138715458 None] Create group completed successfully. Aug 05 10:15:44 devstack sudo[91870]: pam_unix(sudo:session): session closed for user root Aug 05 10:15:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a7b135e4-bd04-46dc-abf6-5493fff57884 tempest-AttachVolumeTestJSON-1120766613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6bd911e2-d72e-4233-bfe3-79fe19722869 1073741824" returned: 0 in 0.490s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:15:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a7b135e4-bd04-46dc-abf6-5493fff57884 tempest-AttachVolumeTestJSON-1120766613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6bd911e2-d72e-4233-bfe3-79fe19722869 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:15:44 devstack sudo[91876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6bd911e2-d72e-4233-bfe3-79fe19722869 Aug 05 10:15:44 devstack sudo[91876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:15:44 devstack sudo[91876]: pam_unix(sudo:session): session closed for user root Aug 05 10:15:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a7b135e4-bd04-46dc-abf6-5493fff57884 tempest-AttachVolumeTestJSON-1120766613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6bd911e2-d72e-4233-bfe3-79fe19722869" returned: 0 in 0.266s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:15:44 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-a7b135e4-bd04-46dc-abf6-5493fff57884 tempest-AttachVolumeTestJSON-1120766613 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:15:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a7b135e4-bd04-46dc-abf6-5493fff57884 tempest-AttachVolumeTestJSON-1120766613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:15:44 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a7b135e4-bd04-46dc-abf6-5493fff57884 tempest-AttachVolumeTestJSON-1120766613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e440cad2-4dec-4cc5-a132-b5f942a43cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bd911e2-d72e-4233-bfe3-79fe19722869', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:15:44 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a7b135e4-bd04-46dc-abf6-5493fff57884 tempest-AttachVolumeTestJSON-1120766613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eab6fabb-6edd-404f-aefd-608ce5077f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:15:44 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-a7b135e4-bd04-46dc-abf6-5493fff57884 tempest-AttachVolumeTestJSON-1120766613 None] Volume volume-6bd911e2-d72e-4233-bfe3-79fe19722869 (6bd911e2-d72e-4233-bfe3-79fe19722869): created successfully Aug 05 10:15:44 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a7b135e4-bd04-46dc-abf6-5493fff57884 tempest-AttachVolumeTestJSON-1120766613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eab6fabb-6edd-404f-aefd-608ce5077f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:15:44 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a7b135e4-bd04-46dc-abf6-5493fff57884 tempest-AttachVolumeTestJSON-1120766613 None] Flow 'volume_create_manager' (387bc0df-470d-4c0f-ba79-9786372cbda4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:15:44 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-a7b135e4-bd04-46dc-abf6-5493fff57884 tempest-AttachVolumeTestJSON-1120766613 None] Created volume successfully. Aug 05 10:15:45 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2691f23-297c-4d39-b251-154c19eb46be tempest-GroupSnapshotsV319Test-1138715458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:15:45 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-b2691f23-297c-4d39-b251-154c19eb46be tempest-GroupSnapshotsV319Test-1138715458 None] Flow 'volume_create_manager' (92117392-04a9-4822-af1e-dc198253d1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:15:45 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-b2691f23-297c-4d39-b251-154c19eb46be tempest-GroupSnapshotsV319Test-1138715458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93233027-af0c-49f6-807e-1cc7eb0bc694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:15:45 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-b2691f23-297c-4d39-b251-154c19eb46be tempest-GroupSnapshotsV319Test-1138715458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93233027-af0c-49f6-807e-1cc7eb0bc694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:15:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-501053341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=78f9a2c5-e42f-4319-bc9b-0d8aa55da704,host='devstack@QuobyteHD#QuobyteHD',id=8e6aac10-c4af-4b84-b61d-6e89b65ddea9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b8dd7c158d841cba071ed382f769888',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:15:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:15:46Z,use_quota=True,user_id='74b990954ef142588f55c69aa6ae72b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d38c19e-26ca-45cc-be35-41a5d2e79b5d),volume_type_id=0d38c19e-26ca-45cc-be35-41a5d2e79b5d)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:15:45 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-b2691f23-297c-4d39-b251-154c19eb46be tempest-GroupSnapshotsV319Test-1138715458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b80c8546-1d6e-4673-80e5-1585c2c0a1bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:15:45 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-b2691f23-297c-4d39-b251-154c19eb46be tempest-GroupSnapshotsV319Test-1138715458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b80c8546-1d6e-4673-80e5-1585c2c0a1bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:15:45 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-b2691f23-297c-4d39-b251-154c19eb46be tempest-GroupSnapshotsV319Test-1138715458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8f44b2f-70c3-4577-9c8e-0b7541265368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:15:45 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-b2691f23-297c-4d39-b251-154c19eb46be tempest-GroupSnapshotsV319Test-1138715458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8f44b2f-70c3-4577-9c8e-0b7541265368) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e6aac10-c4af-4b84-b61d-6e89b65ddea9', 'volume_name': 'volume-8e6aac10-c4af-4b84-b61d-6e89b65ddea9', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:15:45 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-b2691f23-297c-4d39-b251-154c19eb46be tempest-GroupSnapshotsV319Test-1138715458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d3487f9-8b03-41d1-8eaa-b7bcbbf2fee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:15:46 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-b2691f23-297c-4d39-b251-154c19eb46be tempest-GroupSnapshotsV319Test-1138715458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d3487f9-8b03-41d1-8eaa-b7bcbbf2fee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:15:46 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-b2691f23-297c-4d39-b251-154c19eb46be tempest-GroupSnapshotsV319Test-1138715458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc4851fa-335e-4776-87f0-95781f1bb5b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:15:46 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-b2691f23-297c-4d39-b251-154c19eb46be tempest-GroupSnapshotsV319Test-1138715458 None] Volume 8e6aac10-c4af-4b84-b61d-6e89b65ddea9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e6aac10-c4af-4b84-b61d-6e89b65ddea9', 'volume_size': 1} Aug 05 10:15:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-b2691f23-297c-4d39-b251-154c19eb46be tempest-GroupSnapshotsV319Test-1138715458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:15:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-b2691f23-297c-4d39-b251-154c19eb46be tempest-GroupSnapshotsV319Test-1138715458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:15:46 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-b2691f23-297c-4d39-b251-154c19eb46be tempest-GroupSnapshotsV319Test-1138715458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=78f9a2c5-e42f-4319-bc9b-0d8aa55da704,created_at=2026-08-05T08:15:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-501053341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=78f9a2c5-e42f-4319-bc9b-0d8aa55da704,host='devstack@QuobyteHD#QuobyteHD',id=8e6aac10-c4af-4b84-b61d-6e89b65ddea9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b8dd7c158d841cba071ed382f769888',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:15:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:15:46Z,use_quota=True,user_id='74b990954ef142588f55c69aa6ae72b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d38c19e-26ca-45cc-be35-41a5d2e79b5d),volume_type_id=0d38c19e-26ca-45cc-be35-41a5d2e79b5d)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:15:46 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-b2691f23-297c-4d39-b251-154c19eb46be tempest-GroupSnapshotsV319Test-1138715458 None] Creating volume 8e6aac10-c4af-4b84-b61d-6e89b65ddea9 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:15:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-b2691f23-297c-4d39-b251-154c19eb46be tempest-GroupSnapshotsV319Test-1138715458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:15:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-b2691f23-297c-4d39-b251-154c19eb46be tempest-GroupSnapshotsV319Test-1138715458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:15:46 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-b2691f23-297c-4d39-b251-154c19eb46be tempest-GroupSnapshotsV319Test-1138715458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:15:46 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-b2691f23-297c-4d39-b251-154c19eb46be tempest-GroupSnapshotsV319Test-1138715458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:15:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-b2691f23-297c-4d39-b251-154c19eb46be tempest-GroupSnapshotsV319Test-1138715458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:15:46 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-b2691f23-297c-4d39-b251-154c19eb46be tempest-GroupSnapshotsV319Test-1138715458 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:15:46 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-b2691f23-297c-4d39-b251-154c19eb46be tempest-GroupSnapshotsV319Test-1138715458 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:15:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b2691f23-297c-4d39-b251-154c19eb46be tempest-GroupSnapshotsV319Test-1138715458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e6aac10-c4af-4b84-b61d-6e89b65ddea9 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:15:46 devstack sudo[91919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e6aac10-c4af-4b84-b61d-6e89b65ddea9 1073741824 Aug 05 10:15:46 devstack sudo[91919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:15:46 devstack sudo[91919]: pam_unix(sudo:session): session closed for user root Aug 05 10:15:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b2691f23-297c-4d39-b251-154c19eb46be tempest-GroupSnapshotsV319Test-1138715458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e6aac10-c4af-4b84-b61d-6e89b65ddea9 1073741824" returned: 0 in 0.681s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:15:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b2691f23-297c-4d39-b251-154c19eb46be tempest-GroupSnapshotsV319Test-1138715458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e6aac10-c4af-4b84-b61d-6e89b65ddea9 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:15:46 devstack sudo[91939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e6aac10-c4af-4b84-b61d-6e89b65ddea9 Aug 05 10:15:46 devstack sudo[91939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:15:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-88ef0e94-3beb-4095-a79c-9766fa8f1e62 req-24d2e2fb-c42d-4ff6-9bd2-a22f44130345 tempest-AttachVolumeTestJSON-1120766613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:15:47 devstack sudo[91939]: pam_unix(sudo:session): session closed for user root Aug 05 10:15:47 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b2691f23-297c-4d39-b251-154c19eb46be tempest-GroupSnapshotsV319Test-1138715458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e6aac10-c4af-4b84-b61d-6e89b65ddea9" returned: 0 in 0.337s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:15:47 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-b2691f23-297c-4d39-b251-154c19eb46be tempest-GroupSnapshotsV319Test-1138715458 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:15:47 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-b2691f23-297c-4d39-b251-154c19eb46be tempest-GroupSnapshotsV319Test-1138715458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:15:47 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-88ef0e94-3beb-4095-a79c-9766fa8f1e62 req-24d2e2fb-c42d-4ff6-9bd2-a22f44130345 tempest-AttachVolumeTestJSON-1120766613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.131s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:15:47 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-b2691f23-297c-4d39-b251-154c19eb46be tempest-GroupSnapshotsV319Test-1138715458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc4851fa-335e-4776-87f0-95781f1bb5b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e6aac10-c4af-4b84-b61d-6e89b65ddea9', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:15:47 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-b2691f23-297c-4d39-b251-154c19eb46be tempest-GroupSnapshotsV319Test-1138715458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97323ea7-f540-4e02-8e7f-a963aea8d9c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:15:47 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-b2691f23-297c-4d39-b251-154c19eb46be tempest-GroupSnapshotsV319Test-1138715458 None] Volume volume-8e6aac10-c4af-4b84-b61d-6e89b65ddea9 (8e6aac10-c4af-4b84-b61d-6e89b65ddea9): created successfully Aug 05 10:15:47 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-b2691f23-297c-4d39-b251-154c19eb46be tempest-GroupSnapshotsV319Test-1138715458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97323ea7-f540-4e02-8e7f-a963aea8d9c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:15:47 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-b2691f23-297c-4d39-b251-154c19eb46be tempest-GroupSnapshotsV319Test-1138715458 None] Flow 'volume_create_manager' (92117392-04a9-4822-af1e-dc198253d1a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:15:47 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-88ef0e94-3beb-4095-a79c-9766fa8f1e62 req-24d2e2fb-c42d-4ff6-9bd2-a22f44130345 tempest-AttachVolumeTestJSON-1120766613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.125s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:15:47 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-b2691f23-297c-4d39-b251-154c19eb46be tempest-GroupSnapshotsV319Test-1138715458 None] Created volume successfully. Aug 05 10:15:47 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [req-88ef0e94-3beb-4095-a79c-9766fa8f1e62 req-24d2e2fb-c42d-4ff6-9bd2-a22f44130345 tempest-AttachVolumeTestJSON-1120766613 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1', 'name': 'volume-6bd911e2-d72e-4233-bfe3-79fe19722869', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2a9d2687-c00d-4237-937d-ae1ee5a0536f', 'enforce_multipath': True} {{(pid=88613) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 10:15:47 devstack cinder-volume[88613]: INFO cinder.volume.manager [req-88ef0e94-3beb-4095-a79c-9766fa8f1e62 req-24d2e2fb-c42d-4ff6-9bd2-a22f44130345 tempest-AttachVolumeTestJSON-1120766613 None] attachment_update completed successfully. Aug 05 10:15:48 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-f39e4ee6-c94f-4bbb-b143-29e4729b2893 tempest-GroupSnapshotsV319Test-1138715458 None] GroupSnapshot 1396d574-e805-42f3-8ccd-7360bd3765bf: creating. Aug 05 10:15:49 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-f39e4ee6-c94f-4bbb-b143-29e4729b2893 tempest-GroupSnapshotsV319Test-1138715458 None] Group snapshot 1396d574-e805-42f3-8ccd-7360bd3765bf: creating. {{(pid=88613) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 05 10:15:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-f39e4ee6-c94f-4bbb-b143-29e4729b2893 tempest-GroupSnapshotsV319Test-1138715458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:15:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-f39e4ee6-c94f-4bbb-b143-29e4729b2893 tempest-GroupSnapshotsV319Test-1138715458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:15:49 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-f39e4ee6-c94f-4bbb-b143-29e4729b2893 tempest-GroupSnapshotsV319Test-1138715458 None] Creating offline snapshot ab51ca90-1488-466f-a5a9-6b921f298e43 of volume 8e6aac10-c4af-4b84-b61d-6e89b65ddea9 {{(pid=88613) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:15:49 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[39245720-61f4-44a5-95e9-83fad33b1962]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:15:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f39e4ee6-c94f-4bbb-b143-29e4729b2893 tempest-GroupSnapshotsV319Test-1138715458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e6aac10-c4af-4b84-b61d-6e89b65ddea9 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:15:49 devstack sudo[92333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e6aac10-c4af-4b84-b61d-6e89b65ddea9 Aug 05 10:15:49 devstack sudo[92333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:15:49 devstack sudo[92333]: pam_unix(sudo:session): session closed for user root Aug 05 10:15:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f39e4ee6-c94f-4bbb-b143-29e4729b2893 tempest-GroupSnapshotsV319Test-1138715458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e6aac10-c4af-4b84-b61d-6e89b65ddea9" returned: 0 in 0.570s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:15:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f39e4ee6-c94f-4bbb-b143-29e4729b2893 tempest-GroupSnapshotsV319Test-1138715458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e6aac10-c4af-4b84-b61d-6e89b65ddea9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e6aac10-c4af-4b84-b61d-6e89b65ddea9.ab51ca90-1488-466f-a5a9-6b921f298e43 1G {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:15:49 devstack sudo[92357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e6aac10-c4af-4b84-b61d-6e89b65ddea9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e6aac10-c4af-4b84-b61d-6e89b65ddea9.ab51ca90-1488-466f-a5a9-6b921f298e43 1G Aug 05 10:15:49 devstack sudo[92357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:15:50 devstack sudo[92357]: pam_unix(sudo:session): session closed for user root Aug 05 10:15:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f39e4ee6-c94f-4bbb-b143-29e4729b2893 tempest-GroupSnapshotsV319Test-1138715458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e6aac10-c4af-4b84-b61d-6e89b65ddea9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e6aac10-c4af-4b84-b61d-6e89b65ddea9.ab51ca90-1488-466f-a5a9-6b921f298e43 1G" returned: 0 in 0.609s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:15:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f39e4ee6-c94f-4bbb-b143-29e4729b2893 tempest-GroupSnapshotsV319Test-1138715458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e6aac10-c4af-4b84-b61d-6e89b65ddea9 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e6aac10-c4af-4b84-b61d-6e89b65ddea9.ab51ca90-1488-466f-a5a9-6b921f298e43 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:15:50 devstack sudo[92371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e6aac10-c4af-4b84-b61d-6e89b65ddea9 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e6aac10-c4af-4b84-b61d-6e89b65ddea9.ab51ca90-1488-466f-a5a9-6b921f298e43 Aug 05 10:15:50 devstack sudo[92371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:15:50 devstack sudo[92371]: pam_unix(sudo:session): session closed for user root Aug 05 10:15:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f39e4ee6-c94f-4bbb-b143-29e4729b2893 tempest-GroupSnapshotsV319Test-1138715458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e6aac10-c4af-4b84-b61d-6e89b65ddea9 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e6aac10-c4af-4b84-b61d-6e89b65ddea9.ab51ca90-1488-466f-a5a9-6b921f298e43" returned: 0 in 0.505s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:15:50 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-f39e4ee6-c94f-4bbb-b143-29e4729b2893 tempest-GroupSnapshotsV319Test-1138715458 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e6aac10-c4af-4b84-b61d-6e89b65ddea9.ab51ca90-1488-466f-a5a9-6b921f298e43 is being set with open permissions: ugo+rw: NotImplementedError Aug 05 10:15:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f39e4ee6-c94f-4bbb-b143-29e4729b2893 tempest-GroupSnapshotsV319Test-1138715458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e6aac10-c4af-4b84-b61d-6e89b65ddea9.ab51ca90-1488-466f-a5a9-6b921f298e43 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:15:50 devstack sudo[92382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e6aac10-c4af-4b84-b61d-6e89b65ddea9.ab51ca90-1488-466f-a5a9-6b921f298e43 Aug 05 10:15:50 devstack sudo[92382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:15:51 devstack sudo[92382]: pam_unix(sudo:session): session closed for user root Aug 05 10:15:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f39e4ee6-c94f-4bbb-b143-29e4729b2893 tempest-GroupSnapshotsV319Test-1138715458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e6aac10-c4af-4b84-b61d-6e89b65ddea9.ab51ca90-1488-466f-a5a9-6b921f298e43" returned: 0 in 0.416s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:15:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f39e4ee6-c94f-4bbb-b143-29e4729b2893 tempest-GroupSnapshotsV319Test-1138715458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e6aac10-c4af-4b84-b61d-6e89b65ddea9.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:15:51 devstack sudo[92387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e6aac10-c4af-4b84-b61d-6e89b65ddea9.info Aug 05 10:15:51 devstack sudo[92387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:15:51 devstack sudo[92387]: pam_unix(sudo:session): session closed for user root Aug 05 10:15:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f39e4ee6-c94f-4bbb-b143-29e4729b2893 tempest-GroupSnapshotsV319Test-1138715458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e6aac10-c4af-4b84-b61d-6e89b65ddea9.info" returned: 0 in 0.524s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:15:51 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-f39e4ee6-c94f-4bbb-b143-29e4729b2893 tempest-GroupSnapshotsV319Test-1138715458 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e6aac10-c4af-4b84-b61d-6e89b65ddea9.info is being set with open permissions: ugo+rw: NotImplementedError Aug 05 10:15:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f39e4ee6-c94f-4bbb-b143-29e4729b2893 tempest-GroupSnapshotsV319Test-1138715458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e6aac10-c4af-4b84-b61d-6e89b65ddea9.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:15:51 devstack sudo[92426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e6aac10-c4af-4b84-b61d-6e89b65ddea9.info Aug 05 10:15:51 devstack sudo[92426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:15:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-4b8acf28-14a7-4f72-b068-f348f60b8d45 req-a5b98aa8-75b5-4165-a074-bdfb431f1785 tempest-ServerActionsTestOtherA-221436279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:15:52 devstack sudo[92426]: pam_unix(sudo:session): session closed for user root Aug 05 10:15:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f39e4ee6-c94f-4bbb-b143-29e4729b2893 tempest-GroupSnapshotsV319Test-1138715458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e6aac10-c4af-4b84-b61d-6e89b65ddea9.info" returned: 0 in 0.656s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:15:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-f39e4ee6-c94f-4bbb-b143-29e4729b2893 tempest-GroupSnapshotsV319Test-1138715458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.439s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:15:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-4b8acf28-14a7-4f72-b068-f348f60b8d45 req-a5b98aa8-75b5-4165-a074-bdfb431f1785 tempest-ServerActionsTestOtherA-221436279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.579s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:15:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-4b8acf28-14a7-4f72-b068-f348f60b8d45 req-a5b98aa8-75b5-4165-a074-bdfb431f1785 tempest-ServerActionsTestOtherA-221436279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.074s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:15:52 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [req-4b8acf28-14a7-4f72-b068-f348f60b8d45 req-a5b98aa8-75b5-4165-a074-bdfb431f1785 tempest-ServerActionsTestOtherA-221436279 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1', 'name': 'volume-7c2702d5-1ec9-441b-b550-a2b8ae9ab27f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e480648b-aeb6-40c4-bcaf-78e9de90b2db', 'enforce_multipath': True} {{(pid=88613) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 10:15:52 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-f39e4ee6-c94f-4bbb-b143-29e4729b2893 tempest-GroupSnapshotsV319Test-1138715458 None] group_snapshot 1396d574-e805-42f3-8ccd-7360bd3765bf: created successfully Aug 05 10:15:52 devstack cinder-volume[88613]: INFO cinder.volume.manager [req-4b8acf28-14a7-4f72-b068-f348f60b8d45 req-a5b98aa8-75b5-4165-a074-bdfb431f1785 tempest-ServerActionsTestOtherA-221436279 None] attachment_update completed successfully. Aug 05 10:15:54 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-5573e3c5-e1b4-4b23-8130-e4e0af19fe7b tempest-GroupSnapshotsV319Test-1138715458 None] group_snapshot 1396d574-e805-42f3-8ccd-7360bd3765bf: deleting Aug 05 10:15:54 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5573e3c5-e1b4-4b23-8130-e4e0af19fe7b tempest-GroupSnapshotsV319Test-1138715458 None] group_snapshot 1396d574-e805-42f3-8ccd-7360bd3765bf: deleting {{(pid=88613) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 05 10:15:54 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-5573e3c5-e1b4-4b23-8130-e4e0af19fe7b tempest-GroupSnapshotsV319Test-1138715458 None] Acquiring lock "cinder-quobyte-8e6aac10-c4af-4b84-b61d-6e89b65ddea9" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:15:54 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-5573e3c5-e1b4-4b23-8130-e4e0af19fe7b tempest-GroupSnapshotsV319Test-1138715458 None] Lock "cinder-quobyte-8e6aac10-c4af-4b84-b61d-6e89b65ddea9" acquired by "delete_snapshot" :: waited 0.038s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:15:54 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-5573e3c5-e1b4-4b23-8130-e4e0af19fe7b tempest-GroupSnapshotsV319Test-1138715458 None] Acquiring lock "cinder-quobyte-ab51ca90-1488-466f-a5a9-6b921f298e43" by "_delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:15:54 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-5573e3c5-e1b4-4b23-8130-e4e0af19fe7b tempest-GroupSnapshotsV319Test-1138715458 None] Lock "cinder-quobyte-ab51ca90-1488-466f-a5a9-6b921f298e43" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:15:54 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-5573e3c5-e1b4-4b23-8130-e4e0af19fe7b tempest-GroupSnapshotsV319Test-1138715458 None] Deleting offline snapshot ab51ca90-1488-466f-a5a9-6b921f298e43 of volume 8e6aac10-c4af-4b84-b61d-6e89b65ddea9 {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:15:54 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-5573e3c5-e1b4-4b23-8130-e4e0af19fe7b tempest-GroupSnapshotsV319Test-1138715458 None] snapshot_file for this snap is: volume-8e6aac10-c4af-4b84-b61d-6e89b65ddea9.ab51ca90-1488-466f-a5a9-6b921f298e43 {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:15:54 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c142e19-19f0-443d-b4a3-8b50f930b015]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:15:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5573e3c5-e1b4-4b23-8130-e4e0af19fe7b tempest-GroupSnapshotsV319Test-1138715458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e6aac10-c4af-4b84-b61d-6e89b65ddea9.ab51ca90-1488-466f-a5a9-6b921f298e43 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:15:54 devstack sudo[92509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e6aac10-c4af-4b84-b61d-6e89b65ddea9.ab51ca90-1488-466f-a5a9-6b921f298e43 Aug 05 10:15:54 devstack sudo[92509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:15:55 devstack sudo[92509]: pam_unix(sudo:session): session closed for user root Aug 05 10:15:55 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5573e3c5-e1b4-4b23-8130-e4e0af19fe7b tempest-GroupSnapshotsV319Test-1138715458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e6aac10-c4af-4b84-b61d-6e89b65ddea9.ab51ca90-1488-466f-a5a9-6b921f298e43" returned: 0 in 0.854s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:15:55 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-5573e3c5-e1b4-4b23-8130-e4e0af19fe7b tempest-GroupSnapshotsV319Test-1138715458 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e6aac10-c4af-4b84-b61d-6e89b65ddea9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88613) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:15:55 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[76bc2ebe-9227-480d-8642-9fcd15f3a1a1]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:15:55 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5573e3c5-e1b4-4b23-8130-e4e0af19fe7b tempest-GroupSnapshotsV319Test-1138715458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e6aac10-c4af-4b84-b61d-6e89b65ddea9 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:15:55 devstack sudo[92544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e6aac10-c4af-4b84-b61d-6e89b65ddea9 Aug 05 10:15:55 devstack sudo[92544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:15:56 devstack sudo[92544]: pam_unix(sudo:session): session closed for user root Aug 05 10:15:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5573e3c5-e1b4-4b23-8130-e4e0af19fe7b tempest-GroupSnapshotsV319Test-1138715458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e6aac10-c4af-4b84-b61d-6e89b65ddea9" returned: 0 in 0.959s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:15:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5573e3c5-e1b4-4b23-8130-e4e0af19fe7b tempest-GroupSnapshotsV319Test-1138715458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e6aac10-c4af-4b84-b61d-6e89b65ddea9.ab51ca90-1488-466f-a5a9-6b921f298e43 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:15:56 devstack sudo[92578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e6aac10-c4af-4b84-b61d-6e89b65ddea9.ab51ca90-1488-466f-a5a9-6b921f298e43 Aug 05 10:15:56 devstack sudo[92578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:15:57 devstack sudo[92578]: pam_unix(sudo:session): session closed for user root Aug 05 10:15:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5573e3c5-e1b4-4b23-8130-e4e0af19fe7b tempest-GroupSnapshotsV319Test-1138715458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e6aac10-c4af-4b84-b61d-6e89b65ddea9.ab51ca90-1488-466f-a5a9-6b921f298e43" returned: 0 in 0.588s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:15:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5573e3c5-e1b4-4b23-8130-e4e0af19fe7b tempest-GroupSnapshotsV319Test-1138715458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e6aac10-c4af-4b84-b61d-6e89b65ddea9.ab51ca90-1488-466f-a5a9-6b921f298e43 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:15:57 devstack sudo[92600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e6aac10-c4af-4b84-b61d-6e89b65ddea9.ab51ca90-1488-466f-a5a9-6b921f298e43 Aug 05 10:15:57 devstack sudo[92600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:15:57 devstack sudo[92600]: pam_unix(sudo:session): session closed for user root Aug 05 10:15:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5573e3c5-e1b4-4b23-8130-e4e0af19fe7b tempest-GroupSnapshotsV319Test-1138715458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e6aac10-c4af-4b84-b61d-6e89b65ddea9.ab51ca90-1488-466f-a5a9-6b921f298e43" returned: 0 in 0.360s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:15:57 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-5573e3c5-e1b4-4b23-8130-e4e0af19fe7b tempest-GroupSnapshotsV319Test-1138715458 None] Lock "cinder-quobyte-ab51ca90-1488-466f-a5a9-6b921f298e43" released by "_delete_snapshot" :: held 2.977s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:15:57 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-5573e3c5-e1b4-4b23-8130-e4e0af19fe7b tempest-GroupSnapshotsV319Test-1138715458 None] Lock "cinder-quobyte-8e6aac10-c4af-4b84-b61d-6e89b65ddea9" released by "delete_snapshot" :: held 3.023s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:15:57 devstack cinder-volume[88613]: WARNING cinder.quota [None req-5573e3c5-e1b4-4b23-8130-e4e0af19fe7b tempest-GroupSnapshotsV319Test-1138715458 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1330622159 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1330622159, it is now deprecated. Please use the default quota class for default quota. Aug 05 10:15:57 devstack cinder-volume[88613]: WARNING cinder.quota [None req-5573e3c5-e1b4-4b23-8130-e4e0af19fe7b tempest-GroupSnapshotsV319Test-1138715458 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1330622159 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1330622159, it is now deprecated. Please use the default quota class for default quota. Aug 05 10:15:57 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-5573e3c5-e1b4-4b23-8130-e4e0af19fe7b tempest-GroupSnapshotsV319Test-1138715458 None] Created reservations ['3a993aa6-244f-440e-98c4-6e5aefca156f', '04b1f889-f2ef-44c1-88c1-935da64a68c5', '2f13d63c-cd07-4bcd-927e-7f6ead88180a', '51d07c79-d711-4c38-ad6a-bbd96fa3cce9'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:15:57 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-5573e3c5-e1b4-4b23-8130-e4e0af19fe7b tempest-GroupSnapshotsV319Test-1138715458 None] group_snapshot 1396d574-e805-42f3-8ccd-7360bd3765bf: deleted successfully Aug 05 10:15:58 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-290330f1-2924-4cdd-ad73-e6ba9776e7fe tempest-GroupSnapshotsV319Test-1138715458 None] Acquiring lock "cinder-quobyte-8e6aac10-c4af-4b84-b61d-6e89b65ddea9" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:15:58 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-290330f1-2924-4cdd-ad73-e6ba9776e7fe tempest-GroupSnapshotsV319Test-1138715458 None] Lock "cinder-quobyte-8e6aac10-c4af-4b84-b61d-6e89b65ddea9" acquired by "delete_volume" :: waited 0.052s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:15:58 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a126961-bb58-40c8-94f6-b4f6eb40cea0]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:15:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-290330f1-2924-4cdd-ad73-e6ba9776e7fe tempest-GroupSnapshotsV319Test-1138715458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e6aac10-c4af-4b84-b61d-6e89b65ddea9 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:15:59 devstack sudo[92621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e6aac10-c4af-4b84-b61d-6e89b65ddea9 Aug 05 10:15:59 devstack sudo[92621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:15:59 devstack sudo[92621]: pam_unix(sudo:session): session closed for user root Aug 05 10:15:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-290330f1-2924-4cdd-ad73-e6ba9776e7fe tempest-GroupSnapshotsV319Test-1138715458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e6aac10-c4af-4b84-b61d-6e89b65ddea9" returned: 0 in 0.726s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:15:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-290330f1-2924-4cdd-ad73-e6ba9776e7fe tempest-GroupSnapshotsV319Test-1138715458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e6aac10-c4af-4b84-b61d-6e89b65ddea9 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:15:59 devstack sudo[92633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e6aac10-c4af-4b84-b61d-6e89b65ddea9 Aug 05 10:15:59 devstack sudo[92633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:16:00 devstack sudo[92633]: pam_unix(sudo:session): session closed for user root Aug 05 10:16:00 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-290330f1-2924-4cdd-ad73-e6ba9776e7fe tempest-GroupSnapshotsV319Test-1138715458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e6aac10-c4af-4b84-b61d-6e89b65ddea9" returned: 0 in 0.476s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:16:00 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-290330f1-2924-4cdd-ad73-e6ba9776e7fe tempest-GroupSnapshotsV319Test-1138715458 None] Lock "cinder-quobyte-8e6aac10-c4af-4b84-b61d-6e89b65ddea9" released by "delete_volume" :: held 1.401s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:16:00 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-290330f1-2924-4cdd-ad73-e6ba9776e7fe tempest-GroupSnapshotsV319Test-1138715458 None] Created reservations ['abfa2568-9ecb-413c-8ee0-22390ac61581'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:16:00 devstack cinder-volume[88613]: WARNING cinder.quota [None req-290330f1-2924-4cdd-ad73-e6ba9776e7fe tempest-GroupSnapshotsV319Test-1138715458 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1330622159 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1330622159, it is now deprecated. Please use the default quota class for default quota. Aug 05 10:16:00 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-290330f1-2924-4cdd-ad73-e6ba9776e7fe tempest-GroupSnapshotsV319Test-1138715458 None] Created reservations ['3f201e93-ba49-4857-9e7a-462fbc0ca841', '6689d50d-54ec-4ba3-b75e-5bb31212c964', '6e4d42c5-46bf-4bcf-a5f8-22d2414bbf3b', 'c1e92b2d-f530-4a4a-94a7-201d3cfcf28f'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:16:00 devstack cinder-volume[88613]: INFO cinder.volume.manager [req-ef37993a-f637-4853-a1eb-84ffffeeb47c req-7c4189ea-e37e-4767-a9f3-ecc971cfa0df tempest-ServerActionsTestOtherA-221436279 None] Terminate volume connection completed successfully. Aug 05 10:16:00 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [req-ef37993a-f637-4853-a1eb-84ffffeeb47c req-7c4189ea-e37e-4767-a9f3-ecc971cfa0df tempest-ServerActionsTestOtherA-221436279 None] Deleting attachment e480648b-aeb6-40c4-bcaf-78e9de90b2db. {{(pid=88613) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 10:16:00 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-290330f1-2924-4cdd-ad73-e6ba9776e7fe tempest-GroupSnapshotsV319Test-1138715458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:16:00 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-290330f1-2924-4cdd-ad73-e6ba9776e7fe tempest-GroupSnapshotsV319Test-1138715458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:16:00 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-290330f1-2924-4cdd-ad73-e6ba9776e7fe tempest-GroupSnapshotsV319Test-1138715458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:16:00 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-290330f1-2924-4cdd-ad73-e6ba9776e7fe tempest-GroupSnapshotsV319Test-1138715458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:16:00 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-290330f1-2924-4cdd-ad73-e6ba9776e7fe tempest-GroupSnapshotsV319Test-1138715458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:16:00 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-290330f1-2924-4cdd-ad73-e6ba9776e7fe tempest-GroupSnapshotsV319Test-1138715458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:16:00 devstack sudo[92645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:16:00 devstack sudo[92645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:16:01 devstack sudo[92645]: pam_unix(sudo:session): session closed for user root Aug 05 10:16:01 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-290330f1-2924-4cdd-ad73-e6ba9776e7fe tempest-GroupSnapshotsV319Test-1138715458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.706s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:16:01 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-290330f1-2924-4cdd-ad73-e6ba9776e7fe tempest-GroupSnapshotsV319Test-1138715458 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:16:01 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-290330f1-2924-4cdd-ad73-e6ba9776e7fe tempest-GroupSnapshotsV319Test-1138715458 None] Delete group completed successfully. Aug 05 10:16:02 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-ef37993a-f637-4853-a1eb-84ffffeeb47c req-f4c809c7-c78f-43de-bbca-2f8d3dedfcb7 tempest-ServerActionsTestOtherA-221436279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:16:02 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-ef37993a-f637-4853-a1eb-84ffffeeb47c req-f4c809c7-c78f-43de-bbca-2f8d3dedfcb7 tempest-ServerActionsTestOtherA-221436279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:16:02 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-ef37993a-f637-4853-a1eb-84ffffeeb47c req-f4c809c7-c78f-43de-bbca-2f8d3dedfcb7 tempest-ServerActionsTestOtherA-221436279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:16:02 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [req-ef37993a-f637-4853-a1eb-84ffffeeb47c req-f4c809c7-c78f-43de-bbca-2f8d3dedfcb7 tempest-ServerActionsTestOtherA-221436279 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1', 'name': 'volume-7c2702d5-1ec9-441b-b550-a2b8ae9ab27f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '53ec015e-177b-4fe1-8bf9-4283206b3f48', 'enforce_multipath': True} {{(pid=88613) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 10:16:02 devstack cinder-volume[88613]: INFO cinder.volume.manager [req-ef37993a-f637-4853-a1eb-84ffffeeb47c req-f4c809c7-c78f-43de-bbca-2f8d3dedfcb7 tempest-ServerActionsTestOtherA-221436279 None] attachment_update completed successfully. Aug 05 10:16:10 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-2509cbf5-d976-4ac6-9ca2-305bec01072b tempest-SnapshotsActionsTest-292245125 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:16:10 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2509cbf5-d976-4ac6-9ca2-305bec01072b tempest-SnapshotsActionsTest-292245125 None] Flow 'volume_create_manager' (ba0a46ba-34ee-41c3-a3c4-9b42851d10b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:16:10 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2509cbf5-d976-4ac6-9ca2-305bec01072b tempest-SnapshotsActionsTest-292245125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2067cda4-d383-4caa-8e4b-1ad2077ed172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:16:10 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2509cbf5-d976-4ac6-9ca2-305bec01072b tempest-SnapshotsActionsTest-292245125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2067cda4-d383-4caa-8e4b-1ad2077ed172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:16:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1972125231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c3de163-dbcc-4590-b19e-5bd38196626f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4582f3be05d402bb5bc4a0ff6133cd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:16:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:16:10Z,use_quota=True,user_id='cce9926613f24626bd166f740331194e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:16:10 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2509cbf5-d976-4ac6-9ca2-305bec01072b tempest-SnapshotsActionsTest-292245125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b09b57d-99da-47c8-aff9-c970eda8df3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:16:10 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2509cbf5-d976-4ac6-9ca2-305bec01072b tempest-SnapshotsActionsTest-292245125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b09b57d-99da-47c8-aff9-c970eda8df3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:16:10 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2509cbf5-d976-4ac6-9ca2-305bec01072b tempest-SnapshotsActionsTest-292245125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b654ff8-440a-4936-8071-14e169f2940a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:16:10 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2509cbf5-d976-4ac6-9ca2-305bec01072b tempest-SnapshotsActionsTest-292245125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b654ff8-440a-4936-8071-14e169f2940a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c3de163-dbcc-4590-b19e-5bd38196626f', 'volume_name': 'volume-2c3de163-dbcc-4590-b19e-5bd38196626f', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:16:10 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2509cbf5-d976-4ac6-9ca2-305bec01072b tempest-SnapshotsActionsTest-292245125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8278f670-5cde-4810-abe1-be8f0424e7eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:16:10 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2509cbf5-d976-4ac6-9ca2-305bec01072b tempest-SnapshotsActionsTest-292245125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8278f670-5cde-4810-abe1-be8f0424e7eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:16:10 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2509cbf5-d976-4ac6-9ca2-305bec01072b tempest-SnapshotsActionsTest-292245125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c268dc10-2495-4ee2-b3d0-63690561c1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:16:10 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-2509cbf5-d976-4ac6-9ca2-305bec01072b tempest-SnapshotsActionsTest-292245125 None] Volume 2c3de163-dbcc-4590-b19e-5bd38196626f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c3de163-dbcc-4590-b19e-5bd38196626f', 'volume_size': 1} Aug 05 10:16:10 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2509cbf5-d976-4ac6-9ca2-305bec01072b tempest-SnapshotsActionsTest-292245125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:16:10 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2509cbf5-d976-4ac6-9ca2-305bec01072b tempest-SnapshotsActionsTest-292245125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:16:10 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-2509cbf5-d976-4ac6-9ca2-305bec01072b tempest-SnapshotsActionsTest-292245125 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:16:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1972125231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c3de163-dbcc-4590-b19e-5bd38196626f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4582f3be05d402bb5bc4a0ff6133cd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:16:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:16:10Z,use_quota=True,user_id='cce9926613f24626bd166f740331194e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:16:10 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-2509cbf5-d976-4ac6-9ca2-305bec01072b tempest-SnapshotsActionsTest-292245125 None] Creating volume 2c3de163-dbcc-4590-b19e-5bd38196626f {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:16:10 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2509cbf5-d976-4ac6-9ca2-305bec01072b tempest-SnapshotsActionsTest-292245125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:16:10 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2509cbf5-d976-4ac6-9ca2-305bec01072b tempest-SnapshotsActionsTest-292245125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:16:10 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-2509cbf5-d976-4ac6-9ca2-305bec01072b tempest-SnapshotsActionsTest-292245125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:16:10 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-2509cbf5-d976-4ac6-9ca2-305bec01072b tempest-SnapshotsActionsTest-292245125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:16:10 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2509cbf5-d976-4ac6-9ca2-305bec01072b tempest-SnapshotsActionsTest-292245125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:16:10 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-2509cbf5-d976-4ac6-9ca2-305bec01072b tempest-SnapshotsActionsTest-292245125 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:16:10 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-2509cbf5-d976-4ac6-9ca2-305bec01072b tempest-SnapshotsActionsTest-292245125 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:16:10 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2509cbf5-d976-4ac6-9ca2-305bec01072b tempest-SnapshotsActionsTest-292245125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:16:10 devstack sudo[92810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f 1073741824 Aug 05 10:16:10 devstack sudo[92810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:16:11 devstack sudo[92810]: pam_unix(sudo:session): session closed for user root Aug 05 10:16:11 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2509cbf5-d976-4ac6-9ca2-305bec01072b tempest-SnapshotsActionsTest-292245125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f 1073741824" returned: 0 in 0.447s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:16:11 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2509cbf5-d976-4ac6-9ca2-305bec01072b tempest-SnapshotsActionsTest-292245125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:16:11 devstack sudo[92815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f Aug 05 10:16:11 devstack sudo[92815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:16:11 devstack sudo[92815]: pam_unix(sudo:session): session closed for user root Aug 05 10:16:11 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2509cbf5-d976-4ac6-9ca2-305bec01072b tempest-SnapshotsActionsTest-292245125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f" returned: 0 in 0.250s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:16:11 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-2509cbf5-d976-4ac6-9ca2-305bec01072b tempest-SnapshotsActionsTest-292245125 None] <== create_volume: return (740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:16:11 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2509cbf5-d976-4ac6-9ca2-305bec01072b tempest-SnapshotsActionsTest-292245125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:16:11 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2509cbf5-d976-4ac6-9ca2-305bec01072b tempest-SnapshotsActionsTest-292245125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c268dc10-2495-4ee2-b3d0-63690561c1e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c3de163-dbcc-4590-b19e-5bd38196626f', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:16:11 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2509cbf5-d976-4ac6-9ca2-305bec01072b tempest-SnapshotsActionsTest-292245125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cded2ac-1e09-4cc0-9755-a2bfc7cd76ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:16:11 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-2509cbf5-d976-4ac6-9ca2-305bec01072b tempest-SnapshotsActionsTest-292245125 None] Volume volume-2c3de163-dbcc-4590-b19e-5bd38196626f (2c3de163-dbcc-4590-b19e-5bd38196626f): created successfully Aug 05 10:16:11 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2509cbf5-d976-4ac6-9ca2-305bec01072b tempest-SnapshotsActionsTest-292245125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cded2ac-1e09-4cc0-9755-a2bfc7cd76ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:16:11 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2509cbf5-d976-4ac6-9ca2-305bec01072b tempest-SnapshotsActionsTest-292245125 None] Flow 'volume_create_manager' (ba0a46ba-34ee-41c3-a3c4-9b42851d10b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:16:11 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-2509cbf5-d976-4ac6-9ca2-305bec01072b tempest-SnapshotsActionsTest-292245125 None] Created volume successfully. Aug 05 10:16:11 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-82b1749e-fb8c-4284-9105-03408f844dea tempest-SnapshotsActionsTest-292245125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:16:11 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-82b1749e-fb8c-4284-9105-03408f844dea tempest-SnapshotsActionsTest-292245125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:16:11 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-82b1749e-fb8c-4284-9105-03408f844dea tempest-SnapshotsActionsTest-292245125 None] Creating offline snapshot 4bc2ab55-1567-4cea-b262-b60705b6da22 of volume 2c3de163-dbcc-4590-b19e-5bd38196626f {{(pid=88613) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:16:11 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26a8c55-6e13-44b9-b916-56054984ad03]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:16:11 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-82b1749e-fb8c-4284-9105-03408f844dea tempest-SnapshotsActionsTest-292245125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:16:11 devstack sudo[92818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f Aug 05 10:16:11 devstack sudo[92818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:16:12 devstack sudo[92818]: pam_unix(sudo:session): session closed for user root Aug 05 10:16:12 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-82b1749e-fb8c-4284-9105-03408f844dea tempest-SnapshotsActionsTest-292245125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f" returned: 0 in 0.360s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:16:12 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-82b1749e-fb8c-4284-9105-03408f844dea tempest-SnapshotsActionsTest-292245125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.4bc2ab55-1567-4cea-b262-b60705b6da22 1G {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:16:12 devstack sudo[92823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.4bc2ab55-1567-4cea-b262-b60705b6da22 1G Aug 05 10:16:12 devstack sudo[92823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:16:12 devstack sudo[92823]: pam_unix(sudo:session): session closed for user root Aug 05 10:16:12 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-82b1749e-fb8c-4284-9105-03408f844dea tempest-SnapshotsActionsTest-292245125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.4bc2ab55-1567-4cea-b262-b60705b6da22 1G" returned: 0 in 0.389s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:16:12 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-82b1749e-fb8c-4284-9105-03408f844dea tempest-SnapshotsActionsTest-292245125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c3de163-dbcc-4590-b19e-5bd38196626f -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.4bc2ab55-1567-4cea-b262-b60705b6da22 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:16:12 devstack sudo[92829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c3de163-dbcc-4590-b19e-5bd38196626f -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.4bc2ab55-1567-4cea-b262-b60705b6da22 Aug 05 10:16:12 devstack sudo[92829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:16:12 devstack sudo[92829]: pam_unix(sudo:session): session closed for user root Aug 05 10:16:12 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-82b1749e-fb8c-4284-9105-03408f844dea tempest-SnapshotsActionsTest-292245125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c3de163-dbcc-4590-b19e-5bd38196626f -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.4bc2ab55-1567-4cea-b262-b60705b6da22" returned: 0 in 0.332s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:16:12 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-82b1749e-fb8c-4284-9105-03408f844dea tempest-SnapshotsActionsTest-292245125 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.4bc2ab55-1567-4cea-b262-b60705b6da22 is being set with open permissions: ugo+rw Aug 05 10:16:12 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-82b1749e-fb8c-4284-9105-03408f844dea tempest-SnapshotsActionsTest-292245125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.4bc2ab55-1567-4cea-b262-b60705b6da22 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:16:12 devstack sudo[92834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.4bc2ab55-1567-4cea-b262-b60705b6da22 Aug 05 10:16:12 devstack sudo[92834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:16:13 devstack sudo[92834]: pam_unix(sudo:session): session closed for user root Aug 05 10:16:13 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-82b1749e-fb8c-4284-9105-03408f844dea tempest-SnapshotsActionsTest-292245125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.4bc2ab55-1567-4cea-b262-b60705b6da22" returned: 0 in 0.254s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:16:13 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-82b1749e-fb8c-4284-9105-03408f844dea tempest-SnapshotsActionsTest-292245125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:16:13 devstack sudo[92837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.info Aug 05 10:16:13 devstack sudo[92837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:16:13 devstack sudo[92837]: pam_unix(sudo:session): session closed for user root Aug 05 10:16:13 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-82b1749e-fb8c-4284-9105-03408f844dea tempest-SnapshotsActionsTest-292245125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.info" returned: 0 in 0.263s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:16:13 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-82b1749e-fb8c-4284-9105-03408f844dea tempest-SnapshotsActionsTest-292245125 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.info is being set with open permissions: ugo+rw Aug 05 10:16:13 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-82b1749e-fb8c-4284-9105-03408f844dea tempest-SnapshotsActionsTest-292245125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:16:13 devstack sudo[92840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.info Aug 05 10:16:13 devstack sudo[92840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:16:13 devstack sudo[92840]: pam_unix(sudo:session): session closed for user root Aug 05 10:16:13 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-82b1749e-fb8c-4284-9105-03408f844dea tempest-SnapshotsActionsTest-292245125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.info" returned: 0 in 0.272s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:16:13 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-82b1749e-fb8c-4284-9105-03408f844dea tempest-SnapshotsActionsTest-292245125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.958s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:16:13 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-82b1749e-fb8c-4284-9105-03408f844dea tempest-SnapshotsActionsTest-292245125 None] Create snapshot completed successfully Aug 05 10:16:14 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-47693816-24ae-450b-a9b0-d747401ca3e0 tempest-SnapshotsActionsTest-292245125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:16:14 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-47693816-24ae-450b-a9b0-d747401ca3e0 tempest-SnapshotsActionsTest-292245125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:16:14 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-47693816-24ae-450b-a9b0-d747401ca3e0 tempest-SnapshotsActionsTest-292245125 None] Creating offline snapshot 9e383c52-76ba-4b8b-8047-ea6126be2d3d of volume 2c3de163-dbcc-4590-b19e-5bd38196626f {{(pid=88613) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:16:14 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[af04de38-de66-4287-b810-0adfd96fd59e]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:16:14 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-47693816-24ae-450b-a9b0-d747401ca3e0 tempest-SnapshotsActionsTest-292245125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.4bc2ab55-1567-4cea-b262-b60705b6da22 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:16:14 devstack sudo[92853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.4bc2ab55-1567-4cea-b262-b60705b6da22 Aug 05 10:16:14 devstack sudo[92853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:16:14 devstack sudo[92853]: pam_unix(sudo:session): session closed for user root Aug 05 10:16:14 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-47693816-24ae-450b-a9b0-d747401ca3e0 tempest-SnapshotsActionsTest-292245125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.4bc2ab55-1567-4cea-b262-b60705b6da22" returned: 0 in 0.380s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:16:14 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-47693816-24ae-450b-a9b0-d747401ca3e0 tempest-SnapshotsActionsTest-292245125 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c3de163-dbcc-4590-b19e-5bd38196626f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88613) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:16:14 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-47693816-24ae-450b-a9b0-d747401ca3e0 tempest-SnapshotsActionsTest-292245125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.4bc2ab55-1567-4cea-b262-b60705b6da22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.9e383c52-76ba-4b8b-8047-ea6126be2d3d 1G {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:16:14 devstack sudo[92858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.4bc2ab55-1567-4cea-b262-b60705b6da22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.9e383c52-76ba-4b8b-8047-ea6126be2d3d 1G Aug 05 10:16:14 devstack sudo[92858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:16:15 devstack sudo[92858]: pam_unix(sudo:session): session closed for user root Aug 05 10:16:15 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-47693816-24ae-450b-a9b0-d747401ca3e0 tempest-SnapshotsActionsTest-292245125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.4bc2ab55-1567-4cea-b262-b60705b6da22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.9e383c52-76ba-4b8b-8047-ea6126be2d3d 1G" returned: 0 in 0.461s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:16:15 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-47693816-24ae-450b-a9b0-d747401ca3e0 tempest-SnapshotsActionsTest-292245125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c3de163-dbcc-4590-b19e-5bd38196626f.4bc2ab55-1567-4cea-b262-b60705b6da22 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.9e383c52-76ba-4b8b-8047-ea6126be2d3d {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:16:15 devstack sudo[92864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c3de163-dbcc-4590-b19e-5bd38196626f.4bc2ab55-1567-4cea-b262-b60705b6da22 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.9e383c52-76ba-4b8b-8047-ea6126be2d3d Aug 05 10:16:15 devstack sudo[92864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:16:15 devstack sudo[92864]: pam_unix(sudo:session): session closed for user root Aug 05 10:16:15 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-47693816-24ae-450b-a9b0-d747401ca3e0 tempest-SnapshotsActionsTest-292245125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c3de163-dbcc-4590-b19e-5bd38196626f.4bc2ab55-1567-4cea-b262-b60705b6da22 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.9e383c52-76ba-4b8b-8047-ea6126be2d3d" returned: 0 in 0.361s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:16:15 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-47693816-24ae-450b-a9b0-d747401ca3e0 tempest-SnapshotsActionsTest-292245125 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.9e383c52-76ba-4b8b-8047-ea6126be2d3d is being set with open permissions: ugo+rw Aug 05 10:16:15 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-47693816-24ae-450b-a9b0-d747401ca3e0 tempest-SnapshotsActionsTest-292245125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.9e383c52-76ba-4b8b-8047-ea6126be2d3d {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:16:15 devstack sudo[92871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.9e383c52-76ba-4b8b-8047-ea6126be2d3d Aug 05 10:16:15 devstack sudo[92871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:16:15 devstack sudo[92871]: pam_unix(sudo:session): session closed for user root Aug 05 10:16:15 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-47693816-24ae-450b-a9b0-d747401ca3e0 tempest-SnapshotsActionsTest-292245125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.9e383c52-76ba-4b8b-8047-ea6126be2d3d" returned: 0 in 0.266s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:16:15 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-47693816-24ae-450b-a9b0-d747401ca3e0 tempest-SnapshotsActionsTest-292245125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.580s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:16:15 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-47693816-24ae-450b-a9b0-d747401ca3e0 tempest-SnapshotsActionsTest-292245125 None] Create snapshot completed successfully Aug 05 10:16:16 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e5645960-5d38-4f9d-a71b-7f4323bbce17 tempest-SnapshotsActionsTest-1413353285 None] Acquiring lock "cinder-9e383c52-76ba-4b8b-8047-ea6126be2d3d-delete_snapshot" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:16:16 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e5645960-5d38-4f9d-a71b-7f4323bbce17 tempest-SnapshotsActionsTest-1413353285 None] Lock "cinder-9e383c52-76ba-4b8b-8047-ea6126be2d3d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:16:16 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e5645960-5d38-4f9d-a71b-7f4323bbce17 tempest-SnapshotsActionsTest-1413353285 None] Acquiring lock "cinder-quobyte-2c3de163-dbcc-4590-b19e-5bd38196626f" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:16:16 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e5645960-5d38-4f9d-a71b-7f4323bbce17 tempest-SnapshotsActionsTest-1413353285 None] Lock "cinder-quobyte-2c3de163-dbcc-4590-b19e-5bd38196626f" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:16:16 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e5645960-5d38-4f9d-a71b-7f4323bbce17 tempest-SnapshotsActionsTest-1413353285 None] Acquiring lock "cinder-quobyte-9e383c52-76ba-4b8b-8047-ea6126be2d3d" by "_delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:16:16 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e5645960-5d38-4f9d-a71b-7f4323bbce17 tempest-SnapshotsActionsTest-1413353285 None] Lock "cinder-quobyte-9e383c52-76ba-4b8b-8047-ea6126be2d3d" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:16:16 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-e5645960-5d38-4f9d-a71b-7f4323bbce17 tempest-SnapshotsActionsTest-1413353285 None] Deleting offline snapshot 9e383c52-76ba-4b8b-8047-ea6126be2d3d of volume 2c3de163-dbcc-4590-b19e-5bd38196626f {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:16:16 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-e5645960-5d38-4f9d-a71b-7f4323bbce17 tempest-SnapshotsActionsTest-1413353285 None] snapshot_file for this snap is: volume-2c3de163-dbcc-4590-b19e-5bd38196626f.9e383c52-76ba-4b8b-8047-ea6126be2d3d {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:16:16 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[59698408-f29c-4cd5-9f81-3b3e7245aa89]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:16:16 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e5645960-5d38-4f9d-a71b-7f4323bbce17 tempest-SnapshotsActionsTest-1413353285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.9e383c52-76ba-4b8b-8047-ea6126be2d3d {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:16:16 devstack sudo[92876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.9e383c52-76ba-4b8b-8047-ea6126be2d3d Aug 05 10:16:16 devstack sudo[92876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:16:17 devstack sudo[92876]: pam_unix(sudo:session): session closed for user root Aug 05 10:16:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e5645960-5d38-4f9d-a71b-7f4323bbce17 tempest-SnapshotsActionsTest-1413353285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.9e383c52-76ba-4b8b-8047-ea6126be2d3d" returned: 0 in 0.396s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:16:17 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-e5645960-5d38-4f9d-a71b-7f4323bbce17 tempest-SnapshotsActionsTest-1413353285 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c3de163-dbcc-4590-b19e-5bd38196626f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88613) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:16:17 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[400911a8-efbd-46f0-a815-200e23990d46]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:16:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e5645960-5d38-4f9d-a71b-7f4323bbce17 tempest-SnapshotsActionsTest-1413353285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.4bc2ab55-1567-4cea-b262-b60705b6da22 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:16:17 devstack sudo[92881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.4bc2ab55-1567-4cea-b262-b60705b6da22 Aug 05 10:16:17 devstack sudo[92881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:16:17 devstack sudo[92881]: pam_unix(sudo:session): session closed for user root Aug 05 10:16:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e5645960-5d38-4f9d-a71b-7f4323bbce17 tempest-SnapshotsActionsTest-1413353285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.4bc2ab55-1567-4cea-b262-b60705b6da22" returned: 0 in 0.356s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:16:17 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-e5645960-5d38-4f9d-a71b-7f4323bbce17 tempest-SnapshotsActionsTest-1413353285 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c3de163-dbcc-4590-b19e-5bd38196626f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88613) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:16:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e5645960-5d38-4f9d-a71b-7f4323bbce17 tempest-SnapshotsActionsTest-1413353285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.9e383c52-76ba-4b8b-8047-ea6126be2d3d {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:16:17 devstack sudo[92886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.9e383c52-76ba-4b8b-8047-ea6126be2d3d Aug 05 10:16:17 devstack sudo[92886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:16:17 devstack sudo[92886]: pam_unix(sudo:session): session closed for user root Aug 05 10:16:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e5645960-5d38-4f9d-a71b-7f4323bbce17 tempest-SnapshotsActionsTest-1413353285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.9e383c52-76ba-4b8b-8047-ea6126be2d3d" returned: 0 in 0.367s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:16:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e5645960-5d38-4f9d-a71b-7f4323bbce17 tempest-SnapshotsActionsTest-1413353285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.9e383c52-76ba-4b8b-8047-ea6126be2d3d {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:16:17 devstack sudo[92891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.9e383c52-76ba-4b8b-8047-ea6126be2d3d Aug 05 10:16:17 devstack sudo[92891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:16:18 devstack sudo[92891]: pam_unix(sudo:session): session closed for user root Aug 05 10:16:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e5645960-5d38-4f9d-a71b-7f4323bbce17 tempest-SnapshotsActionsTest-1413353285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.9e383c52-76ba-4b8b-8047-ea6126be2d3d" returned: 0 in 0.259s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:16:18 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e5645960-5d38-4f9d-a71b-7f4323bbce17 tempest-SnapshotsActionsTest-1413353285 None] Lock "cinder-quobyte-9e383c52-76ba-4b8b-8047-ea6126be2d3d" released by "_delete_snapshot" :: held 1.459s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:16:18 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e5645960-5d38-4f9d-a71b-7f4323bbce17 tempest-SnapshotsActionsTest-1413353285 None] Lock "cinder-quobyte-2c3de163-dbcc-4590-b19e-5bd38196626f" released by "delete_snapshot" :: held 1.482s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:16:18 devstack cinder-volume[88613]: DEBUG dbcounter [-] [88613] Writing DB stats cinder:SELECT=74,cinder:INSERT=14,cinder:UPDATE=66,cinder:DELETE=6 {{(pid=88613) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:16:18 devstack cinder-volume[88613]: WARNING cinder.quota [None req-e5645960-5d38-4f9d-a71b-7f4323bbce17 tempest-SnapshotsActionsTest-1413353285 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 05 10:16:18 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-e5645960-5d38-4f9d-a71b-7f4323bbce17 tempest-SnapshotsActionsTest-1413353285 None] Created reservations ['895ab4c0-62c4-4232-8696-3de8c75480e0', '705272f1-e21d-4f47-9bd1-06ba838dc5d2', 'df1b57e6-9718-478e-b655-3e0f693e7f06', '3d895193-0438-41e4-bb88-6cd4d5ec19fc'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:16:18 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-e5645960-5d38-4f9d-a71b-7f4323bbce17 tempest-SnapshotsActionsTest-1413353285 None] Delete snapshot completed successfully. Aug 05 10:16:18 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e5645960-5d38-4f9d-a71b-7f4323bbce17 tempest-SnapshotsActionsTest-1413353285 None] Lock "cinder-9e383c52-76ba-4b8b-8047-ea6126be2d3d-delete_snapshot" released by "delete_snapshot" :: held 1.623s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:16:19 devstack cinder-volume[88613]: DEBUG dbcounter [-] [88613] Writing DB stats cinder:SELECT=87,cinder:UPDATE=79,cinder:DELETE=5,cinder:INSERT=18 {{(pid=88613) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:16:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-9989c0d1-5c2f-4ae5-8ae7-a5dfe2e1dd33 tempest-SnapshotsActionsTest-292245125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:16:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-9989c0d1-5c2f-4ae5-8ae7-a5dfe2e1dd33 tempest-SnapshotsActionsTest-292245125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:16:19 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-9989c0d1-5c2f-4ae5-8ae7-a5dfe2e1dd33 tempest-SnapshotsActionsTest-292245125 None] Creating offline snapshot 3452b550-ca4d-411e-85b9-6b5b7fe1b40d of volume 2c3de163-dbcc-4590-b19e-5bd38196626f {{(pid=88613) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:16:19 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[c60f1f69-c580-4c96-a704-46b49fe3f764]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:16:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9989c0d1-5c2f-4ae5-8ae7-a5dfe2e1dd33 tempest-SnapshotsActionsTest-292245125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.4bc2ab55-1567-4cea-b262-b60705b6da22 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:16:19 devstack sudo[92894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.4bc2ab55-1567-4cea-b262-b60705b6da22 Aug 05 10:16:19 devstack sudo[92894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:16:19 devstack sudo[92894]: pam_unix(sudo:session): session closed for user root Aug 05 10:16:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9989c0d1-5c2f-4ae5-8ae7-a5dfe2e1dd33 tempest-SnapshotsActionsTest-292245125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.4bc2ab55-1567-4cea-b262-b60705b6da22" returned: 0 in 0.356s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:16:19 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-9989c0d1-5c2f-4ae5-8ae7-a5dfe2e1dd33 tempest-SnapshotsActionsTest-292245125 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c3de163-dbcc-4590-b19e-5bd38196626f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88613) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:16:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9989c0d1-5c2f-4ae5-8ae7-a5dfe2e1dd33 tempest-SnapshotsActionsTest-292245125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.4bc2ab55-1567-4cea-b262-b60705b6da22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.3452b550-ca4d-411e-85b9-6b5b7fe1b40d 1G {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:16:19 devstack sudo[92899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.4bc2ab55-1567-4cea-b262-b60705b6da22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.3452b550-ca4d-411e-85b9-6b5b7fe1b40d 1G Aug 05 10:16:19 devstack sudo[92899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:16:19 devstack sudo[92899]: pam_unix(sudo:session): session closed for user root Aug 05 10:16:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9989c0d1-5c2f-4ae5-8ae7-a5dfe2e1dd33 tempest-SnapshotsActionsTest-292245125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.4bc2ab55-1567-4cea-b262-b60705b6da22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.3452b550-ca4d-411e-85b9-6b5b7fe1b40d 1G" returned: 0 in 0.527s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:16:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9989c0d1-5c2f-4ae5-8ae7-a5dfe2e1dd33 tempest-SnapshotsActionsTest-292245125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c3de163-dbcc-4590-b19e-5bd38196626f.4bc2ab55-1567-4cea-b262-b60705b6da22 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.3452b550-ca4d-411e-85b9-6b5b7fe1b40d {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:16:20 devstack sudo[92907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c3de163-dbcc-4590-b19e-5bd38196626f.4bc2ab55-1567-4cea-b262-b60705b6da22 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.3452b550-ca4d-411e-85b9-6b5b7fe1b40d Aug 05 10:16:20 devstack sudo[92907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:16:20 devstack sudo[92907]: pam_unix(sudo:session): session closed for user root Aug 05 10:16:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9989c0d1-5c2f-4ae5-8ae7-a5dfe2e1dd33 tempest-SnapshotsActionsTest-292245125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c3de163-dbcc-4590-b19e-5bd38196626f.4bc2ab55-1567-4cea-b262-b60705b6da22 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.3452b550-ca4d-411e-85b9-6b5b7fe1b40d" returned: 0 in 0.384s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:16:20 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-9989c0d1-5c2f-4ae5-8ae7-a5dfe2e1dd33 tempest-SnapshotsActionsTest-292245125 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.3452b550-ca4d-411e-85b9-6b5b7fe1b40d is being set with open permissions: ugo+rw Aug 05 10:16:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9989c0d1-5c2f-4ae5-8ae7-a5dfe2e1dd33 tempest-SnapshotsActionsTest-292245125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.3452b550-ca4d-411e-85b9-6b5b7fe1b40d {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:16:20 devstack sudo[92915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.3452b550-ca4d-411e-85b9-6b5b7fe1b40d Aug 05 10:16:20 devstack sudo[92915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:16:20 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-14a1fd87-65b5-4158-bb83-4379fc22398f tempest-AttachVolumeNegativeTest-1387927917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:16:20 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-14a1fd87-65b5-4158-bb83-4379fc22398f tempest-AttachVolumeNegativeTest-1387927917 None] Flow 'volume_create_manager' (1cdc8a35-fdc3-4b2d-90c8-e28172ec1225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:16:20 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-14a1fd87-65b5-4158-bb83-4379fc22398f tempest-AttachVolumeNegativeTest-1387927917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c239bde-806d-4462-bec7-b4ac062b993f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:16:20 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-14a1fd87-65b5-4158-bb83-4379fc22398f tempest-AttachVolumeNegativeTest-1387927917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c239bde-806d-4462-bec7-b4ac062b993f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:16:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-717303475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91449632-e7bc-4795-856d-70b239798999,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48672fc3cb8343618f2d2cd36237f130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:16:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:16:20Z,use_quota=True,user_id='47c1b556a85a4368a09d710fff39d27c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:16:20 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-14a1fd87-65b5-4158-bb83-4379fc22398f tempest-AttachVolumeNegativeTest-1387927917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81444c59-43a3-40bb-a3b3-23418e9f13ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:16:20 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-14a1fd87-65b5-4158-bb83-4379fc22398f tempest-AttachVolumeNegativeTest-1387927917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81444c59-43a3-40bb-a3b3-23418e9f13ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:16:20 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-14a1fd87-65b5-4158-bb83-4379fc22398f tempest-AttachVolumeNegativeTest-1387927917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (543f0b0c-cd25-4a8b-ad23-105fec0aa25b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:16:20 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-14a1fd87-65b5-4158-bb83-4379fc22398f tempest-AttachVolumeNegativeTest-1387927917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (543f0b0c-cd25-4a8b-ad23-105fec0aa25b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91449632-e7bc-4795-856d-70b239798999', 'volume_name': 'volume-91449632-e7bc-4795-856d-70b239798999', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:16:20 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-14a1fd87-65b5-4158-bb83-4379fc22398f tempest-AttachVolumeNegativeTest-1387927917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33bc561e-5ee0-4728-be08-36d3fec900de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:16:20 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-14a1fd87-65b5-4158-bb83-4379fc22398f tempest-AttachVolumeNegativeTest-1387927917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33bc561e-5ee0-4728-be08-36d3fec900de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:16:20 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-14a1fd87-65b5-4158-bb83-4379fc22398f tempest-AttachVolumeNegativeTest-1387927917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5c62246-ae9e-4b19-a644-debe67d90bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:16:20 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-14a1fd87-65b5-4158-bb83-4379fc22398f tempest-AttachVolumeNegativeTest-1387927917 None] Volume 91449632-e7bc-4795-856d-70b239798999: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91449632-e7bc-4795-856d-70b239798999', 'volume_size': 1} Aug 05 10:16:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-14a1fd87-65b5-4158-bb83-4379fc22398f tempest-AttachVolumeNegativeTest-1387927917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:16:20 devstack sudo[92915]: pam_unix(sudo:session): session closed for user root Aug 05 10:16:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9989c0d1-5c2f-4ae5-8ae7-a5dfe2e1dd33 tempest-SnapshotsActionsTest-292245125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.3452b550-ca4d-411e-85b9-6b5b7fe1b40d" returned: 0 in 0.291s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:16:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-9989c0d1-5c2f-4ae5-8ae7-a5dfe2e1dd33 tempest-SnapshotsActionsTest-292245125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.665s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:16:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-14a1fd87-65b5-4158-bb83-4379fc22398f tempest-AttachVolumeNegativeTest-1387927917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.114s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:16:20 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-14a1fd87-65b5-4158-bb83-4379fc22398f tempest-AttachVolumeNegativeTest-1387927917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:16:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-717303475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91449632-e7bc-4795-856d-70b239798999,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48672fc3cb8343618f2d2cd36237f130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:16:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:16:20Z,use_quota=True,user_id='47c1b556a85a4368a09d710fff39d27c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:16:20 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-14a1fd87-65b5-4158-bb83-4379fc22398f tempest-AttachVolumeNegativeTest-1387927917 None] Creating volume 91449632-e7bc-4795-856d-70b239798999 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:16:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-14a1fd87-65b5-4158-bb83-4379fc22398f tempest-AttachVolumeNegativeTest-1387927917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:16:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-14a1fd87-65b5-4158-bb83-4379fc22398f tempest-AttachVolumeNegativeTest-1387927917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:16:20 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-14a1fd87-65b5-4158-bb83-4379fc22398f tempest-AttachVolumeNegativeTest-1387927917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:16:20 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-14a1fd87-65b5-4158-bb83-4379fc22398f tempest-AttachVolumeNegativeTest-1387927917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:16:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-14a1fd87-65b5-4158-bb83-4379fc22398f tempest-AttachVolumeNegativeTest-1387927917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:16:20 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-14a1fd87-65b5-4158-bb83-4379fc22398f tempest-AttachVolumeNegativeTest-1387927917 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:16:20 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-14a1fd87-65b5-4158-bb83-4379fc22398f tempest-AttachVolumeNegativeTest-1387927917 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:16:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-14a1fd87-65b5-4158-bb83-4379fc22398f tempest-AttachVolumeNegativeTest-1387927917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-91449632-e7bc-4795-856d-70b239798999 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:16:20 devstack sudo[92918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-91449632-e7bc-4795-856d-70b239798999 1073741824 Aug 05 10:16:20 devstack sudo[92918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:16:20 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-9989c0d1-5c2f-4ae5-8ae7-a5dfe2e1dd33 tempest-SnapshotsActionsTest-292245125 None] Create snapshot completed successfully Aug 05 10:16:21 devstack sudo[92918]: pam_unix(sudo:session): session closed for user root Aug 05 10:16:21 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-3f56eb07-e128-4d4f-b898-94612cf578db tempest-SnapshotsActionsTest-1413353285 None] Acquiring lock "cinder-3452b550-ca4d-411e-85b9-6b5b7fe1b40d-delete_snapshot" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:16:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-14a1fd87-65b5-4158-bb83-4379fc22398f tempest-AttachVolumeNegativeTest-1387927917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-91449632-e7bc-4795-856d-70b239798999 1073741824" returned: 0 in 0.539s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:16:21 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-3f56eb07-e128-4d4f-b898-94612cf578db tempest-SnapshotsActionsTest-1413353285 None] Lock "cinder-3452b550-ca4d-411e-85b9-6b5b7fe1b40d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:16:21 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-3f56eb07-e128-4d4f-b898-94612cf578db tempest-SnapshotsActionsTest-1413353285 None] Acquiring lock "cinder-quobyte-2c3de163-dbcc-4590-b19e-5bd38196626f" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:16:21 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-3f56eb07-e128-4d4f-b898-94612cf578db tempest-SnapshotsActionsTest-1413353285 None] Lock "cinder-quobyte-2c3de163-dbcc-4590-b19e-5bd38196626f" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:16:21 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-3f56eb07-e128-4d4f-b898-94612cf578db tempest-SnapshotsActionsTest-1413353285 None] Acquiring lock "cinder-quobyte-3452b550-ca4d-411e-85b9-6b5b7fe1b40d" by "_delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:16:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-14a1fd87-65b5-4158-bb83-4379fc22398f tempest-AttachVolumeNegativeTest-1387927917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-91449632-e7bc-4795-856d-70b239798999 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:16:21 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-3f56eb07-e128-4d4f-b898-94612cf578db tempest-SnapshotsActionsTest-1413353285 None] Lock "cinder-quobyte-3452b550-ca4d-411e-85b9-6b5b7fe1b40d" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:16:21 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-3f56eb07-e128-4d4f-b898-94612cf578db tempest-SnapshotsActionsTest-1413353285 None] Deleting offline snapshot 3452b550-ca4d-411e-85b9-6b5b7fe1b40d of volume 2c3de163-dbcc-4590-b19e-5bd38196626f {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:16:21 devstack sudo[92925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-91449632-e7bc-4795-856d-70b239798999 Aug 05 10:16:21 devstack sudo[92925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:16:21 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-3f56eb07-e128-4d4f-b898-94612cf578db tempest-SnapshotsActionsTest-1413353285 None] snapshot_file for this snap is: volume-2c3de163-dbcc-4590-b19e-5bd38196626f.3452b550-ca4d-411e-85b9-6b5b7fe1b40d {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:16:21 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca47d14d-f530-48ff-a8e2-f824a0ceff7d]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:16:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3f56eb07-e128-4d4f-b898-94612cf578db tempest-SnapshotsActionsTest-1413353285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.3452b550-ca4d-411e-85b9-6b5b7fe1b40d {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:16:21 devstack sudo[92927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.3452b550-ca4d-411e-85b9-6b5b7fe1b40d Aug 05 10:16:21 devstack sudo[92927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:16:21 devstack sudo[92925]: pam_unix(sudo:session): session closed for user root Aug 05 10:16:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-14a1fd87-65b5-4158-bb83-4379fc22398f tempest-AttachVolumeNegativeTest-1387927917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-91449632-e7bc-4795-856d-70b239798999" returned: 0 in 0.365s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:16:21 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-14a1fd87-65b5-4158-bb83-4379fc22398f tempest-AttachVolumeNegativeTest-1387927917 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:16:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-14a1fd87-65b5-4158-bb83-4379fc22398f tempest-AttachVolumeNegativeTest-1387927917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:16:21 devstack cinder-volume[88613]: DEBUG oslo_service.periodic_task [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88613) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:16:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:16:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:16:21 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:16:21 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:16:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:16:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:16:21 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-14a1fd87-65b5-4158-bb83-4379fc22398f tempest-AttachVolumeNegativeTest-1387927917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5c62246-ae9e-4b19-a644-debe67d90bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91449632-e7bc-4795-856d-70b239798999', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:16:21 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-14a1fd87-65b5-4158-bb83-4379fc22398f tempest-AttachVolumeNegativeTest-1387927917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4130912-fe73-4a5a-9536-b42eae6d421a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:16:21 devstack sudo[92930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:16:21 devstack sudo[92930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:16:21 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-14a1fd87-65b5-4158-bb83-4379fc22398f tempest-AttachVolumeNegativeTest-1387927917 None] Volume volume-91449632-e7bc-4795-856d-70b239798999 (91449632-e7bc-4795-856d-70b239798999): created successfully Aug 05 10:16:21 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-14a1fd87-65b5-4158-bb83-4379fc22398f tempest-AttachVolumeNegativeTest-1387927917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4130912-fe73-4a5a-9536-b42eae6d421a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:16:21 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-14a1fd87-65b5-4158-bb83-4379fc22398f tempest-AttachVolumeNegativeTest-1387927917 None] Flow 'volume_create_manager' (1cdc8a35-fdc3-4b2d-90c8-e28172ec1225) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:16:21 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-14a1fd87-65b5-4158-bb83-4379fc22398f tempest-AttachVolumeNegativeTest-1387927917 None] Created volume successfully. Aug 05 10:16:21 devstack sudo[92927]: pam_unix(sudo:session): session closed for user root Aug 05 10:16:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3f56eb07-e128-4d4f-b898-94612cf578db tempest-SnapshotsActionsTest-1413353285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.3452b550-ca4d-411e-85b9-6b5b7fe1b40d" returned: 0 in 0.487s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:16:21 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-3f56eb07-e128-4d4f-b898-94612cf578db tempest-SnapshotsActionsTest-1413353285 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c3de163-dbcc-4590-b19e-5bd38196626f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88613) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:16:21 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[4889bbe0-d218-4239-8b2f-6529c39f6b3a]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:16:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3f56eb07-e128-4d4f-b898-94612cf578db tempest-SnapshotsActionsTest-1413353285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.4bc2ab55-1567-4cea-b262-b60705b6da22 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:16:22 devstack sudo[92935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.4bc2ab55-1567-4cea-b262-b60705b6da22 Aug 05 10:16:22 devstack sudo[92935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:16:22 devstack sudo[92930]: pam_unix(sudo:session): session closed for user root Aug 05 10:16:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.368s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:16:22 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:16:22 devstack sudo[92935]: pam_unix(sudo:session): session closed for user root Aug 05 10:16:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3f56eb07-e128-4d4f-b898-94612cf578db tempest-SnapshotsActionsTest-1413353285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.4bc2ab55-1567-4cea-b262-b60705b6da22" returned: 0 in 0.411s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:16:22 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-3f56eb07-e128-4d4f-b898-94612cf578db tempest-SnapshotsActionsTest-1413353285 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c3de163-dbcc-4590-b19e-5bd38196626f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88613) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:16:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3f56eb07-e128-4d4f-b898-94612cf578db tempest-SnapshotsActionsTest-1413353285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.3452b550-ca4d-411e-85b9-6b5b7fe1b40d {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:16:22 devstack sudo[92960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.3452b550-ca4d-411e-85b9-6b5b7fe1b40d Aug 05 10:16:22 devstack sudo[92960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:16:22 devstack sudo[92960]: pam_unix(sudo:session): session closed for user root Aug 05 10:16:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3f56eb07-e128-4d4f-b898-94612cf578db tempest-SnapshotsActionsTest-1413353285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.3452b550-ca4d-411e-85b9-6b5b7fe1b40d" returned: 0 in 0.446s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:16:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3f56eb07-e128-4d4f-b898-94612cf578db tempest-SnapshotsActionsTest-1413353285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.3452b550-ca4d-411e-85b9-6b5b7fe1b40d {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:16:22 devstack sudo[92969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.3452b550-ca4d-411e-85b9-6b5b7fe1b40d Aug 05 10:16:22 devstack sudo[92969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:16:23 devstack sudo[92969]: pam_unix(sudo:session): session closed for user root Aug 05 10:16:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3f56eb07-e128-4d4f-b898-94612cf578db tempest-SnapshotsActionsTest-1413353285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.3452b550-ca4d-411e-85b9-6b5b7fe1b40d" returned: 0 in 0.310s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:16:23 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-3f56eb07-e128-4d4f-b898-94612cf578db tempest-SnapshotsActionsTest-1413353285 None] Lock "cinder-quobyte-3452b550-ca4d-411e-85b9-6b5b7fe1b40d" released by "_delete_snapshot" :: held 1.781s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:16:23 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-3f56eb07-e128-4d4f-b898-94612cf578db tempest-SnapshotsActionsTest-1413353285 None] Lock "cinder-quobyte-2c3de163-dbcc-4590-b19e-5bd38196626f" released by "delete_snapshot" :: held 1.832s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:16:23 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-3f56eb07-e128-4d4f-b898-94612cf578db tempest-SnapshotsActionsTest-1413353285 None] Created reservations ['108be4a6-cffb-4089-a226-a66c8ec17915', 'cd0c5469-9bb8-436c-b876-eed8f5b361b5', '7b068c60-62e2-4372-a245-ad405e345cd7', '725638c1-65c2-4511-b491-418cb886552c'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:16:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-d1381c84-42ed-47e0-9704-ecbca8eb3cda req-e9ab306d-9896-4f8a-98f1-09bf05068876 tempest-AttachVolumeNegativeTest-1387927917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:16:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-d1381c84-42ed-47e0-9704-ecbca8eb3cda req-e9ab306d-9896-4f8a-98f1-09bf05068876 tempest-AttachVolumeNegativeTest-1387927917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:16:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-d1381c84-42ed-47e0-9704-ecbca8eb3cda req-e9ab306d-9896-4f8a-98f1-09bf05068876 tempest-AttachVolumeNegativeTest-1387927917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:16:23 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-3f56eb07-e128-4d4f-b898-94612cf578db tempest-SnapshotsActionsTest-1413353285 None] Delete snapshot completed successfully. Aug 05 10:16:23 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [req-d1381c84-42ed-47e0-9704-ecbca8eb3cda req-e9ab306d-9896-4f8a-98f1-09bf05068876 tempest-AttachVolumeNegativeTest-1387927917 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1', 'name': 'volume-91449632-e7bc-4795-856d-70b239798999', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7ec7cd27-0c22-40e0-88db-f0d7405ce595', 'enforce_multipath': True} {{(pid=88613) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 10:16:23 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-3f56eb07-e128-4d4f-b898-94612cf578db tempest-SnapshotsActionsTest-1413353285 None] Lock "cinder-3452b550-ca4d-411e-85b9-6b5b7fe1b40d-delete_snapshot" released by "delete_snapshot" :: held 2.019s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:16:23 devstack cinder-volume[88613]: INFO cinder.volume.manager [req-d1381c84-42ed-47e0-9704-ecbca8eb3cda req-e9ab306d-9896-4f8a-98f1-09bf05068876 tempest-AttachVolumeNegativeTest-1387927917 None] attachment_update completed successfully. Aug 05 10:16:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-7c984f4d-beb3-4113-a0d2-b14469b111cc tempest-SnapshotsActionsTest-292245125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:16:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-7c984f4d-beb3-4113-a0d2-b14469b111cc tempest-SnapshotsActionsTest-292245125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:16:23 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-7c984f4d-beb3-4113-a0d2-b14469b111cc tempest-SnapshotsActionsTest-292245125 None] Creating offline snapshot d5eafdf9-ea8b-483e-a62d-be42216036f5 of volume 2c3de163-dbcc-4590-b19e-5bd38196626f {{(pid=88613) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:16:23 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de95fca-ffdb-4693-9015-a78dbc21cb86]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:16:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7c984f4d-beb3-4113-a0d2-b14469b111cc tempest-SnapshotsActionsTest-292245125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.4bc2ab55-1567-4cea-b262-b60705b6da22 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:16:23 devstack sudo[92987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.4bc2ab55-1567-4cea-b262-b60705b6da22 Aug 05 10:16:23 devstack sudo[92987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:16:24 devstack sudo[92987]: pam_unix(sudo:session): session closed for user root Aug 05 10:16:24 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7c984f4d-beb3-4113-a0d2-b14469b111cc tempest-SnapshotsActionsTest-292245125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.4bc2ab55-1567-4cea-b262-b60705b6da22" returned: 0 in 0.425s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:16:24 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-7c984f4d-beb3-4113-a0d2-b14469b111cc tempest-SnapshotsActionsTest-292245125 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c3de163-dbcc-4590-b19e-5bd38196626f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88613) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:16:24 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7c984f4d-beb3-4113-a0d2-b14469b111cc tempest-SnapshotsActionsTest-292245125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.4bc2ab55-1567-4cea-b262-b60705b6da22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.d5eafdf9-ea8b-483e-a62d-be42216036f5 1G {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:16:24 devstack sudo[92992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.4bc2ab55-1567-4cea-b262-b60705b6da22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.d5eafdf9-ea8b-483e-a62d-be42216036f5 1G Aug 05 10:16:24 devstack sudo[92992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:16:24 devstack sudo[92992]: pam_unix(sudo:session): session closed for user root Aug 05 10:16:24 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7c984f4d-beb3-4113-a0d2-b14469b111cc tempest-SnapshotsActionsTest-292245125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.4bc2ab55-1567-4cea-b262-b60705b6da22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.d5eafdf9-ea8b-483e-a62d-be42216036f5 1G" returned: 0 in 0.503s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:16:24 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7c984f4d-beb3-4113-a0d2-b14469b111cc tempest-SnapshotsActionsTest-292245125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c3de163-dbcc-4590-b19e-5bd38196626f.4bc2ab55-1567-4cea-b262-b60705b6da22 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.d5eafdf9-ea8b-483e-a62d-be42216036f5 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:16:24 devstack sudo[92998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c3de163-dbcc-4590-b19e-5bd38196626f.4bc2ab55-1567-4cea-b262-b60705b6da22 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.d5eafdf9-ea8b-483e-a62d-be42216036f5 Aug 05 10:16:24 devstack sudo[92998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:16:25 devstack sudo[92998]: pam_unix(sudo:session): session closed for user root Aug 05 10:16:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7c984f4d-beb3-4113-a0d2-b14469b111cc tempest-SnapshotsActionsTest-292245125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c3de163-dbcc-4590-b19e-5bd38196626f.4bc2ab55-1567-4cea-b262-b60705b6da22 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.d5eafdf9-ea8b-483e-a62d-be42216036f5" returned: 0 in 0.317s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:16:25 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-7c984f4d-beb3-4113-a0d2-b14469b111cc tempest-SnapshotsActionsTest-292245125 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.d5eafdf9-ea8b-483e-a62d-be42216036f5 is being set with open permissions: ugo+rw Aug 05 10:16:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7c984f4d-beb3-4113-a0d2-b14469b111cc tempest-SnapshotsActionsTest-292245125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.d5eafdf9-ea8b-483e-a62d-be42216036f5 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:16:25 devstack sudo[93003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.d5eafdf9-ea8b-483e-a62d-be42216036f5 Aug 05 10:16:25 devstack sudo[93003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:16:25 devstack sudo[93003]: pam_unix(sudo:session): session closed for user root Aug 05 10:16:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7c984f4d-beb3-4113-a0d2-b14469b111cc tempest-SnapshotsActionsTest-292245125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.d5eafdf9-ea8b-483e-a62d-be42216036f5" returned: 0 in 0.259s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:16:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-7c984f4d-beb3-4113-a0d2-b14469b111cc tempest-SnapshotsActionsTest-292245125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.616s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:16:25 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-7c984f4d-beb3-4113-a0d2-b14469b111cc tempest-SnapshotsActionsTest-292245125 None] Create snapshot completed successfully Aug 05 10:16:25 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-7db13412-a725-44c1-9138-535bd96bccd1 tempest-SnapshotsActionsTest-1413353285 None] Acquiring lock "cinder-d5eafdf9-ea8b-483e-a62d-be42216036f5-delete_snapshot" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:16:25 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-7db13412-a725-44c1-9138-535bd96bccd1 tempest-SnapshotsActionsTest-1413353285 None] Lock "cinder-d5eafdf9-ea8b-483e-a62d-be42216036f5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:16:25 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-7db13412-a725-44c1-9138-535bd96bccd1 tempest-SnapshotsActionsTest-1413353285 None] Acquiring lock "cinder-quobyte-2c3de163-dbcc-4590-b19e-5bd38196626f" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:16:26 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-7db13412-a725-44c1-9138-535bd96bccd1 tempest-SnapshotsActionsTest-1413353285 None] Lock "cinder-quobyte-2c3de163-dbcc-4590-b19e-5bd38196626f" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:16:26 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-7db13412-a725-44c1-9138-535bd96bccd1 tempest-SnapshotsActionsTest-1413353285 None] Acquiring lock "cinder-quobyte-d5eafdf9-ea8b-483e-a62d-be42216036f5" by "_delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:16:26 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-7db13412-a725-44c1-9138-535bd96bccd1 tempest-SnapshotsActionsTest-1413353285 None] Lock "cinder-quobyte-d5eafdf9-ea8b-483e-a62d-be42216036f5" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:16:26 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-7db13412-a725-44c1-9138-535bd96bccd1 tempest-SnapshotsActionsTest-1413353285 None] Deleting offline snapshot d5eafdf9-ea8b-483e-a62d-be42216036f5 of volume 2c3de163-dbcc-4590-b19e-5bd38196626f {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:16:26 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-7db13412-a725-44c1-9138-535bd96bccd1 tempest-SnapshotsActionsTest-1413353285 None] snapshot_file for this snap is: volume-2c3de163-dbcc-4590-b19e-5bd38196626f.d5eafdf9-ea8b-483e-a62d-be42216036f5 {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:16:26 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[25bde819-d412-4a5f-93a1-2e7be575e367]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:16:26 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7db13412-a725-44c1-9138-535bd96bccd1 tempest-SnapshotsActionsTest-1413353285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.d5eafdf9-ea8b-483e-a62d-be42216036f5 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:16:26 devstack sudo[93006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.d5eafdf9-ea8b-483e-a62d-be42216036f5 Aug 05 10:16:26 devstack sudo[93006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:16:26 devstack sudo[93006]: pam_unix(sudo:session): session closed for user root Aug 05 10:16:26 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7db13412-a725-44c1-9138-535bd96bccd1 tempest-SnapshotsActionsTest-1413353285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.d5eafdf9-ea8b-483e-a62d-be42216036f5" returned: 0 in 0.422s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:16:26 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-7db13412-a725-44c1-9138-535bd96bccd1 tempest-SnapshotsActionsTest-1413353285 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c3de163-dbcc-4590-b19e-5bd38196626f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88613) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:16:26 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91fe723-d608-4a05-b301-d2a41c86913a]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:16:26 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7db13412-a725-44c1-9138-535bd96bccd1 tempest-SnapshotsActionsTest-1413353285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.4bc2ab55-1567-4cea-b262-b60705b6da22 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:16:26 devstack sudo[93011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.4bc2ab55-1567-4cea-b262-b60705b6da22 Aug 05 10:16:26 devstack sudo[93011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:16:26 devstack sudo[93011]: pam_unix(sudo:session): session closed for user root Aug 05 10:16:26 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7db13412-a725-44c1-9138-535bd96bccd1 tempest-SnapshotsActionsTest-1413353285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.4bc2ab55-1567-4cea-b262-b60705b6da22" returned: 0 in 0.361s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:16:26 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-7db13412-a725-44c1-9138-535bd96bccd1 tempest-SnapshotsActionsTest-1413353285 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c3de163-dbcc-4590-b19e-5bd38196626f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88613) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:16:26 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7db13412-a725-44c1-9138-535bd96bccd1 tempest-SnapshotsActionsTest-1413353285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.d5eafdf9-ea8b-483e-a62d-be42216036f5 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:16:26 devstack sudo[93016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.d5eafdf9-ea8b-483e-a62d-be42216036f5 Aug 05 10:16:26 devstack sudo[93016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:16:27 devstack sudo[93016]: pam_unix(sudo:session): session closed for user root Aug 05 10:16:27 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7db13412-a725-44c1-9138-535bd96bccd1 tempest-SnapshotsActionsTest-1413353285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.d5eafdf9-ea8b-483e-a62d-be42216036f5" returned: 0 in 0.423s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:16:27 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7db13412-a725-44c1-9138-535bd96bccd1 tempest-SnapshotsActionsTest-1413353285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.d5eafdf9-ea8b-483e-a62d-be42216036f5 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:16:27 devstack sudo[93027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.d5eafdf9-ea8b-483e-a62d-be42216036f5 Aug 05 10:16:27 devstack sudo[93027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:16:27 devstack sudo[93027]: pam_unix(sudo:session): session closed for user root Aug 05 10:16:27 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7db13412-a725-44c1-9138-535bd96bccd1 tempest-SnapshotsActionsTest-1413353285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.d5eafdf9-ea8b-483e-a62d-be42216036f5" returned: 0 in 0.263s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:16:27 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-7db13412-a725-44c1-9138-535bd96bccd1 tempest-SnapshotsActionsTest-1413353285 None] Lock "cinder-quobyte-d5eafdf9-ea8b-483e-a62d-be42216036f5" released by "_delete_snapshot" :: held 1.584s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:16:27 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-7db13412-a725-44c1-9138-535bd96bccd1 tempest-SnapshotsActionsTest-1413353285 None] Lock "cinder-quobyte-2c3de163-dbcc-4590-b19e-5bd38196626f" released by "delete_snapshot" :: held 1.609s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:16:27 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-7db13412-a725-44c1-9138-535bd96bccd1 tempest-SnapshotsActionsTest-1413353285 None] Created reservations ['f9312133-b6cb-45bc-9d99-95f2ac045dd0', 'cde7f886-ca52-4b87-acbd-1a4affe84e26', '59b7f097-a9dc-4a57-b0ae-2e8714757149', 'fb3e4e2b-90b5-422d-bac2-573161e1f1d3'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:16:27 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-7db13412-a725-44c1-9138-535bd96bccd1 tempest-SnapshotsActionsTest-1413353285 None] Delete snapshot completed successfully. Aug 05 10:16:27 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-7db13412-a725-44c1-9138-535bd96bccd1 tempest-SnapshotsActionsTest-1413353285 None] Lock "cinder-d5eafdf9-ea8b-483e-a62d-be42216036f5-delete_snapshot" released by "delete_snapshot" :: held 1.783s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:16:28 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-4ba34eb2-e361-406d-9190-949d2062635c tempest-SnapshotsActionsTest-292245125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:16:28 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-4ba34eb2-e361-406d-9190-949d2062635c tempest-SnapshotsActionsTest-292245125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:16:28 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-4ba34eb2-e361-406d-9190-949d2062635c tempest-SnapshotsActionsTest-292245125 None] Creating offline snapshot aa009df5-b140-476c-b440-a18119b0d128 of volume 2c3de163-dbcc-4590-b19e-5bd38196626f {{(pid=88613) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:16:28 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3774288-4412-42a5-8ffd-0e4a4905333a]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:16:28 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4ba34eb2-e361-406d-9190-949d2062635c tempest-SnapshotsActionsTest-292245125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.4bc2ab55-1567-4cea-b262-b60705b6da22 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:16:28 devstack sudo[93059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.4bc2ab55-1567-4cea-b262-b60705b6da22 Aug 05 10:16:28 devstack sudo[93059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:16:28 devstack sudo[93059]: pam_unix(sudo:session): session closed for user root Aug 05 10:16:28 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4ba34eb2-e361-406d-9190-949d2062635c tempest-SnapshotsActionsTest-292245125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.4bc2ab55-1567-4cea-b262-b60705b6da22" returned: 0 in 0.381s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:16:28 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-4ba34eb2-e361-406d-9190-949d2062635c tempest-SnapshotsActionsTest-292245125 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c3de163-dbcc-4590-b19e-5bd38196626f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88613) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:16:28 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4ba34eb2-e361-406d-9190-949d2062635c tempest-SnapshotsActionsTest-292245125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.4bc2ab55-1567-4cea-b262-b60705b6da22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.aa009df5-b140-476c-b440-a18119b0d128 1G {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:16:28 devstack sudo[93064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.4bc2ab55-1567-4cea-b262-b60705b6da22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.aa009df5-b140-476c-b440-a18119b0d128 1G Aug 05 10:16:28 devstack sudo[93064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:16:29 devstack sudo[93064]: pam_unix(sudo:session): session closed for user root Aug 05 10:16:29 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4ba34eb2-e361-406d-9190-949d2062635c tempest-SnapshotsActionsTest-292245125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.4bc2ab55-1567-4cea-b262-b60705b6da22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.aa009df5-b140-476c-b440-a18119b0d128 1G" returned: 0 in 0.622s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:16:29 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4ba34eb2-e361-406d-9190-949d2062635c tempest-SnapshotsActionsTest-292245125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c3de163-dbcc-4590-b19e-5bd38196626f.4bc2ab55-1567-4cea-b262-b60705b6da22 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.aa009df5-b140-476c-b440-a18119b0d128 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:16:29 devstack sudo[93069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c3de163-dbcc-4590-b19e-5bd38196626f.4bc2ab55-1567-4cea-b262-b60705b6da22 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.aa009df5-b140-476c-b440-a18119b0d128 Aug 05 10:16:29 devstack sudo[93069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:16:29 devstack sudo[93069]: pam_unix(sudo:session): session closed for user root Aug 05 10:16:29 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4ba34eb2-e361-406d-9190-949d2062635c tempest-SnapshotsActionsTest-292245125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c3de163-dbcc-4590-b19e-5bd38196626f.4bc2ab55-1567-4cea-b262-b60705b6da22 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.aa009df5-b140-476c-b440-a18119b0d128" returned: 0 in 0.338s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:16:29 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-4ba34eb2-e361-406d-9190-949d2062635c tempest-SnapshotsActionsTest-292245125 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.aa009df5-b140-476c-b440-a18119b0d128 is being set with open permissions: ugo+rw Aug 05 10:16:29 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4ba34eb2-e361-406d-9190-949d2062635c tempest-SnapshotsActionsTest-292245125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.aa009df5-b140-476c-b440-a18119b0d128 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:16:29 devstack sudo[93074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.aa009df5-b140-476c-b440-a18119b0d128 Aug 05 10:16:29 devstack sudo[93074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:16:30 devstack sudo[93074]: pam_unix(sudo:session): session closed for user root Aug 05 10:16:30 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4ba34eb2-e361-406d-9190-949d2062635c tempest-SnapshotsActionsTest-292245125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.aa009df5-b140-476c-b440-a18119b0d128" returned: 0 in 0.290s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:16:30 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-4ba34eb2-e361-406d-9190-949d2062635c tempest-SnapshotsActionsTest-292245125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.787s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:16:30 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-4ba34eb2-e361-406d-9190-949d2062635c tempest-SnapshotsActionsTest-292245125 None] Create snapshot completed successfully Aug 05 10:16:30 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-317233d1-ce4b-4702-9e9b-a7d8229cd1ba tempest-SnapshotsActionsTest-1413353285 None] Acquiring lock "cinder-aa009df5-b140-476c-b440-a18119b0d128-delete_snapshot" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:16:30 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-317233d1-ce4b-4702-9e9b-a7d8229cd1ba tempest-SnapshotsActionsTest-1413353285 None] Lock "cinder-aa009df5-b140-476c-b440-a18119b0d128-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:16:30 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-317233d1-ce4b-4702-9e9b-a7d8229cd1ba tempest-SnapshotsActionsTest-1413353285 None] Acquiring lock "cinder-quobyte-2c3de163-dbcc-4590-b19e-5bd38196626f" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:16:30 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-317233d1-ce4b-4702-9e9b-a7d8229cd1ba tempest-SnapshotsActionsTest-1413353285 None] Lock "cinder-quobyte-2c3de163-dbcc-4590-b19e-5bd38196626f" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:16:30 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-317233d1-ce4b-4702-9e9b-a7d8229cd1ba tempest-SnapshotsActionsTest-1413353285 None] Acquiring lock "cinder-quobyte-aa009df5-b140-476c-b440-a18119b0d128" by "_delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:16:30 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-317233d1-ce4b-4702-9e9b-a7d8229cd1ba tempest-SnapshotsActionsTest-1413353285 None] Lock "cinder-quobyte-aa009df5-b140-476c-b440-a18119b0d128" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:16:30 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-317233d1-ce4b-4702-9e9b-a7d8229cd1ba tempest-SnapshotsActionsTest-1413353285 None] Deleting offline snapshot aa009df5-b140-476c-b440-a18119b0d128 of volume 2c3de163-dbcc-4590-b19e-5bd38196626f {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:16:30 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-317233d1-ce4b-4702-9e9b-a7d8229cd1ba tempest-SnapshotsActionsTest-1413353285 None] snapshot_file for this snap is: volume-2c3de163-dbcc-4590-b19e-5bd38196626f.aa009df5-b140-476c-b440-a18119b0d128 {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:16:30 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aaf9610-6bb9-4ad3-9d9f-1a5b62f107bf]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:16:30 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-317233d1-ce4b-4702-9e9b-a7d8229cd1ba tempest-SnapshotsActionsTest-1413353285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.aa009df5-b140-476c-b440-a18119b0d128 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:16:31 devstack sudo[93094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.aa009df5-b140-476c-b440-a18119b0d128 Aug 05 10:16:31 devstack sudo[93094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:16:31 devstack sudo[93094]: pam_unix(sudo:session): session closed for user root Aug 05 10:16:31 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-317233d1-ce4b-4702-9e9b-a7d8229cd1ba tempest-SnapshotsActionsTest-1413353285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.aa009df5-b140-476c-b440-a18119b0d128" returned: 0 in 0.393s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:16:31 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-317233d1-ce4b-4702-9e9b-a7d8229cd1ba tempest-SnapshotsActionsTest-1413353285 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c3de163-dbcc-4590-b19e-5bd38196626f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88613) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:16:31 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[050d5c0d-0ee9-4765-b6be-cad65f7047cd]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:16:31 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-317233d1-ce4b-4702-9e9b-a7d8229cd1ba tempest-SnapshotsActionsTest-1413353285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.4bc2ab55-1567-4cea-b262-b60705b6da22 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:16:31 devstack sudo[93099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.4bc2ab55-1567-4cea-b262-b60705b6da22 Aug 05 10:16:31 devstack sudo[93099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:16:31 devstack sudo[93099]: pam_unix(sudo:session): session closed for user root Aug 05 10:16:31 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-317233d1-ce4b-4702-9e9b-a7d8229cd1ba tempest-SnapshotsActionsTest-1413353285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.4bc2ab55-1567-4cea-b262-b60705b6da22" returned: 0 in 0.428s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:16:31 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-317233d1-ce4b-4702-9e9b-a7d8229cd1ba tempest-SnapshotsActionsTest-1413353285 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c3de163-dbcc-4590-b19e-5bd38196626f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88613) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:16:31 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-317233d1-ce4b-4702-9e9b-a7d8229cd1ba tempest-SnapshotsActionsTest-1413353285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.aa009df5-b140-476c-b440-a18119b0d128 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:16:31 devstack sudo[93106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.aa009df5-b140-476c-b440-a18119b0d128 Aug 05 10:16:31 devstack sudo[93106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:16:32 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-317233d1-ce4b-4702-9e9b-a7d8229cd1ba tempest-SnapshotsActionsTest-1413353285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.aa009df5-b140-476c-b440-a18119b0d128" returned: 0 in 0.525s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:16:32 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-317233d1-ce4b-4702-9e9b-a7d8229cd1ba tempest-SnapshotsActionsTest-1413353285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.aa009df5-b140-476c-b440-a18119b0d128 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:16:32 devstack sudo[93106]: pam_unix(sudo:session): session closed for user root Aug 05 10:16:32 devstack sudo[93115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.aa009df5-b140-476c-b440-a18119b0d128 Aug 05 10:16:32 devstack sudo[93115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:16:32 devstack sudo[93115]: pam_unix(sudo:session): session closed for user root Aug 05 10:16:32 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-317233d1-ce4b-4702-9e9b-a7d8229cd1ba tempest-SnapshotsActionsTest-1413353285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.aa009df5-b140-476c-b440-a18119b0d128" returned: 0 in 0.579s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:16:32 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-317233d1-ce4b-4702-9e9b-a7d8229cd1ba tempest-SnapshotsActionsTest-1413353285 None] Lock "cinder-quobyte-aa009df5-b140-476c-b440-a18119b0d128" released by "_delete_snapshot" :: held 2.052s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:16:33 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-317233d1-ce4b-4702-9e9b-a7d8229cd1ba tempest-SnapshotsActionsTest-1413353285 None] Lock "cinder-quobyte-2c3de163-dbcc-4590-b19e-5bd38196626f" released by "delete_snapshot" :: held 2.097s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:16:33 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-317233d1-ce4b-4702-9e9b-a7d8229cd1ba tempest-SnapshotsActionsTest-1413353285 None] Created reservations ['e1f7ce17-d761-4e74-8411-5e146d08f8c9', 'cb5d7cde-3867-4a6c-b472-e80c17a82c17', '2190dedc-14cb-460f-a492-f7906d1eddc8', '3f8dce13-3bb8-4858-8f27-8542c8725a72'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:16:33 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-317233d1-ce4b-4702-9e9b-a7d8229cd1ba tempest-SnapshotsActionsTest-1413353285 None] Delete snapshot completed successfully. Aug 05 10:16:33 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-317233d1-ce4b-4702-9e9b-a7d8229cd1ba tempest-SnapshotsActionsTest-1413353285 None] Lock "cinder-aa009df5-b140-476c-b440-a18119b0d128-delete_snapshot" released by "delete_snapshot" :: held 2.281s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:16:34 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-581cfccb-e4fa-41ae-99bf-4751c9ed3ecc tempest-SnapshotsActionsTest-292245125 None] Acquiring lock "cinder-4bc2ab55-1567-4cea-b262-b60705b6da22-delete_snapshot" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:16:34 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-581cfccb-e4fa-41ae-99bf-4751c9ed3ecc tempest-SnapshotsActionsTest-292245125 None] Lock "cinder-4bc2ab55-1567-4cea-b262-b60705b6da22-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:16:34 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-581cfccb-e4fa-41ae-99bf-4751c9ed3ecc tempest-SnapshotsActionsTest-292245125 None] Acquiring lock "cinder-quobyte-2c3de163-dbcc-4590-b19e-5bd38196626f" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:16:34 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-581cfccb-e4fa-41ae-99bf-4751c9ed3ecc tempest-SnapshotsActionsTest-292245125 None] Lock "cinder-quobyte-2c3de163-dbcc-4590-b19e-5bd38196626f" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:16:34 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-581cfccb-e4fa-41ae-99bf-4751c9ed3ecc tempest-SnapshotsActionsTest-292245125 None] Acquiring lock "cinder-quobyte-4bc2ab55-1567-4cea-b262-b60705b6da22" by "_delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:16:34 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-581cfccb-e4fa-41ae-99bf-4751c9ed3ecc tempest-SnapshotsActionsTest-292245125 None] Lock "cinder-quobyte-4bc2ab55-1567-4cea-b262-b60705b6da22" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:16:34 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-581cfccb-e4fa-41ae-99bf-4751c9ed3ecc tempest-SnapshotsActionsTest-292245125 None] Deleting offline snapshot 4bc2ab55-1567-4cea-b262-b60705b6da22 of volume 2c3de163-dbcc-4590-b19e-5bd38196626f {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:16:34 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-581cfccb-e4fa-41ae-99bf-4751c9ed3ecc tempest-SnapshotsActionsTest-292245125 None] snapshot_file for this snap is: volume-2c3de163-dbcc-4590-b19e-5bd38196626f.4bc2ab55-1567-4cea-b262-b60705b6da22 {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:16:34 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6de4c6-f36f-4b46-874c-7d9c36a57f94]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:16:34 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-581cfccb-e4fa-41ae-99bf-4751c9ed3ecc tempest-SnapshotsActionsTest-292245125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.4bc2ab55-1567-4cea-b262-b60705b6da22 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:16:34 devstack sudo[93172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.4bc2ab55-1567-4cea-b262-b60705b6da22 Aug 05 10:16:34 devstack sudo[93172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:16:35 devstack sudo[93172]: pam_unix(sudo:session): session closed for user root Aug 05 10:16:35 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-581cfccb-e4fa-41ae-99bf-4751c9ed3ecc tempest-SnapshotsActionsTest-292245125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.4bc2ab55-1567-4cea-b262-b60705b6da22" returned: 0 in 0.410s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:16:35 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-581cfccb-e4fa-41ae-99bf-4751c9ed3ecc tempest-SnapshotsActionsTest-292245125 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c3de163-dbcc-4590-b19e-5bd38196626f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88613) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:16:35 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d83b2e-3e95-4893-8d6c-3aa612803c1b]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:16:35 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-581cfccb-e4fa-41ae-99bf-4751c9ed3ecc tempest-SnapshotsActionsTest-292245125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:16:35 devstack sudo[93179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f Aug 05 10:16:35 devstack sudo[93179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:16:35 devstack sudo[93179]: pam_unix(sudo:session): session closed for user root Aug 05 10:16:35 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-581cfccb-e4fa-41ae-99bf-4751c9ed3ecc tempest-SnapshotsActionsTest-292245125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f" returned: 0 in 0.468s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:16:35 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-581cfccb-e4fa-41ae-99bf-4751c9ed3ecc tempest-SnapshotsActionsTest-292245125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.4bc2ab55-1567-4cea-b262-b60705b6da22 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:16:35 devstack sudo[93186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.4bc2ab55-1567-4cea-b262-b60705b6da22 Aug 05 10:16:35 devstack sudo[93186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:16:36 devstack sudo[93186]: pam_unix(sudo:session): session closed for user root Aug 05 10:16:36 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-581cfccb-e4fa-41ae-99bf-4751c9ed3ecc tempest-SnapshotsActionsTest-292245125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.4bc2ab55-1567-4cea-b262-b60705b6da22" returned: 0 in 0.479s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:16:36 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-581cfccb-e4fa-41ae-99bf-4751c9ed3ecc tempest-SnapshotsActionsTest-292245125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.4bc2ab55-1567-4cea-b262-b60705b6da22 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:16:36 devstack sudo[93193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.4bc2ab55-1567-4cea-b262-b60705b6da22 Aug 05 10:16:36 devstack sudo[93193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:16:36 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-581cfccb-e4fa-41ae-99bf-4751c9ed3ecc tempest-SnapshotsActionsTest-292245125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f.4bc2ab55-1567-4cea-b262-b60705b6da22" returned: 0 in 0.477s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:16:36 devstack sudo[93193]: pam_unix(sudo:session): session closed for user root Aug 05 10:16:36 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-581cfccb-e4fa-41ae-99bf-4751c9ed3ecc tempest-SnapshotsActionsTest-292245125 None] Lock "cinder-quobyte-4bc2ab55-1567-4cea-b262-b60705b6da22" released by "_delete_snapshot" :: held 2.009s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:16:36 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-581cfccb-e4fa-41ae-99bf-4751c9ed3ecc tempest-SnapshotsActionsTest-292245125 None] Lock "cinder-quobyte-2c3de163-dbcc-4590-b19e-5bd38196626f" released by "delete_snapshot" :: held 2.044s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:16:36 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-581cfccb-e4fa-41ae-99bf-4751c9ed3ecc tempest-SnapshotsActionsTest-292245125 None] Created reservations ['fe870f4d-d42a-4a79-a6a7-e2d12224c331', '6215e93c-2cf1-415b-9c49-73da15aca509', '5f22c8a0-8291-4ad3-bef2-5570567ecbba', '0c47e056-c981-48e3-bc31-b8abb366337a'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:16:36 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-581cfccb-e4fa-41ae-99bf-4751c9ed3ecc tempest-SnapshotsActionsTest-292245125 None] Delete snapshot completed successfully. Aug 05 10:16:36 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-581cfccb-e4fa-41ae-99bf-4751c9ed3ecc tempest-SnapshotsActionsTest-292245125 None] Lock "cinder-4bc2ab55-1567-4cea-b262-b60705b6da22-delete_snapshot" released by "delete_snapshot" :: held 2.327s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:16:37 devstack cinder-volume[88613]: INFO cinder.volume.manager [req-d6eae58b-98a0-4a2e-af9f-3fe998fa590f req-cc789562-5744-4da9-8e48-49ef647b6956 tempest-ServerActionsTestOtherA-221436279 None] Terminate volume connection completed successfully. Aug 05 10:16:37 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [req-d6eae58b-98a0-4a2e-af9f-3fe998fa590f req-cc789562-5744-4da9-8e48-49ef647b6956 tempest-ServerActionsTestOtherA-221436279 None] Deleting attachment 53ec015e-177b-4fe1-8bf9-4283206b3f48. {{(pid=88613) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 10:16:37 devstack cinder-volume[88613]: INFO cinder.volume.manager [req-f1111d67-065e-41e4-8ad8-fae9f7647087 req-e6687dcb-65b7-4db9-9043-7bbdf6d60496 tempest-AttachVolumeTestJSON-1120766613 None] Terminate volume connection completed successfully. Aug 05 10:16:37 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [req-f1111d67-065e-41e4-8ad8-fae9f7647087 req-e6687dcb-65b7-4db9-9043-7bbdf6d60496 tempest-AttachVolumeTestJSON-1120766613 None] Deleting attachment 2a9d2687-c00d-4237-937d-ae1ee5a0536f. {{(pid=88613) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 10:16:38 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-bc1ed52f-06b3-4fba-9f8f-c4818ab48904 tempest-SnapshotsActionsTest-292245125 None] Acquiring lock "cinder-2c3de163-dbcc-4590-b19e-5bd38196626f-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:16:38 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-bc1ed52f-06b3-4fba-9f8f-c4818ab48904 tempest-SnapshotsActionsTest-292245125 None] Lock "cinder-2c3de163-dbcc-4590-b19e-5bd38196626f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:16:38 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-bc1ed52f-06b3-4fba-9f8f-c4818ab48904 tempest-SnapshotsActionsTest-292245125 None] Acquiring lock "cinder-quobyte-2c3de163-dbcc-4590-b19e-5bd38196626f" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:16:38 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-bc1ed52f-06b3-4fba-9f8f-c4818ab48904 tempest-SnapshotsActionsTest-292245125 None] Lock "cinder-quobyte-2c3de163-dbcc-4590-b19e-5bd38196626f" acquired by "delete_volume" :: waited 0.028s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:16:38 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[09509536-e068-4b87-8c9f-dcdc9d1b5876]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:16:38 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-bc1ed52f-06b3-4fba-9f8f-c4818ab48904 tempest-SnapshotsActionsTest-292245125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:16:38 devstack sudo[93215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f Aug 05 10:16:38 devstack sudo[93215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:16:38 devstack sudo[93215]: pam_unix(sudo:session): session closed for user root Aug 05 10:16:38 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-bc1ed52f-06b3-4fba-9f8f-c4818ab48904 tempest-SnapshotsActionsTest-292245125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f" returned: 0 in 0.699s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:16:38 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-bc1ed52f-06b3-4fba-9f8f-c4818ab48904 tempest-SnapshotsActionsTest-292245125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:16:39 devstack sudo[93226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f Aug 05 10:16:39 devstack sudo[93226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:16:39 devstack sudo[93226]: pam_unix(sudo:session): session closed for user root Aug 05 10:16:39 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-bc1ed52f-06b3-4fba-9f8f-c4818ab48904 tempest-SnapshotsActionsTest-292245125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2c3de163-dbcc-4590-b19e-5bd38196626f" returned: 0 in 0.569s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:16:39 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-bc1ed52f-06b3-4fba-9f8f-c4818ab48904 tempest-SnapshotsActionsTest-292245125 None] Lock "cinder-quobyte-2c3de163-dbcc-4590-b19e-5bd38196626f" released by "delete_volume" :: held 1.404s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:16:39 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-bc1ed52f-06b3-4fba-9f8f-c4818ab48904 tempest-SnapshotsActionsTest-292245125 None] Created reservations ['07c1db88-261b-44b5-8b10-43abbf518f65', 'd035be4e-7e52-475b-a919-30021ca1be32', '2aa74188-a98e-4770-9242-c95f869d79c8', '3a486a3f-e3c9-4a63-8fd9-51190e775c38'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:16:39 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-bc1ed52f-06b3-4fba-9f8f-c4818ab48904 tempest-SnapshotsActionsTest-292245125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:16:39 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-bc1ed52f-06b3-4fba-9f8f-c4818ab48904 tempest-SnapshotsActionsTest-292245125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:16:39 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-bc1ed52f-06b3-4fba-9f8f-c4818ab48904 tempest-SnapshotsActionsTest-292245125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:16:39 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-bc1ed52f-06b3-4fba-9f8f-c4818ab48904 tempest-SnapshotsActionsTest-292245125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:16:39 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-bc1ed52f-06b3-4fba-9f8f-c4818ab48904 tempest-SnapshotsActionsTest-292245125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:16:39 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-bc1ed52f-06b3-4fba-9f8f-c4818ab48904 tempest-SnapshotsActionsTest-292245125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:16:39 devstack sudo[93259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:16:39 devstack sudo[93259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:16:40 devstack sudo[93259]: pam_unix(sudo:session): session closed for user root Aug 05 10:16:40 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-bc1ed52f-06b3-4fba-9f8f-c4818ab48904 tempest-SnapshotsActionsTest-292245125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.283s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:16:40 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-bc1ed52f-06b3-4fba-9f8f-c4818ab48904 tempest-SnapshotsActionsTest-292245125 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:16:40 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-bc1ed52f-06b3-4fba-9f8f-c4818ab48904 tempest-SnapshotsActionsTest-292245125 None] Deleted volume successfully. Aug 05 10:16:40 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-bc1ed52f-06b3-4fba-9f8f-c4818ab48904 tempest-SnapshotsActionsTest-292245125 None] Lock "cinder-2c3de163-dbcc-4590-b19e-5bd38196626f-delete_volume" released by "delete_volume" :: held 2.036s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:16:47 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc0db37f-f472-4a7d-b0e5-6eddcd083cf5 tempest-ServerActionsTestOtherA-221436279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:16:47 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-bc0db37f-f472-4a7d-b0e5-6eddcd083cf5 tempest-ServerActionsTestOtherA-221436279 None] Flow 'volume_create_manager' (8c5b7095-ad10-422c-88a0-e2f5dc010dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:16:47 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-bc0db37f-f472-4a7d-b0e5-6eddcd083cf5 tempest-ServerActionsTestOtherA-221436279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f48cfb48-dd2d-4d8c-a338-58f0e3653de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:16:47 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-bc0db37f-f472-4a7d-b0e5-6eddcd083cf5 tempest-ServerActionsTestOtherA-221436279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f48cfb48-dd2d-4d8c-a338-58f0e3653de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1581781057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9825d6b-f9aa-4743-9e57-160fb8860b66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb2123cb3a264e81af054be93978d988',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:16:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:16:48Z,use_quota=True,user_id='7edfc3ff0f5e4ad68dfe369f13101f15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:16:47 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-bc0db37f-f472-4a7d-b0e5-6eddcd083cf5 tempest-ServerActionsTestOtherA-221436279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be90098c-864a-46f4-9dcd-a43c093b7df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:16:47 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-bc0db37f-f472-4a7d-b0e5-6eddcd083cf5 tempest-ServerActionsTestOtherA-221436279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be90098c-864a-46f4-9dcd-a43c093b7df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:16:47 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-bc0db37f-f472-4a7d-b0e5-6eddcd083cf5 tempest-ServerActionsTestOtherA-221436279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (221592d9-05ab-4797-9833-d499addde35e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:16:47 devstack cinder-volume[88613]: DEBUG cinder.image.glance [None req-bc0db37f-f472-4a7d-b0e5-6eddcd083cf5 tempest-ServerActionsTestOtherA-221436279 None] Creating Keystone auth plugin from conf {{(pid=88613) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 05 10:16:49 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-bc0db37f-f472-4a7d-b0e5-6eddcd083cf5 tempest-ServerActionsTestOtherA-221436279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (221592d9-05ab-4797-9833-d499addde35e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c9825d6b-f9aa-4743-9e57-160fb8860b66', 'volume_name': 'volume-c9825d6b-f9aa-4743-9e57-160fb8860b66', 'volume_size': 1, 'image_id': '89278436-b56f-45f7-8c42-c9afd7bd7453', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/89278436-b56f-45f7-8c42-c9afd7bd7453', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '654c7af809d145caaadc8738d3dc3df2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '89278436-b56f-45f7-8c42-c9afd7bd7453', 'created_at': datetime.datetime(2026, 8, 5, 8, 7, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 8, 7, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/89278436-b56f-45f7-8c42-c9afd7bd7453/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:16:49 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-bc0db37f-f472-4a7d-b0e5-6eddcd083cf5 tempest-ServerActionsTestOtherA-221436279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (660633b3-20ec-4a60-bfda-333dc96ef397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:16:49 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-bc0db37f-f472-4a7d-b0e5-6eddcd083cf5 tempest-ServerActionsTestOtherA-221436279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (660633b3-20ec-4a60-bfda-333dc96ef397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:16:49 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-bc0db37f-f472-4a7d-b0e5-6eddcd083cf5 tempest-ServerActionsTestOtherA-221436279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60731cf3-f072-4a8f-b0ae-f30d4f78af4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:16:49 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-bc0db37f-f472-4a7d-b0e5-6eddcd083cf5 tempest-ServerActionsTestOtherA-221436279 None] Volume c9825d6b-f9aa-4743-9e57-160fb8860b66: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c9825d6b-f9aa-4743-9e57-160fb8860b66', 'volume_size': 1, 'image_id': '89278436-b56f-45f7-8c42-c9afd7bd7453', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/89278436-b56f-45f7-8c42-c9afd7bd7453', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '654c7af809d145caaadc8738d3dc3df2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '89278436-b56f-45f7-8c42-c9afd7bd7453', 'created_at': datetime.datetime(2026, 8, 5, 8, 7, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 8, 7, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/89278436-b56f-45f7-8c42-c9afd7bd7453/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 05 10:16:49 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc0db37f-f472-4a7d-b0e5-6eddcd083cf5 tempest-ServerActionsTestOtherA-221436279 None] Trying to clone c9825d6b-f9aa-4743-9e57-160fb8860b66 from image 89278436-b56f-45f7-8c42-c9afd7bd7453 at location (None, [{'url': 'file:///opt/stack/data/glance/images/89278436-b56f-45f7-8c42-c9afd7bd7453', 'metadata': {}}]). {{(pid=88613) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 05 10:16:49 devstack cinder-volume[88613]: DEBUG cinder.image.image_utils [None req-bc0db37f-f472-4a7d-b0e5-6eddcd083cf5 tempest-ServerActionsTestOtherA-221436279 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_89278436-b56f-45f7-8c42-c9afd7bd7453_moc23ietdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88613) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 05 10:16:49 devstack cinder-volume[88613]: INFO cinder.image.image_utils [None req-bc0db37f-f472-4a7d-b0e5-6eddcd083cf5 tempest-ServerActionsTestOtherA-221436279 None] Image download 20.69 MB at 20.69 MB/s Aug 05 10:16:49 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f9d941b-0959-42f1-9f9f-a7d090c9ad61]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:16:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-bc0db37f-f472-4a7d-b0e5-6eddcd083cf5 tempest-ServerActionsTestOtherA-221436279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89278436-b56f-45f7-8c42-c9afd7bd7453_moc23ietdevstack@QuobyteHD {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:16:50 devstack sudo[93470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89278436-b56f-45f7-8c42-c9afd7bd7453_moc23ietdevstack@QuobyteHD Aug 05 10:16:50 devstack sudo[93470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:16:50 devstack sudo[93470]: pam_unix(sudo:session): session closed for user root Aug 05 10:16:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-bc0db37f-f472-4a7d-b0e5-6eddcd083cf5 tempest-ServerActionsTestOtherA-221436279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89278436-b56f-45f7-8c42-c9afd7bd7453_moc23ietdevstack@QuobyteHD" returned: 0 in 0.459s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:16:50 devstack cinder-volume[88613]: DEBUG cinder.image.image_utils [None req-bc0db37f-f472-4a7d-b0e5-6eddcd083cf5 tempest-ServerActionsTestOtherA-221436279 None] Temporary image 89278436-b56f-45f7-8c42-c9afd7bd7453 is fetched for user 7edfc3ff0f5e4ad68dfe369f13101f15. {{(pid=88613) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 05 10:16:50 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cf80326-c8cd-4cf1-9c92-f70f6de90516 tempest-VolumeRetypeWithoutMigrationTest-620250663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:16:50 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3cf80326-c8cd-4cf1-9c92-f70f6de90516 tempest-VolumeRetypeWithoutMigrationTest-620250663 None] Flow 'volume_create_manager' (c09faaeb-262e-4547-a327-398918d7acbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:16:50 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3cf80326-c8cd-4cf1-9c92-f70f6de90516 tempest-VolumeRetypeWithoutMigrationTest-620250663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8527ff66-5d7a-4b0a-a7d9-c769e4b78659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:16:50 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3cf80326-c8cd-4cf1-9c92-f70f6de90516 tempest-VolumeRetypeWithoutMigrationTest-620250663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8527ff66-5d7a-4b0a-a7d9-c769e4b78659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:16:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-935104950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12b5d56b-f3fb-474d-ae83-4ab26effc259,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='271f7f0358d74ac894e6bb538f7301fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:16:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:16:50Z,use_quota=True,user_id='f7f1c5866d4c42bf8f47f57b9cebb627',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9e1ae5e-ba85-4982-b173-b788db6019a0),volume_type_id=c9e1ae5e-ba85-4982-b173-b788db6019a0)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:16:50 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3cf80326-c8cd-4cf1-9c92-f70f6de90516 tempest-VolumeRetypeWithoutMigrationTest-620250663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b426963-86e3-4f5c-9167-2fe3700ce4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:16:50 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3cf80326-c8cd-4cf1-9c92-f70f6de90516 tempest-VolumeRetypeWithoutMigrationTest-620250663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b426963-86e3-4f5c-9167-2fe3700ce4c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:16:50 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3cf80326-c8cd-4cf1-9c92-f70f6de90516 tempest-VolumeRetypeWithoutMigrationTest-620250663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e0ddbaf-9880-4b25-ae8b-44bb6b99d5b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:16:50 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3cf80326-c8cd-4cf1-9c92-f70f6de90516 tempest-VolumeRetypeWithoutMigrationTest-620250663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e0ddbaf-9880-4b25-ae8b-44bb6b99d5b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12b5d56b-f3fb-474d-ae83-4ab26effc259', 'volume_name': 'volume-12b5d56b-f3fb-474d-ae83-4ab26effc259', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:16:50 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3cf80326-c8cd-4cf1-9c92-f70f6de90516 tempest-VolumeRetypeWithoutMigrationTest-620250663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26d6fed0-965f-4124-b037-7113b4902c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:16:50 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3cf80326-c8cd-4cf1-9c92-f70f6de90516 tempest-VolumeRetypeWithoutMigrationTest-620250663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26d6fed0-965f-4124-b037-7113b4902c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:16:50 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3cf80326-c8cd-4cf1-9c92-f70f6de90516 tempest-VolumeRetypeWithoutMigrationTest-620250663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e00c0517-c14d-4f28-b3b3-1c8668ba74cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:16:50 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-3cf80326-c8cd-4cf1-9c92-f70f6de90516 tempest-VolumeRetypeWithoutMigrationTest-620250663 None] Volume 12b5d56b-f3fb-474d-ae83-4ab26effc259: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12b5d56b-f3fb-474d-ae83-4ab26effc259', 'volume_size': 1} Aug 05 10:16:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-3cf80326-c8cd-4cf1-9c92-f70f6de90516 tempest-VolumeRetypeWithoutMigrationTest-620250663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:16:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-3cf80326-c8cd-4cf1-9c92-f70f6de90516 tempest-VolumeRetypeWithoutMigrationTest-620250663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:16:50 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-3cf80326-c8cd-4cf1-9c92-f70f6de90516 tempest-VolumeRetypeWithoutMigrationTest-620250663 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:16:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-935104950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12b5d56b-f3fb-474d-ae83-4ab26effc259,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='271f7f0358d74ac894e6bb538f7301fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:16:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:16:50Z,use_quota=True,user_id='f7f1c5866d4c42bf8f47f57b9cebb627',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9e1ae5e-ba85-4982-b173-b788db6019a0),volume_type_id=c9e1ae5e-ba85-4982-b173-b788db6019a0)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:16:50 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-3cf80326-c8cd-4cf1-9c92-f70f6de90516 tempest-VolumeRetypeWithoutMigrationTest-620250663 None] Creating volume 12b5d56b-f3fb-474d-ae83-4ab26effc259 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:16:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-3cf80326-c8cd-4cf1-9c92-f70f6de90516 tempest-VolumeRetypeWithoutMigrationTest-620250663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:16:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-3cf80326-c8cd-4cf1-9c92-f70f6de90516 tempest-VolumeRetypeWithoutMigrationTest-620250663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:16:50 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-3cf80326-c8cd-4cf1-9c92-f70f6de90516 tempest-VolumeRetypeWithoutMigrationTest-620250663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:16:50 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-3cf80326-c8cd-4cf1-9c92-f70f6de90516 tempest-VolumeRetypeWithoutMigrationTest-620250663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:16:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-3cf80326-c8cd-4cf1-9c92-f70f6de90516 tempest-VolumeRetypeWithoutMigrationTest-620250663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:16:50 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-3cf80326-c8cd-4cf1-9c92-f70f6de90516 tempest-VolumeRetypeWithoutMigrationTest-620250663 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:16:50 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-3cf80326-c8cd-4cf1-9c92-f70f6de90516 tempest-VolumeRetypeWithoutMigrationTest-620250663 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:16:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3cf80326-c8cd-4cf1-9c92-f70f6de90516 tempest-VolumeRetypeWithoutMigrationTest-620250663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-12b5d56b-f3fb-474d-ae83-4ab26effc259 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:16:50 devstack sudo[93476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-12b5d56b-f3fb-474d-ae83-4ab26effc259 1073741824 Aug 05 10:16:50 devstack sudo[93476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:16:50 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f6c213-0df6-447e-8715-ecb7c97fe410]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:16:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-bc0db37f-f472-4a7d-b0e5-6eddcd083cf5 tempest-ServerActionsTestOtherA-221436279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89278436-b56f-45f7-8c42-c9afd7bd7453_moc23ietdevstack@QuobyteHD {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:16:50 devstack sudo[93478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89278436-b56f-45f7-8c42-c9afd7bd7453_moc23ietdevstack@QuobyteHD Aug 05 10:16:50 devstack sudo[93478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:16:50 devstack sudo[93478]: pam_unix(sudo:session): session closed for user root Aug 05 10:16:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-bc0db37f-f472-4a7d-b0e5-6eddcd083cf5 tempest-ServerActionsTestOtherA-221436279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89278436-b56f-45f7-8c42-c9afd7bd7453_moc23ietdevstack@QuobyteHD" returned: 0 in 0.354s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:16:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-bc0db37f-f472-4a7d-b0e5-6eddcd083cf5 tempest-ServerActionsTestOtherA-221436279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:16:50 devstack sudo[93476]: pam_unix(sudo:session): session closed for user root Aug 05 10:16:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3cf80326-c8cd-4cf1-9c92-f70f6de90516 tempest-VolumeRetypeWithoutMigrationTest-620250663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-12b5d56b-f3fb-474d-ae83-4ab26effc259 1073741824" returned: 0 in 0.493s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:16:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3cf80326-c8cd-4cf1-9c92-f70f6de90516 tempest-VolumeRetypeWithoutMigrationTest-620250663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-12b5d56b-f3fb-474d-ae83-4ab26effc259 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:16:51 devstack sudo[93486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-12b5d56b-f3fb-474d-ae83-4ab26effc259 Aug 05 10:16:51 devstack sudo[93486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:16:51 devstack sudo[93486]: pam_unix(sudo:session): session closed for user root Aug 05 10:16:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3cf80326-c8cd-4cf1-9c92-f70f6de90516 tempest-VolumeRetypeWithoutMigrationTest-620250663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-12b5d56b-f3fb-474d-ae83-4ab26effc259" returned: 0 in 0.260s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:16:51 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-3cf80326-c8cd-4cf1-9c92-f70f6de90516 tempest-VolumeRetypeWithoutMigrationTest-620250663 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:16:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-3cf80326-c8cd-4cf1-9c92-f70f6de90516 tempest-VolumeRetypeWithoutMigrationTest-620250663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:16:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-bc0db37f-f472-4a7d-b0e5-6eddcd083cf5 tempest-ServerActionsTestOtherA-221436279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.399s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:16:51 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-bc0db37f-f472-4a7d-b0e5-6eddcd083cf5 tempest-ServerActionsTestOtherA-221436279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1581781057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9825d6b-f9aa-4743-9e57-160fb8860b66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb2123cb3a264e81af054be93978d988',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:16:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:16:48Z,use_quota=True,user_id='7edfc3ff0f5e4ad68dfe369f13101f15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:16:51 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-bc0db37f-f472-4a7d-b0e5-6eddcd083cf5 tempest-ServerActionsTestOtherA-221436279 None] Creating volume c9825d6b-f9aa-4743-9e57-160fb8860b66 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:16:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-bc0db37f-f472-4a7d-b0e5-6eddcd083cf5 tempest-ServerActionsTestOtherA-221436279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:16:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-bc0db37f-f472-4a7d-b0e5-6eddcd083cf5 tempest-ServerActionsTestOtherA-221436279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:16:51 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-bc0db37f-f472-4a7d-b0e5-6eddcd083cf5 tempest-ServerActionsTestOtherA-221436279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:16:51 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-bc0db37f-f472-4a7d-b0e5-6eddcd083cf5 tempest-ServerActionsTestOtherA-221436279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:16:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-bc0db37f-f472-4a7d-b0e5-6eddcd083cf5 tempest-ServerActionsTestOtherA-221436279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:16:51 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-bc0db37f-f472-4a7d-b0e5-6eddcd083cf5 tempest-ServerActionsTestOtherA-221436279 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:16:51 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-bc0db37f-f472-4a7d-b0e5-6eddcd083cf5 tempest-ServerActionsTestOtherA-221436279 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:16:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-bc0db37f-f472-4a7d-b0e5-6eddcd083cf5 tempest-ServerActionsTestOtherA-221436279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-c9825d6b-f9aa-4743-9e57-160fb8860b66 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:16:51 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3cf80326-c8cd-4cf1-9c92-f70f6de90516 tempest-VolumeRetypeWithoutMigrationTest-620250663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e00c0517-c14d-4f28-b3b3-1c8668ba74cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12b5d56b-f3fb-474d-ae83-4ab26effc259', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:16:51 devstack sudo[93489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-c9825d6b-f9aa-4743-9e57-160fb8860b66 1073741824 Aug 05 10:16:51 devstack sudo[93489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:16:51 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3cf80326-c8cd-4cf1-9c92-f70f6de90516 tempest-VolumeRetypeWithoutMigrationTest-620250663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e57876b-1391-4ed8-bab1-89fe70e523fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:16:51 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-3cf80326-c8cd-4cf1-9c92-f70f6de90516 tempest-VolumeRetypeWithoutMigrationTest-620250663 None] Volume volume-12b5d56b-f3fb-474d-ae83-4ab26effc259 (12b5d56b-f3fb-474d-ae83-4ab26effc259): created successfully Aug 05 10:16:51 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3cf80326-c8cd-4cf1-9c92-f70f6de90516 tempest-VolumeRetypeWithoutMigrationTest-620250663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e57876b-1391-4ed8-bab1-89fe70e523fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:16:51 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3cf80326-c8cd-4cf1-9c92-f70f6de90516 tempest-VolumeRetypeWithoutMigrationTest-620250663 None] Flow 'volume_create_manager' (c09faaeb-262e-4547-a327-398918d7acbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:16:51 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-3cf80326-c8cd-4cf1-9c92-f70f6de90516 tempest-VolumeRetypeWithoutMigrationTest-620250663 None] Created volume successfully. Aug 05 10:16:51 devstack sudo[93489]: pam_unix(sudo:session): session closed for user root Aug 05 10:16:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-bc0db37f-f472-4a7d-b0e5-6eddcd083cf5 tempest-ServerActionsTestOtherA-221436279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-c9825d6b-f9aa-4743-9e57-160fb8860b66 1073741824" returned: 0 in 0.443s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:16:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-bc0db37f-f472-4a7d-b0e5-6eddcd083cf5 tempest-ServerActionsTestOtherA-221436279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-c9825d6b-f9aa-4743-9e57-160fb8860b66 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:16:51 devstack sudo[93494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-c9825d6b-f9aa-4743-9e57-160fb8860b66 Aug 05 10:16:51 devstack sudo[93494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:16:52 devstack sudo[93494]: pam_unix(sudo:session): session closed for user root Aug 05 10:16:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-bc0db37f-f472-4a7d-b0e5-6eddcd083cf5 tempest-ServerActionsTestOtherA-221436279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-c9825d6b-f9aa-4743-9e57-160fb8860b66" returned: 0 in 0.315s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:16:52 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-bc0db37f-f472-4a7d-b0e5-6eddcd083cf5 tempest-ServerActionsTestOtherA-221436279 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:16:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-bc0db37f-f472-4a7d-b0e5-6eddcd083cf5 tempest-ServerActionsTestOtherA-221436279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:16:52 devstack cinder-volume[88613]: DEBUG cinder.volume.volume_utils [None req-bc0db37f-f472-4a7d-b0e5-6eddcd083cf5 tempest-ServerActionsTestOtherA-221436279 None] Attempting download of 89278436-b56f-45f7-8c42-c9afd7bd7453 ((None, [{'url': 'file:///opt/stack/data/glance/images/89278436-b56f-45f7-8c42-c9afd7bd7453', 'metadata': {}}])) to volume c9825d6b-f9aa-4743-9e57-160fb8860b66. {{(pid=88613) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 05 10:16:52 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f4642a4-157a-43cd-a285-20e9f577c1e2]: (4, 'raw') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:16:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-bc0db37f-f472-4a7d-b0e5-6eddcd083cf5 tempest-ServerActionsTestOtherA-221436279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_89278436-b56f-45f7-8c42-c9afd7bd7453_zrjo5knq {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:16:52 devstack sudo[93497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_89278436-b56f-45f7-8c42-c9afd7bd7453_zrjo5knq Aug 05 10:16:52 devstack sudo[93497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:16:52 devstack sudo[93497]: pam_unix(sudo:session): session closed for user root Aug 05 10:16:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-bc0db37f-f472-4a7d-b0e5-6eddcd083cf5 tempest-ServerActionsTestOtherA-221436279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_89278436-b56f-45f7-8c42-c9afd7bd7453_zrjo5knq" returned: 0 in 0.349s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:16:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-bc0db37f-f472-4a7d-b0e5-6eddcd083cf5 tempest-ServerActionsTestOtherA-221436279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_89278436-b56f-45f7-8c42-c9afd7bd7453_zrjo5knq {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:16:52 devstack sudo[93501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_89278436-b56f-45f7-8c42-c9afd7bd7453_zrjo5knq Aug 05 10:16:52 devstack sudo[93501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:16:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-abcede39-f0e1-4320-aff3-14820ebb02d1 tempest-VolumeRetypeWithoutMigrationTest-620250663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:16:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-abcede39-f0e1-4320-aff3-14820ebb02d1 tempest-VolumeRetypeWithoutMigrationTest-620250663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:16:52 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-abcede39-f0e1-4320-aff3-14820ebb02d1 tempest-VolumeRetypeWithoutMigrationTest-620250663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:16:52 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-abcede39-f0e1-4320-aff3-14820ebb02d1 tempest-VolumeRetypeWithoutMigrationTest-620250663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:16:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-abcede39-f0e1-4320-aff3-14820ebb02d1 tempest-VolumeRetypeWithoutMigrationTest-620250663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:16:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-abcede39-f0e1-4320-aff3-14820ebb02d1 tempest-VolumeRetypeWithoutMigrationTest-620250663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:16:52 devstack sudo[93503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:16:52 devstack sudo[93503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:16:52 devstack sudo[93501]: pam_unix(sudo:session): session closed for user root Aug 05 10:16:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-bc0db37f-f472-4a7d-b0e5-6eddcd083cf5 tempest-ServerActionsTestOtherA-221436279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_89278436-b56f-45f7-8c42-c9afd7bd7453_zrjo5knq" returned: 1 in 0.392s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:16:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-bc0db37f-f472-4a7d-b0e5-6eddcd083cf5 tempest-ServerActionsTestOtherA-221436279 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_89278436-b56f-45f7-8c42-c9afd7bd7453_zrjo5knq' failed. Not Retrying. {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 10:16:52 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0cae246-b2de-4389-9caa-225c759d46cb]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:16:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-bc0db37f-f472-4a7d-b0e5-6eddcd083cf5 tempest-ServerActionsTestOtherA-221436279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89278436-b56f-45f7-8c42-c9afd7bd7453_moc23ietdevstack@QuobyteHD {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:16:53 devstack sudo[93507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89278436-b56f-45f7-8c42-c9afd7bd7453_moc23ietdevstack@QuobyteHD Aug 05 10:16:53 devstack sudo[93507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:16:53 devstack sudo[93503]: pam_unix(sudo:session): session closed for user root Aug 05 10:16:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-abcede39-f0e1-4320-aff3-14820ebb02d1 tempest-VolumeRetypeWithoutMigrationTest-620250663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.289s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:16:53 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-abcede39-f0e1-4320-aff3-14820ebb02d1 tempest-VolumeRetypeWithoutMigrationTest-620250663 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:16:53 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-abcede39-f0e1-4320-aff3-14820ebb02d1 tempest-VolumeRetypeWithoutMigrationTest-620250663 None] Retype volume completed successfully. Aug 05 10:16:53 devstack sudo[93507]: pam_unix(sudo:session): session closed for user root Aug 05 10:16:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-bc0db37f-f472-4a7d-b0e5-6eddcd083cf5 tempest-ServerActionsTestOtherA-221436279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89278436-b56f-45f7-8c42-c9afd7bd7453_moc23ietdevstack@QuobyteHD" returned: 0 in 0.371s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:16:53 devstack cinder-volume[88613]: DEBUG cinder.image.image_utils [None req-bc0db37f-f472-4a7d-b0e5-6eddcd083cf5 tempest-ServerActionsTestOtherA-221436279 None] 89278436-b56f-45f7-8c42-c9afd7bd7453 was qcow2, converting to qcow2 {{(pid=88613) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 05 10:16:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-bc0db37f-f472-4a7d-b0e5-6eddcd083cf5 tempest-ServerActionsTestOtherA-221436279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_89278436-b56f-45f7-8c42-c9afd7bd7453_moc23ietdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-c9825d6b-f9aa-4743-9e57-160fb8860b66 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:16:53 devstack sudo[93513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_89278436-b56f-45f7-8c42-c9afd7bd7453_moc23ietdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-c9825d6b-f9aa-4743-9e57-160fb8860b66 Aug 05 10:16:53 devstack sudo[93513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:16:54 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-059aca61-b381-4c9a-939f-33be7c86e200 tempest-VolumeRetypeWithoutMigrationTest-620250663 None] Acquiring lock "cinder-12b5d56b-f3fb-474d-ae83-4ab26effc259-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:16:54 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-059aca61-b381-4c9a-939f-33be7c86e200 tempest-VolumeRetypeWithoutMigrationTest-620250663 None] Lock "cinder-12b5d56b-f3fb-474d-ae83-4ab26effc259-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:16:54 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-059aca61-b381-4c9a-939f-33be7c86e200 tempest-VolumeRetypeWithoutMigrationTest-620250663 None] Acquiring lock "cinder-quobyte-12b5d56b-f3fb-474d-ae83-4ab26effc259" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:16:54 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-059aca61-b381-4c9a-939f-33be7c86e200 tempest-VolumeRetypeWithoutMigrationTest-620250663 None] Lock "cinder-quobyte-12b5d56b-f3fb-474d-ae83-4ab26effc259" acquired by "delete_volume" :: waited 0.024s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:16:54 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[5236a359-09bc-4987-895b-429d543bbc9d]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:16:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-059aca61-b381-4c9a-939f-33be7c86e200 tempest-VolumeRetypeWithoutMigrationTest-620250663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-12b5d56b-f3fb-474d-ae83-4ab26effc259 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:16:54 devstack sudo[93522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-12b5d56b-f3fb-474d-ae83-4ab26effc259 Aug 05 10:16:54 devstack sudo[93522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:16:54 devstack sudo[93522]: pam_unix(sudo:session): session closed for user root Aug 05 10:16:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-059aca61-b381-4c9a-939f-33be7c86e200 tempest-VolumeRetypeWithoutMigrationTest-620250663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-12b5d56b-f3fb-474d-ae83-4ab26effc259" returned: 0 in 0.431s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:16:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-059aca61-b381-4c9a-939f-33be7c86e200 tempest-VolumeRetypeWithoutMigrationTest-620250663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-12b5d56b-f3fb-474d-ae83-4ab26effc259 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:16:54 devstack sudo[93528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-12b5d56b-f3fb-474d-ae83-4ab26effc259 Aug 05 10:16:54 devstack sudo[93528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:16:55 devstack sudo[93528]: pam_unix(sudo:session): session closed for user root Aug 05 10:16:55 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-059aca61-b381-4c9a-939f-33be7c86e200 tempest-VolumeRetypeWithoutMigrationTest-620250663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-12b5d56b-f3fb-474d-ae83-4ab26effc259" returned: 0 in 0.412s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:16:55 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-059aca61-b381-4c9a-939f-33be7c86e200 tempest-VolumeRetypeWithoutMigrationTest-620250663 None] Lock "cinder-quobyte-12b5d56b-f3fb-474d-ae83-4ab26effc259" released by "delete_volume" :: held 0.905s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:16:55 devstack cinder-volume[88613]: WARNING cinder.quota [None req-059aca61-b381-4c9a-939f-33be7c86e200 tempest-VolumeRetypeWithoutMigrationTest-620250663 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Aug 05 10:16:55 devstack cinder-volume[88613]: WARNING cinder.quota [None req-059aca61-b381-4c9a-939f-33be7c86e200 tempest-VolumeRetypeWithoutMigrationTest-620250663 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Aug 05 10:16:55 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-059aca61-b381-4c9a-939f-33be7c86e200 tempest-VolumeRetypeWithoutMigrationTest-620250663 None] Created reservations ['d1657871-dbf7-4546-811d-59fc4d4692f2', '4564c333-2bf7-46ce-b18c-e8092e34a2c9', 'ce7e9b66-ca2f-4b24-81f7-0ab3643cfd40', 'bd89aa31-35d4-44a0-b2bc-f51dfd1379b4'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:16:55 devstack sudo[93513]: pam_unix(sudo:session): session closed for user root Aug 05 10:16:55 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-bc0db37f-f472-4a7d-b0e5-6eddcd083cf5 tempest-ServerActionsTestOtherA-221436279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_89278436-b56f-45f7-8c42-c9afd7bd7453_moc23ietdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-c9825d6b-f9aa-4743-9e57-160fb8860b66" returned: 0 in 2.045s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:16:55 devstack cinder-volume[88613]: DEBUG cinder.image.image_utils [None req-bc0db37f-f472-4a7d-b0e5-6eddcd083cf5 tempest-ServerActionsTestOtherA-221436279 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_89278436-b56f-45f7-8c42-c9afd7bd7453_moc23ietdevstack@QuobyteHD, size 112.00 MB, duration 2.05 sec, destination /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-c9825d6b-f9aa-4743-9e57-160fb8860b66 {{(pid=88613) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 10:16:55 devstack cinder-volume[88613]: INFO cinder.image.image_utils [None req-bc0db37f-f472-4a7d-b0e5-6eddcd083cf5 tempest-ServerActionsTestOtherA-221436279 None] Converted 112.00 MB image at 54.72 MB/s Aug 05 10:16:55 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-bc0db37f-f472-4a7d-b0e5-6eddcd083cf5 tempest-ServerActionsTestOtherA-221436279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-c9825d6b-f9aa-4743-9e57-160fb8860b66 1G {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:16:55 devstack sudo[93531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-c9825d6b-f9aa-4743-9e57-160fb8860b66 1G Aug 05 10:16:55 devstack sudo[93531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:16:55 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-059aca61-b381-4c9a-939f-33be7c86e200 tempest-VolumeRetypeWithoutMigrationTest-620250663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:16:55 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-059aca61-b381-4c9a-939f-33be7c86e200 tempest-VolumeRetypeWithoutMigrationTest-620250663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:16:55 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-059aca61-b381-4c9a-939f-33be7c86e200 tempest-VolumeRetypeWithoutMigrationTest-620250663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:16:55 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-059aca61-b381-4c9a-939f-33be7c86e200 tempest-VolumeRetypeWithoutMigrationTest-620250663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:16:55 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-059aca61-b381-4c9a-939f-33be7c86e200 tempest-VolumeRetypeWithoutMigrationTest-620250663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:16:55 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-059aca61-b381-4c9a-939f-33be7c86e200 tempest-VolumeRetypeWithoutMigrationTest-620250663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:16:55 devstack sudo[93533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:16:55 devstack sudo[93533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:16:55 devstack sudo[93531]: pam_unix(sudo:session): session closed for user root Aug 05 10:16:55 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-bc0db37f-f472-4a7d-b0e5-6eddcd083cf5 tempest-ServerActionsTestOtherA-221436279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-c9825d6b-f9aa-4743-9e57-160fb8860b66 1G" returned: 0 in 0.478s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:16:55 devstack cinder-volume[88613]: DEBUG cinder.volume.volume_utils [None req-bc0db37f-f472-4a7d-b0e5-6eddcd083cf5 tempest-ServerActionsTestOtherA-221436279 None] Downloaded image 89278436-b56f-45f7-8c42-c9afd7bd7453 ((None, [{'url': 'file:///opt/stack/data/glance/images/89278436-b56f-45f7-8c42-c9afd7bd7453', 'metadata': {}}])) to volume c9825d6b-f9aa-4743-9e57-160fb8860b66 successfully. {{(pid=88613) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 05 10:16:55 devstack cinder-volume[88613]: DEBUG cinder.image.image_utils [None req-bc0db37f-f472-4a7d-b0e5-6eddcd083cf5 tempest-ServerActionsTestOtherA-221436279 None] Temporary image 89278436-b56f-45f7-8c42-c9afd7bd7453 for user 7edfc3ff0f5e4ad68dfe369f13101f15 is deleted. {{(pid=88613) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 05 10:16:55 devstack cinder-volume[88613]: DEBUG cinder.volume.volume_utils [None req-bc0db37f-f472-4a7d-b0e5-6eddcd083cf5 tempest-ServerActionsTestOtherA-221436279 None] Marking volume c9825d6b-f9aa-4743-9e57-160fb8860b66 as bootable. {{(pid=88613) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 05 10:16:55 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc0db37f-f472-4a7d-b0e5-6eddcd083cf5 tempest-ServerActionsTestOtherA-221436279 None] Copying metadata from image 89278436-b56f-45f7-8c42-c9afd7bd7453 to c9825d6b-f9aa-4743-9e57-160fb8860b66. {{(pid=88613) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 05 10:16:55 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc0db37f-f472-4a7d-b0e5-6eddcd083cf5 tempest-ServerActionsTestOtherA-221436279 None] Creating volume glance metadata for volume c9825d6b-f9aa-4743-9e57-160fb8860b66 backed by image 89278436-b56f-45f7-8c42-c9afd7bd7453 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '89278436-b56f-45f7-8c42-c9afd7bd7453', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88613) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 05 10:16:55 devstack sudo[93533]: pam_unix(sudo:session): session closed for user root Aug 05 10:16:55 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-059aca61-b381-4c9a-939f-33be7c86e200 tempest-VolumeRetypeWithoutMigrationTest-620250663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.433s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:16:55 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-059aca61-b381-4c9a-939f-33be7c86e200 tempest-VolumeRetypeWithoutMigrationTest-620250663 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:16:55 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-059aca61-b381-4c9a-939f-33be7c86e200 tempest-VolumeRetypeWithoutMigrationTest-620250663 None] Deleted volume successfully. Aug 05 10:16:55 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-059aca61-b381-4c9a-939f-33be7c86e200 tempest-VolumeRetypeWithoutMigrationTest-620250663 None] Lock "cinder-12b5d56b-f3fb-474d-ae83-4ab26effc259-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:16:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-bc0db37f-f472-4a7d-b0e5-6eddcd083cf5 tempest-ServerActionsTestOtherA-221436279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60731cf3-f072-4a8f-b0ae-f30d4f78af4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9825d6b-f9aa-4743-9e57-160fb8860b66', 'volume_size': 1, 'image_id': '89278436-b56f-45f7-8c42-c9afd7bd7453', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/89278436-b56f-45f7-8c42-c9afd7bd7453', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '654c7af809d145caaadc8738d3dc3df2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '89278436-b56f-45f7-8c42-c9afd7bd7453', 'created_at': datetime.datetime(2026, 8, 5, 8, 7, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 8, 7, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/89278436-b56f-45f7-8c42-c9afd7bd7453/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:16:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-bc0db37f-f472-4a7d-b0e5-6eddcd083cf5 tempest-ServerActionsTestOtherA-221436279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c49b6e60-0a9c-4716-bd77-4fe251f7b6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:16:56 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-bc0db37f-f472-4a7d-b0e5-6eddcd083cf5 tempest-ServerActionsTestOtherA-221436279 None] Volume volume-c9825d6b-f9aa-4743-9e57-160fb8860b66 (c9825d6b-f9aa-4743-9e57-160fb8860b66): created successfully Aug 05 10:16:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-bc0db37f-f472-4a7d-b0e5-6eddcd083cf5 tempest-ServerActionsTestOtherA-221436279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c49b6e60-0a9c-4716-bd77-4fe251f7b6f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:16:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-bc0db37f-f472-4a7d-b0e5-6eddcd083cf5 tempest-ServerActionsTestOtherA-221436279 None] Flow 'volume_create_manager' (8c5b7095-ad10-422c-88a0-e2f5dc010dfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:16:56 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-bc0db37f-f472-4a7d-b0e5-6eddcd083cf5 tempest-ServerActionsTestOtherA-221436279 None] Created volume successfully. Aug 05 10:17:00 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-36b7a239-f2d1-450b-a0c4-a80f725704a8 req-eb7a9b18-70dd-41ee-b6a5-89c228dcf4aa tempest-ServerActionsTestOtherA-221436279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:17:00 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-36b7a239-f2d1-450b-a0c4-a80f725704a8 req-eb7a9b18-70dd-41ee-b6a5-89c228dcf4aa tempest-ServerActionsTestOtherA-221436279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:17:00 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-36b7a239-f2d1-450b-a0c4-a80f725704a8 req-eb7a9b18-70dd-41ee-b6a5-89c228dcf4aa tempest-ServerActionsTestOtherA-221436279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:17:00 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [req-36b7a239-f2d1-450b-a0c4-a80f725704a8 req-eb7a9b18-70dd-41ee-b6a5-89c228dcf4aa tempest-ServerActionsTestOtherA-221436279 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1', 'name': 'volume-c9825d6b-f9aa-4743-9e57-160fb8860b66', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '12ad79a1-84d4-4690-944f-336f0221622d', 'enforce_multipath': True} {{(pid=88613) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 10:17:01 devstack cinder-volume[88613]: INFO cinder.volume.manager [req-36b7a239-f2d1-450b-a0c4-a80f725704a8 req-eb7a9b18-70dd-41ee-b6a5-89c228dcf4aa tempest-ServerActionsTestOtherA-221436279 None] attachment_update completed successfully. Aug 05 10:17:04 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f6eed0e-0aac-4b5a-b1ab-bc235aef5061 tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:17:04 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-6f6eed0e-0aac-4b5a-b1ab-bc235aef5061 tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] Flow 'volume_create_manager' (1304860a-4659-4cbe-8de5-2df7755eef42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:17:04 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-6f6eed0e-0aac-4b5a-b1ab-bc235aef5061 tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1e6cc0b-76ae-44b5-8e24-1c273ea24cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:17:04 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-6f6eed0e-0aac-4b5a-b1ab-bc235aef5061 tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1e6cc0b-76ae-44b5-8e24-1c273ea24cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:17:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1870611498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5b58a2d-52f4-417e-860b-ff8cf01fc503,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='429531e36937403ea3c05d21976ee8a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:17:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:17:04Z,use_quota=True,user_id='8a0cebe4904046ba83712c7e7c1b0cb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:17:04 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-6f6eed0e-0aac-4b5a-b1ab-bc235aef5061 tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f2d6466-a160-40af-a218-9fc3b0fc778d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:17:04 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-6f6eed0e-0aac-4b5a-b1ab-bc235aef5061 tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f2d6466-a160-40af-a218-9fc3b0fc778d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:17:04 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-6f6eed0e-0aac-4b5a-b1ab-bc235aef5061 tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17a312c6-1b63-4cf0-a8f6-8f7d967e087e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:17:04 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-6f6eed0e-0aac-4b5a-b1ab-bc235aef5061 tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17a312c6-1b63-4cf0-a8f6-8f7d967e087e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5b58a2d-52f4-417e-860b-ff8cf01fc503', 'volume_name': 'volume-e5b58a2d-52f4-417e-860b-ff8cf01fc503', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:17:04 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-6f6eed0e-0aac-4b5a-b1ab-bc235aef5061 tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d6559d3-ac43-4962-a820-1da337db47d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:17:04 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-6f6eed0e-0aac-4b5a-b1ab-bc235aef5061 tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d6559d3-ac43-4962-a820-1da337db47d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:17:04 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-6f6eed0e-0aac-4b5a-b1ab-bc235aef5061 tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20a59004-0386-4d84-b3be-ba1c228eead6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:17:04 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-6f6eed0e-0aac-4b5a-b1ab-bc235aef5061 tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] Volume e5b58a2d-52f4-417e-860b-ff8cf01fc503: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5b58a2d-52f4-417e-860b-ff8cf01fc503', 'volume_size': 1} Aug 05 10:17:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-6f6eed0e-0aac-4b5a-b1ab-bc235aef5061 tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:17:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-6f6eed0e-0aac-4b5a-b1ab-bc235aef5061 tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:17:04 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-6f6eed0e-0aac-4b5a-b1ab-bc235aef5061 tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:17:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1870611498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5b58a2d-52f4-417e-860b-ff8cf01fc503,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='429531e36937403ea3c05d21976ee8a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:17:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:17:04Z,use_quota=True,user_id='8a0cebe4904046ba83712c7e7c1b0cb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:17:04 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-6f6eed0e-0aac-4b5a-b1ab-bc235aef5061 tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] Creating volume e5b58a2d-52f4-417e-860b-ff8cf01fc503 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:17:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-6f6eed0e-0aac-4b5a-b1ab-bc235aef5061 tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:17:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-6f6eed0e-0aac-4b5a-b1ab-bc235aef5061 tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:17:04 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-6f6eed0e-0aac-4b5a-b1ab-bc235aef5061 tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:17:04 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-6f6eed0e-0aac-4b5a-b1ab-bc235aef5061 tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:17:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-6f6eed0e-0aac-4b5a-b1ab-bc235aef5061 tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:17:04 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-6f6eed0e-0aac-4b5a-b1ab-bc235aef5061 tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:17:04 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-6f6eed0e-0aac-4b5a-b1ab-bc235aef5061 tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:17:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6f6eed0e-0aac-4b5a-b1ab-bc235aef5061 tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5b58a2d-52f4-417e-860b-ff8cf01fc503 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:17:04 devstack sudo[93628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5b58a2d-52f4-417e-860b-ff8cf01fc503 1073741824 Aug 05 10:17:04 devstack sudo[93628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:17:05 devstack sudo[93628]: pam_unix(sudo:session): session closed for user root Aug 05 10:17:05 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6f6eed0e-0aac-4b5a-b1ab-bc235aef5061 tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5b58a2d-52f4-417e-860b-ff8cf01fc503 1073741824" returned: 0 in 0.503s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:17:05 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6f6eed0e-0aac-4b5a-b1ab-bc235aef5061 tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5b58a2d-52f4-417e-860b-ff8cf01fc503 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:17:05 devstack sudo[93644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5b58a2d-52f4-417e-860b-ff8cf01fc503 Aug 05 10:17:05 devstack sudo[93644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:17:05 devstack sudo[93644]: pam_unix(sudo:session): session closed for user root Aug 05 10:17:05 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6f6eed0e-0aac-4b5a-b1ab-bc235aef5061 tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5b58a2d-52f4-417e-860b-ff8cf01fc503" returned: 0 in 0.261s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:17:05 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-6f6eed0e-0aac-4b5a-b1ab-bc235aef5061 tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:17:05 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-6f6eed0e-0aac-4b5a-b1ab-bc235aef5061 tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:17:05 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-6f6eed0e-0aac-4b5a-b1ab-bc235aef5061 tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20a59004-0386-4d84-b3be-ba1c228eead6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5b58a2d-52f4-417e-860b-ff8cf01fc503', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:17:05 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-6f6eed0e-0aac-4b5a-b1ab-bc235aef5061 tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db3d6786-daf4-4ad6-98fa-b1af2a86e6cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:17:05 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-6f6eed0e-0aac-4b5a-b1ab-bc235aef5061 tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] Volume volume-e5b58a2d-52f4-417e-860b-ff8cf01fc503 (e5b58a2d-52f4-417e-860b-ff8cf01fc503): created successfully Aug 05 10:17:05 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-6f6eed0e-0aac-4b5a-b1ab-bc235aef5061 tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db3d6786-daf4-4ad6-98fa-b1af2a86e6cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:17:05 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-6f6eed0e-0aac-4b5a-b1ab-bc235aef5061 tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] Flow 'volume_create_manager' (1304860a-4659-4cbe-8de5-2df7755eef42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:17:05 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-6f6eed0e-0aac-4b5a-b1ab-bc235aef5061 tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] Created volume successfully. Aug 05 10:17:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c5692d5b-7cba-41d7-846d-f8fcc884059d tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:17:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c5692d5b-7cba-41d7-846d-f8fcc884059d tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:17:06 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-c5692d5b-7cba-41d7-846d-f8fcc884059d tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] Creating offline snapshot 990d9554-03c9-4b71-a7b1-5717da84874f of volume e5b58a2d-52f4-417e-860b-ff8cf01fc503 {{(pid=88613) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:17:06 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb23e91-7222-4db3-bfd4-35effeabbc38]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:17:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c5692d5b-7cba-41d7-846d-f8fcc884059d tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5b58a2d-52f4-417e-860b-ff8cf01fc503 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:17:06 devstack sudo[93669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5b58a2d-52f4-417e-860b-ff8cf01fc503 Aug 05 10:17:06 devstack sudo[93669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:17:07 devstack sudo[93669]: pam_unix(sudo:session): session closed for user root Aug 05 10:17:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c5692d5b-7cba-41d7-846d-f8fcc884059d tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5b58a2d-52f4-417e-860b-ff8cf01fc503" returned: 0 in 0.538s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:17:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c5692d5b-7cba-41d7-846d-f8fcc884059d tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5b58a2d-52f4-417e-860b-ff8cf01fc503,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5b58a2d-52f4-417e-860b-ff8cf01fc503.990d9554-03c9-4b71-a7b1-5717da84874f 1G {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:17:07 devstack sudo[93682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5b58a2d-52f4-417e-860b-ff8cf01fc503,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5b58a2d-52f4-417e-860b-ff8cf01fc503.990d9554-03c9-4b71-a7b1-5717da84874f 1G Aug 05 10:17:07 devstack sudo[93682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:17:07 devstack cinder-volume[88613]: INFO cinder.volume.manager [req-7533ff35-f8ef-480d-aeaf-07c7efb2d09f req-023d80f4-b884-4c55-a2d7-83a0d86a0722 tempest-AttachVolumeNegativeTest-1387927917 None] Terminate volume connection completed successfully. Aug 05 10:17:07 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [req-7533ff35-f8ef-480d-aeaf-07c7efb2d09f req-023d80f4-b884-4c55-a2d7-83a0d86a0722 tempest-AttachVolumeNegativeTest-1387927917 None] Deleting attachment 7ec7cd27-0c22-40e0-88db-f0d7405ce595. {{(pid=88613) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 10:17:07 devstack sudo[93682]: pam_unix(sudo:session): session closed for user root Aug 05 10:17:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c5692d5b-7cba-41d7-846d-f8fcc884059d tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5b58a2d-52f4-417e-860b-ff8cf01fc503,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5b58a2d-52f4-417e-860b-ff8cf01fc503.990d9554-03c9-4b71-a7b1-5717da84874f 1G" returned: 0 in 0.612s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:17:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c5692d5b-7cba-41d7-846d-f8fcc884059d tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5b58a2d-52f4-417e-860b-ff8cf01fc503 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5b58a2d-52f4-417e-860b-ff8cf01fc503.990d9554-03c9-4b71-a7b1-5717da84874f {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:17:07 devstack sudo[93692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5b58a2d-52f4-417e-860b-ff8cf01fc503 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5b58a2d-52f4-417e-860b-ff8cf01fc503.990d9554-03c9-4b71-a7b1-5717da84874f Aug 05 10:17:07 devstack sudo[93692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:17:08 devstack sudo[93692]: pam_unix(sudo:session): session closed for user root Aug 05 10:17:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c5692d5b-7cba-41d7-846d-f8fcc884059d tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5b58a2d-52f4-417e-860b-ff8cf01fc503 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5b58a2d-52f4-417e-860b-ff8cf01fc503.990d9554-03c9-4b71-a7b1-5717da84874f" returned: 0 in 0.434s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:17:08 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-c5692d5b-7cba-41d7-846d-f8fcc884059d tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5b58a2d-52f4-417e-860b-ff8cf01fc503.990d9554-03c9-4b71-a7b1-5717da84874f is being set with open permissions: ugo+rw Aug 05 10:17:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c5692d5b-7cba-41d7-846d-f8fcc884059d tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5b58a2d-52f4-417e-860b-ff8cf01fc503.990d9554-03c9-4b71-a7b1-5717da84874f {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:17:08 devstack sudo[93697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5b58a2d-52f4-417e-860b-ff8cf01fc503.990d9554-03c9-4b71-a7b1-5717da84874f Aug 05 10:17:08 devstack sudo[93697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:17:08 devstack sudo[93697]: pam_unix(sudo:session): session closed for user root Aug 05 10:17:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c5692d5b-7cba-41d7-846d-f8fcc884059d tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5b58a2d-52f4-417e-860b-ff8cf01fc503.990d9554-03c9-4b71-a7b1-5717da84874f" returned: 0 in 0.524s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:17:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c5692d5b-7cba-41d7-846d-f8fcc884059d tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5b58a2d-52f4-417e-860b-ff8cf01fc503.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:17:08 devstack sudo[93703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5b58a2d-52f4-417e-860b-ff8cf01fc503.info Aug 05 10:17:08 devstack sudo[93703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:17:09 devstack sudo[93703]: pam_unix(sudo:session): session closed for user root Aug 05 10:17:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c5692d5b-7cba-41d7-846d-f8fcc884059d tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5b58a2d-52f4-417e-860b-ff8cf01fc503.info" returned: 0 in 0.677s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:17:09 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-c5692d5b-7cba-41d7-846d-f8fcc884059d tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5b58a2d-52f4-417e-860b-ff8cf01fc503.info is being set with open permissions: ugo+rw Aug 05 10:17:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c5692d5b-7cba-41d7-846d-f8fcc884059d tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5b58a2d-52f4-417e-860b-ff8cf01fc503.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:17:09 devstack sudo[93726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5b58a2d-52f4-417e-860b-ff8cf01fc503.info Aug 05 10:17:09 devstack sudo[93726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:17:09 devstack sudo[93726]: pam_unix(sudo:session): session closed for user root Aug 05 10:17:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c5692d5b-7cba-41d7-846d-f8fcc884059d tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5b58a2d-52f4-417e-860b-ff8cf01fc503.info" returned: 0 in 0.388s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:17:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c5692d5b-7cba-41d7-846d-f8fcc884059d tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.369s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:17:10 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-c5692d5b-7cba-41d7-846d-f8fcc884059d tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] Create snapshot completed successfully Aug 05 10:17:12 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-f515c5b2-f98b-447d-9d43-dd2f6ca82761 tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] Acquiring lock "cinder-990d9554-03c9-4b71-a7b1-5717da84874f-delete_snapshot" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:17:12 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-f515c5b2-f98b-447d-9d43-dd2f6ca82761 tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] Lock "cinder-990d9554-03c9-4b71-a7b1-5717da84874f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:17:12 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-f515c5b2-f98b-447d-9d43-dd2f6ca82761 tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] Acquiring lock "cinder-quobyte-e5b58a2d-52f4-417e-860b-ff8cf01fc503" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:17:12 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-f515c5b2-f98b-447d-9d43-dd2f6ca82761 tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] Lock "cinder-quobyte-e5b58a2d-52f4-417e-860b-ff8cf01fc503" acquired by "delete_snapshot" :: waited 0.042s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:17:12 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-f515c5b2-f98b-447d-9d43-dd2f6ca82761 tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] Acquiring lock "cinder-quobyte-990d9554-03c9-4b71-a7b1-5717da84874f" by "_delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:17:12 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-f515c5b2-f98b-447d-9d43-dd2f6ca82761 tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] Lock "cinder-quobyte-990d9554-03c9-4b71-a7b1-5717da84874f" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:17:12 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-f515c5b2-f98b-447d-9d43-dd2f6ca82761 tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] Deleting offline snapshot 990d9554-03c9-4b71-a7b1-5717da84874f of volume e5b58a2d-52f4-417e-860b-ff8cf01fc503 {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:17:12 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-f515c5b2-f98b-447d-9d43-dd2f6ca82761 tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] snapshot_file for this snap is: volume-e5b58a2d-52f4-417e-860b-ff8cf01fc503.990d9554-03c9-4b71-a7b1-5717da84874f {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:17:12 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c91836f-efc7-4ef3-aaf1-6b8d34b69321]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:17:12 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f515c5b2-f98b-447d-9d43-dd2f6ca82761 tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5b58a2d-52f4-417e-860b-ff8cf01fc503.990d9554-03c9-4b71-a7b1-5717da84874f {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:17:12 devstack sudo[93748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5b58a2d-52f4-417e-860b-ff8cf01fc503.990d9554-03c9-4b71-a7b1-5717da84874f Aug 05 10:17:12 devstack sudo[93748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:17:13 devstack sudo[93748]: pam_unix(sudo:session): session closed for user root Aug 05 10:17:13 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f515c5b2-f98b-447d-9d43-dd2f6ca82761 tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5b58a2d-52f4-417e-860b-ff8cf01fc503.990d9554-03c9-4b71-a7b1-5717da84874f" returned: 0 in 0.729s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:17:13 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-f515c5b2-f98b-447d-9d43-dd2f6ca82761 tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5b58a2d-52f4-417e-860b-ff8cf01fc503(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88613) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:17:13 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[7615e67c-f178-43e1-85ed-4be18cee9a70]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:17:13 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f515c5b2-f98b-447d-9d43-dd2f6ca82761 tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5b58a2d-52f4-417e-860b-ff8cf01fc503 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:17:13 devstack sudo[93770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5b58a2d-52f4-417e-860b-ff8cf01fc503 Aug 05 10:17:13 devstack sudo[93770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:17:13 devstack sudo[93770]: pam_unix(sudo:session): session closed for user root Aug 05 10:17:13 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f515c5b2-f98b-447d-9d43-dd2f6ca82761 tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5b58a2d-52f4-417e-860b-ff8cf01fc503" returned: 0 in 0.534s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:17:13 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f515c5b2-f98b-447d-9d43-dd2f6ca82761 tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5b58a2d-52f4-417e-860b-ff8cf01fc503.990d9554-03c9-4b71-a7b1-5717da84874f {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:17:13 devstack sudo[93777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5b58a2d-52f4-417e-860b-ff8cf01fc503.990d9554-03c9-4b71-a7b1-5717da84874f Aug 05 10:17:13 devstack sudo[93777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:17:14 devstack sudo[93777]: pam_unix(sudo:session): session closed for user root Aug 05 10:17:14 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f515c5b2-f98b-447d-9d43-dd2f6ca82761 tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5b58a2d-52f4-417e-860b-ff8cf01fc503.990d9554-03c9-4b71-a7b1-5717da84874f" returned: 0 in 0.481s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:17:14 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f515c5b2-f98b-447d-9d43-dd2f6ca82761 tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5b58a2d-52f4-417e-860b-ff8cf01fc503.990d9554-03c9-4b71-a7b1-5717da84874f {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:17:14 devstack sudo[93785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5b58a2d-52f4-417e-860b-ff8cf01fc503.990d9554-03c9-4b71-a7b1-5717da84874f Aug 05 10:17:14 devstack sudo[93785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:17:14 devstack sudo[93785]: pam_unix(sudo:session): session closed for user root Aug 05 10:17:14 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f515c5b2-f98b-447d-9d43-dd2f6ca82761 tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5b58a2d-52f4-417e-860b-ff8cf01fc503.990d9554-03c9-4b71-a7b1-5717da84874f" returned: 0 in 0.434s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:17:14 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-f515c5b2-f98b-447d-9d43-dd2f6ca82761 tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] Lock "cinder-quobyte-990d9554-03c9-4b71-a7b1-5717da84874f" released by "_delete_snapshot" :: held 2.359s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:17:14 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-f515c5b2-f98b-447d-9d43-dd2f6ca82761 tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] Lock "cinder-quobyte-e5b58a2d-52f4-417e-860b-ff8cf01fc503" released by "delete_snapshot" :: held 2.401s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:17:14 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-f515c5b2-f98b-447d-9d43-dd2f6ca82761 tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] Created reservations ['ae95dadf-6bb4-4887-83a0-366860703e88', 'f75e07de-e789-4224-be4c-c89f7dadbae3', '6b245cdd-3061-4158-ba7e-13f93e79f49d', '66fb2b66-23dd-474e-abaf-e74b0b25cf05'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:17:14 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-f515c5b2-f98b-447d-9d43-dd2f6ca82761 tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] Delete snapshot completed successfully. Aug 05 10:17:15 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-f515c5b2-f98b-447d-9d43-dd2f6ca82761 tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] Lock "cinder-990d9554-03c9-4b71-a7b1-5717da84874f-delete_snapshot" released by "delete_snapshot" :: held 2.693s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:17:15 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-8701ec9a-369d-458f-9345-1e216dbef567 tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] Acquiring lock "cinder-e5b58a2d-52f4-417e-860b-ff8cf01fc503-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:17:15 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-8701ec9a-369d-458f-9345-1e216dbef567 tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] Lock "cinder-e5b58a2d-52f4-417e-860b-ff8cf01fc503-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:17:15 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-8701ec9a-369d-458f-9345-1e216dbef567 tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] Acquiring lock "cinder-quobyte-e5b58a2d-52f4-417e-860b-ff8cf01fc503" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:17:15 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-8701ec9a-369d-458f-9345-1e216dbef567 tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] Lock "cinder-quobyte-e5b58a2d-52f4-417e-860b-ff8cf01fc503" acquired by "delete_volume" :: waited 0.034s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:17:16 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a37199b-6c46-4e43-a203-84fe21b8cc94]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:17:16 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-8701ec9a-369d-458f-9345-1e216dbef567 tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5b58a2d-52f4-417e-860b-ff8cf01fc503 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:17:16 devstack sudo[93793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5b58a2d-52f4-417e-860b-ff8cf01fc503 Aug 05 10:17:16 devstack sudo[93793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:17:16 devstack sudo[93793]: pam_unix(sudo:session): session closed for user root Aug 05 10:17:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-8701ec9a-369d-458f-9345-1e216dbef567 tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5b58a2d-52f4-417e-860b-ff8cf01fc503" returned: 0 in 0.961s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:17:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-8701ec9a-369d-458f-9345-1e216dbef567 tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5b58a2d-52f4-417e-860b-ff8cf01fc503 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:17:17 devstack sudo[93798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5b58a2d-52f4-417e-860b-ff8cf01fc503 Aug 05 10:17:17 devstack sudo[93798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:17:17 devstack sudo[93798]: pam_unix(sudo:session): session closed for user root Aug 05 10:17:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-8701ec9a-369d-458f-9345-1e216dbef567 tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5b58a2d-52f4-417e-860b-ff8cf01fc503" returned: 0 in 0.469s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:17:17 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-8701ec9a-369d-458f-9345-1e216dbef567 tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] Lock "cinder-quobyte-e5b58a2d-52f4-417e-860b-ff8cf01fc503" released by "delete_volume" :: held 1.536s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:17:17 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-8701ec9a-369d-458f-9345-1e216dbef567 tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] Created reservations ['fb142cce-f589-48c7-8783-e044384cd1ef', 'e6162ac5-4cd4-4ef8-8164-eae1fb233ced', '6e7b6f96-da9c-4fb6-8460-ac1694bb12d7', '459359ab-da78-4c1e-9658-4df745602b8b'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:17:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-8701ec9a-369d-458f-9345-1e216dbef567 tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:17:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-8701ec9a-369d-458f-9345-1e216dbef567 tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:17:17 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-8701ec9a-369d-458f-9345-1e216dbef567 tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:17:17 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-8701ec9a-369d-458f-9345-1e216dbef567 tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:17:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-8701ec9a-369d-458f-9345-1e216dbef567 tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:17:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-8701ec9a-369d-458f-9345-1e216dbef567 tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:17:17 devstack sudo[93803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:17:17 devstack sudo[93803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:17:18 devstack sudo[93803]: pam_unix(sudo:session): session closed for user root Aug 05 10:17:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-8701ec9a-369d-458f-9345-1e216dbef567 tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.413s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:17:18 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-8701ec9a-369d-458f-9345-1e216dbef567 tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:17:18 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-8701ec9a-369d-458f-9345-1e216dbef567 tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] Deleted volume successfully. Aug 05 10:17:18 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-8701ec9a-369d-458f-9345-1e216dbef567 tempest-VolumeSnapshotQuotasNegativeTestJSON-1447563989 None] Lock "cinder-e5b58a2d-52f4-417e-860b-ff8cf01fc503-delete_volume" released by "delete_volume" :: held 2.336s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:17:21 devstack cinder-volume[88613]: DEBUG oslo_service.periodic_task [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88613) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:17:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:17:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:17:21 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:17:21 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:17:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:17:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:17:21 devstack sudo[93807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:17:21 devstack sudo[93807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:17:22 devstack sudo[93807]: pam_unix(sudo:session): session closed for user root Aug 05 10:17:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.499s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:17:22 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:17:22 devstack cinder-volume[88613]: DEBUG oslo_service.periodic_task [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Running periodic task VolumeManager._thread_info {{(pid=88613) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:17:22 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] thread count: 28 {{(pid=88613) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 10:17:22 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] thread info: [<_MainThread(MainThread, started 126173666128000)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88613) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 10:17:23 devstack cinder-volume[88613]: DEBUG dbcounter [-] [88613] Writing DB stats cinder:INSERT=27,cinder:UPDATE=92,cinder:SELECT=85,cinder:DELETE=3 {{(pid=88613) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:17:23 devstack cinder-volume[88613]: DEBUG dbcounter [-] [88613] Writing DB stats cinder:SELECT=96,cinder:DELETE=8,cinder:UPDATE=67,cinder:INSERT=24 {{(pid=88613) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:17:23 devstack cinder-volume[88613]: INFO cinder.volume.manager [req-b8e982fe-1e2a-4e06-9224-db5ffede253f req-5e7e3827-70b6-4b34-84e8-9cdb62675faf tempest-ServerActionsTestOtherA-221436279 None] Terminate volume connection completed successfully. Aug 05 10:17:23 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [req-b8e982fe-1e2a-4e06-9224-db5ffede253f req-5e7e3827-70b6-4b34-84e8-9cdb62675faf tempest-ServerActionsTestOtherA-221436279 None] Deleting attachment 12ad79a1-84d4-4690-944f-336f0221622d. {{(pid=88613) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 10:17:26 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-b8e982fe-1e2a-4e06-9224-db5ffede253f req-ae246781-42b9-49ac-b372-65d0c0435501 tempest-ServerActionsTestOtherA-221436279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:17:26 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-b8e982fe-1e2a-4e06-9224-db5ffede253f req-ae246781-42b9-49ac-b372-65d0c0435501 tempest-ServerActionsTestOtherA-221436279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:17:26 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-b8e982fe-1e2a-4e06-9224-db5ffede253f req-ae246781-42b9-49ac-b372-65d0c0435501 tempest-ServerActionsTestOtherA-221436279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:17:26 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [req-b8e982fe-1e2a-4e06-9224-db5ffede253f req-ae246781-42b9-49ac-b372-65d0c0435501 tempest-ServerActionsTestOtherA-221436279 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1', 'name': 'volume-c9825d6b-f9aa-4743-9e57-160fb8860b66', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '842a861c-285c-4952-9253-a70c33da3b80', 'enforce_multipath': True} {{(pid=88613) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 10:17:26 devstack cinder-volume[88613]: INFO cinder.volume.manager [req-b8e982fe-1e2a-4e06-9224-db5ffede253f req-ae246781-42b9-49ac-b372-65d0c0435501 tempest-ServerActionsTestOtherA-221436279 None] attachment_update completed successfully. Aug 05 10:17:28 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-77176b14-1873-4eb8-83a7-5fee2cda2382 tempest-VolumeTypesAccessTest-1708878224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:17:28 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-77176b14-1873-4eb8-83a7-5fee2cda2382 tempest-VolumeTypesAccessTest-1708878224 None] Flow 'volume_create_manager' (9c9e4403-02e4-4dbf-872d-b54baa12d363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:17:28 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-77176b14-1873-4eb8-83a7-5fee2cda2382 tempest-VolumeTypesAccessTest-1708878224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3078c6c7-6a50-4af3-932f-b979fcbccd8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:17:28 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-77176b14-1873-4eb8-83a7-5fee2cda2382 tempest-VolumeTypesAccessTest-1708878224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3078c6c7-6a50-4af3-932f-b979fcbccd8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:17:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-332992847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=818ad130-06ca-4ead-8a6e-5b2202971738,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d257054cbd2484aa170c3aa9d30e2ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:17:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:17:29Z,use_quota=True,user_id='0dbec9347f664cf4858b24d6c22473c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3463b97f-ba99-4952-b71c-8b873fbdf744),volume_type_id=3463b97f-ba99-4952-b71c-8b873fbdf744)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:17:28 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-77176b14-1873-4eb8-83a7-5fee2cda2382 tempest-VolumeTypesAccessTest-1708878224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43759b59-816a-4fcc-b7a1-b4af6c0bb33f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:17:28 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-77176b14-1873-4eb8-83a7-5fee2cda2382 tempest-VolumeTypesAccessTest-1708878224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43759b59-816a-4fcc-b7a1-b4af6c0bb33f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:17:29 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-77176b14-1873-4eb8-83a7-5fee2cda2382 tempest-VolumeTypesAccessTest-1708878224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e63d75f-fdf4-4187-88fa-c62717ce4163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:17:29 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-77176b14-1873-4eb8-83a7-5fee2cda2382 tempest-VolumeTypesAccessTest-1708878224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e63d75f-fdf4-4187-88fa-c62717ce4163) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '818ad130-06ca-4ead-8a6e-5b2202971738', 'volume_name': 'volume-818ad130-06ca-4ead-8a6e-5b2202971738', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:17:29 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-77176b14-1873-4eb8-83a7-5fee2cda2382 tempest-VolumeTypesAccessTest-1708878224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c49e95f4-1787-4765-93da-7c09c5a95126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:17:29 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-77176b14-1873-4eb8-83a7-5fee2cda2382 tempest-VolumeTypesAccessTest-1708878224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c49e95f4-1787-4765-93da-7c09c5a95126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:17:29 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-77176b14-1873-4eb8-83a7-5fee2cda2382 tempest-VolumeTypesAccessTest-1708878224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af044047-8b03-43a3-bf1f-7e2c9ad86c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:17:29 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-77176b14-1873-4eb8-83a7-5fee2cda2382 tempest-VolumeTypesAccessTest-1708878224 None] Volume 818ad130-06ca-4ead-8a6e-5b2202971738: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-818ad130-06ca-4ead-8a6e-5b2202971738', 'volume_size': 1} Aug 05 10:17:29 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-77176b14-1873-4eb8-83a7-5fee2cda2382 tempest-VolumeTypesAccessTest-1708878224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:17:29 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-77176b14-1873-4eb8-83a7-5fee2cda2382 tempest-VolumeTypesAccessTest-1708878224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:17:29 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-77176b14-1873-4eb8-83a7-5fee2cda2382 tempest-VolumeTypesAccessTest-1708878224 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:17:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-332992847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=818ad130-06ca-4ead-8a6e-5b2202971738,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d257054cbd2484aa170c3aa9d30e2ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:17:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:17:29Z,use_quota=True,user_id='0dbec9347f664cf4858b24d6c22473c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3463b97f-ba99-4952-b71c-8b873fbdf744),volume_type_id=3463b97f-ba99-4952-b71c-8b873fbdf744)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:17:29 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-77176b14-1873-4eb8-83a7-5fee2cda2382 tempest-VolumeTypesAccessTest-1708878224 None] Creating volume 818ad130-06ca-4ead-8a6e-5b2202971738 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:17:29 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-77176b14-1873-4eb8-83a7-5fee2cda2382 tempest-VolumeTypesAccessTest-1708878224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:17:29 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-77176b14-1873-4eb8-83a7-5fee2cda2382 tempest-VolumeTypesAccessTest-1708878224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:17:29 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-77176b14-1873-4eb8-83a7-5fee2cda2382 tempest-VolumeTypesAccessTest-1708878224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:17:29 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-77176b14-1873-4eb8-83a7-5fee2cda2382 tempest-VolumeTypesAccessTest-1708878224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:17:29 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-77176b14-1873-4eb8-83a7-5fee2cda2382 tempest-VolumeTypesAccessTest-1708878224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:17:29 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-77176b14-1873-4eb8-83a7-5fee2cda2382 tempest-VolumeTypesAccessTest-1708878224 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:17:29 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-77176b14-1873-4eb8-83a7-5fee2cda2382 tempest-VolumeTypesAccessTest-1708878224 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:17:29 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-77176b14-1873-4eb8-83a7-5fee2cda2382 tempest-VolumeTypesAccessTest-1708878224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-818ad130-06ca-4ead-8a6e-5b2202971738 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:17:29 devstack sudo[94297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-818ad130-06ca-4ead-8a6e-5b2202971738 1073741824 Aug 05 10:17:29 devstack sudo[94297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:17:29 devstack sudo[94297]: pam_unix(sudo:session): session closed for user root Aug 05 10:17:29 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-77176b14-1873-4eb8-83a7-5fee2cda2382 tempest-VolumeTypesAccessTest-1708878224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-818ad130-06ca-4ead-8a6e-5b2202971738 1073741824" returned: 0 in 0.622s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:17:29 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-77176b14-1873-4eb8-83a7-5fee2cda2382 tempest-VolumeTypesAccessTest-1708878224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-818ad130-06ca-4ead-8a6e-5b2202971738 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:17:29 devstack sudo[94324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-818ad130-06ca-4ead-8a6e-5b2202971738 Aug 05 10:17:29 devstack sudo[94324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:17:30 devstack sudo[94324]: pam_unix(sudo:session): session closed for user root Aug 05 10:17:30 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-77176b14-1873-4eb8-83a7-5fee2cda2382 tempest-VolumeTypesAccessTest-1708878224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-818ad130-06ca-4ead-8a6e-5b2202971738" returned: 0 in 0.366s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:17:30 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-77176b14-1873-4eb8-83a7-5fee2cda2382 tempest-VolumeTypesAccessTest-1708878224 None] <== create_volume: return (1080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:17:30 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-77176b14-1873-4eb8-83a7-5fee2cda2382 tempest-VolumeTypesAccessTest-1708878224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:17:30 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-77176b14-1873-4eb8-83a7-5fee2cda2382 tempest-VolumeTypesAccessTest-1708878224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af044047-8b03-43a3-bf1f-7e2c9ad86c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-818ad130-06ca-4ead-8a6e-5b2202971738', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:17:30 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-77176b14-1873-4eb8-83a7-5fee2cda2382 tempest-VolumeTypesAccessTest-1708878224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfc61e2c-a7d5-4da6-ac90-aa33902a5407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:17:30 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-77176b14-1873-4eb8-83a7-5fee2cda2382 tempest-VolumeTypesAccessTest-1708878224 None] Volume volume-818ad130-06ca-4ead-8a6e-5b2202971738 (818ad130-06ca-4ead-8a6e-5b2202971738): created successfully Aug 05 10:17:30 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-77176b14-1873-4eb8-83a7-5fee2cda2382 tempest-VolumeTypesAccessTest-1708878224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfc61e2c-a7d5-4da6-ac90-aa33902a5407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:17:30 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-77176b14-1873-4eb8-83a7-5fee2cda2382 tempest-VolumeTypesAccessTest-1708878224 None] Flow 'volume_create_manager' (9c9e4403-02e4-4dbf-872d-b54baa12d363) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:17:30 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-77176b14-1873-4eb8-83a7-5fee2cda2382 tempest-VolumeTypesAccessTest-1708878224 None] Created volume successfully. Aug 05 10:17:31 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-ac559421-5653-4887-afb4-715ab467f752 tempest-VolumeTypesAccessTest-1708878224 None] Acquiring lock "cinder-818ad130-06ca-4ead-8a6e-5b2202971738-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:17:31 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-ac559421-5653-4887-afb4-715ab467f752 tempest-VolumeTypesAccessTest-1708878224 None] Lock "cinder-818ad130-06ca-4ead-8a6e-5b2202971738-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:17:31 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-ac559421-5653-4887-afb4-715ab467f752 tempest-VolumeTypesAccessTest-1708878224 None] Acquiring lock "cinder-quobyte-818ad130-06ca-4ead-8a6e-5b2202971738" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:17:31 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-ac559421-5653-4887-afb4-715ab467f752 tempest-VolumeTypesAccessTest-1708878224 None] Lock "cinder-quobyte-818ad130-06ca-4ead-8a6e-5b2202971738" acquired by "delete_volume" :: waited 0.024s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:17:31 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[981dc746-8e8f-4802-998a-a732da4f8a6c]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:17:31 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ac559421-5653-4887-afb4-715ab467f752 tempest-VolumeTypesAccessTest-1708878224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-818ad130-06ca-4ead-8a6e-5b2202971738 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:17:31 devstack sudo[94397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-818ad130-06ca-4ead-8a6e-5b2202971738 Aug 05 10:17:31 devstack sudo[94397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:17:32 devstack sudo[94397]: pam_unix(sudo:session): session closed for user root Aug 05 10:17:32 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ac559421-5653-4887-afb4-715ab467f752 tempest-VolumeTypesAccessTest-1708878224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-818ad130-06ca-4ead-8a6e-5b2202971738" returned: 0 in 1.103s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:17:32 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ac559421-5653-4887-afb4-715ab467f752 tempest-VolumeTypesAccessTest-1708878224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-818ad130-06ca-4ead-8a6e-5b2202971738 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:17:32 devstack sudo[94429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-818ad130-06ca-4ead-8a6e-5b2202971738 Aug 05 10:17:32 devstack sudo[94429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:17:33 devstack sudo[94429]: pam_unix(sudo:session): session closed for user root Aug 05 10:17:33 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ac559421-5653-4887-afb4-715ab467f752 tempest-VolumeTypesAccessTest-1708878224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-818ad130-06ca-4ead-8a6e-5b2202971738" returned: 0 in 0.612s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:17:33 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-ac559421-5653-4887-afb4-715ab467f752 tempest-VolumeTypesAccessTest-1708878224 None] Lock "cinder-quobyte-818ad130-06ca-4ead-8a6e-5b2202971738" released by "delete_volume" :: held 1.786s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:17:33 devstack cinder-volume[88613]: WARNING cinder.quota [None req-ac559421-5653-4887-afb4-715ab467f752 tempest-VolumeTypesAccessTest-1708878224 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-529609055 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-529609055, it is now deprecated. Please use the default quota class for default quota. Aug 05 10:17:33 devstack cinder-volume[88613]: WARNING cinder.quota [None req-ac559421-5653-4887-afb4-715ab467f752 tempest-VolumeTypesAccessTest-1708878224 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-529609055 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-529609055, it is now deprecated. Please use the default quota class for default quota. Aug 05 10:17:33 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-ac559421-5653-4887-afb4-715ab467f752 tempest-VolumeTypesAccessTest-1708878224 None] Created reservations ['afdcc24b-dd90-4e1a-a252-fda9ee947356', 'af9a61ba-fb15-4361-bd3d-655dd87c4f80', 'f73c0dc1-ad05-4154-b92f-b35aee3434b3', '41e67a05-a472-4673-b4ac-80464b4aef2d'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:17:33 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-ac559421-5653-4887-afb4-715ab467f752 tempest-VolumeTypesAccessTest-1708878224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:17:33 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-ac559421-5653-4887-afb4-715ab467f752 tempest-VolumeTypesAccessTest-1708878224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:17:33 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-ac559421-5653-4887-afb4-715ab467f752 tempest-VolumeTypesAccessTest-1708878224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:17:33 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-ac559421-5653-4887-afb4-715ab467f752 tempest-VolumeTypesAccessTest-1708878224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:17:33 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-ac559421-5653-4887-afb4-715ab467f752 tempest-VolumeTypesAccessTest-1708878224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:17:33 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ac559421-5653-4887-afb4-715ab467f752 tempest-VolumeTypesAccessTest-1708878224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:17:33 devstack sudo[94436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:17:33 devstack sudo[94436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:17:33 devstack sudo[94436]: pam_unix(sudo:session): session closed for user root Aug 05 10:17:33 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ac559421-5653-4887-afb4-715ab467f752 tempest-VolumeTypesAccessTest-1708878224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.466s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:17:33 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-ac559421-5653-4887-afb4-715ab467f752 tempest-VolumeTypesAccessTest-1708878224 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:17:33 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-ac559421-5653-4887-afb4-715ab467f752 tempest-VolumeTypesAccessTest-1708878224 None] Deleted volume successfully. Aug 05 10:17:33 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-ac559421-5653-4887-afb4-715ab467f752 tempest-VolumeTypesAccessTest-1708878224 None] Lock "cinder-818ad130-06ca-4ead-8a6e-5b2202971738-delete_volume" released by "delete_volume" :: held 2.646s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:17:43 devstack cinder-volume[88613]: DEBUG dbcounter [-] [88613] Writing DB stats cinder:SELECT=12,cinder:UPDATE=11,cinder:DELETE=1,cinder:INSERT=3 {{(pid=88613) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:17:43 devstack cinder-volume[88613]: DEBUG dbcounter [-] [88613] Writing DB stats cinder:SELECT=15,cinder:UPDATE=14,cinder:INSERT=2,cinder:DELETE=1 {{(pid=88613) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:17:54 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-c49e543d-e264-410f-b866-218df08e3120 tempest-VolumesGetTest-784082675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:17:54 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c49e543d-e264-410f-b866-218df08e3120 tempest-VolumesGetTest-784082675 None] Flow 'volume_create_manager' (73c7b262-85d0-41da-a9cc-b7bfe1876f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:17:54 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c49e543d-e264-410f-b866-218df08e3120 tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fcbc8d4-f32d-4ed8-8335-f3d242698066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:17:54 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c49e543d-e264-410f-b866-218df08e3120 tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fcbc8d4-f32d-4ed8-8335-f3d242698066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:17:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-782568857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02c98207-5c67-4ba4-929e-6d9fba9a4bd8,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6a06c5d00bd44107a18e7ae90e338bde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:17:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:17:55Z,use_quota=True,user_id='02afcf118fdd4d2c9432655c62cfcfaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:17:54 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c49e543d-e264-410f-b866-218df08e3120 tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3570de32-e0f0-422d-9a58-ed7ae3ccb4b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:17:54 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c49e543d-e264-410f-b866-218df08e3120 tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3570de32-e0f0-422d-9a58-ed7ae3ccb4b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:17:54 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c49e543d-e264-410f-b866-218df08e3120 tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e7c2921-5592-471a-adf0-144075462ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:17:54 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c49e543d-e264-410f-b866-218df08e3120 tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e7c2921-5592-471a-adf0-144075462ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02c98207-5c67-4ba4-929e-6d9fba9a4bd8', 'volume_name': 'volume-02c98207-5c67-4ba4-929e-6d9fba9a4bd8', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:17:54 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c49e543d-e264-410f-b866-218df08e3120 tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6466465-ff54-4f9f-8852-d33f3ce9cc53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:17:54 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c49e543d-e264-410f-b866-218df08e3120 tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6466465-ff54-4f9f-8852-d33f3ce9cc53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:17:54 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c49e543d-e264-410f-b866-218df08e3120 tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67c79eb9-ebf7-4673-8aa5-caf587a5f1a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:17:54 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-c49e543d-e264-410f-b866-218df08e3120 tempest-VolumesGetTest-784082675 None] Volume 02c98207-5c67-4ba4-929e-6d9fba9a4bd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02c98207-5c67-4ba4-929e-6d9fba9a4bd8', 'volume_size': 1} Aug 05 10:17:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c49e543d-e264-410f-b866-218df08e3120 tempest-VolumesGetTest-784082675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:17:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c49e543d-e264-410f-b866-218df08e3120 tempest-VolumesGetTest-784082675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:17:54 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-c49e543d-e264-410f-b866-218df08e3120 tempest-VolumesGetTest-784082675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:17:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-782568857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02c98207-5c67-4ba4-929e-6d9fba9a4bd8,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6a06c5d00bd44107a18e7ae90e338bde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:17:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:17:55Z,use_quota=True,user_id='02afcf118fdd4d2c9432655c62cfcfaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:17:54 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-c49e543d-e264-410f-b866-218df08e3120 tempest-VolumesGetTest-784082675 None] Creating volume 02c98207-5c67-4ba4-929e-6d9fba9a4bd8 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:17:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c49e543d-e264-410f-b866-218df08e3120 tempest-VolumesGetTest-784082675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:17:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c49e543d-e264-410f-b866-218df08e3120 tempest-VolumesGetTest-784082675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:17:54 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-c49e543d-e264-410f-b866-218df08e3120 tempest-VolumesGetTest-784082675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:17:54 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-c49e543d-e264-410f-b866-218df08e3120 tempest-VolumesGetTest-784082675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:17:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c49e543d-e264-410f-b866-218df08e3120 tempest-VolumesGetTest-784082675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:17:54 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-c49e543d-e264-410f-b866-218df08e3120 tempest-VolumesGetTest-784082675 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:17:54 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-c49e543d-e264-410f-b866-218df08e3120 tempest-VolumesGetTest-784082675 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:17:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c49e543d-e264-410f-b866-218df08e3120 tempest-VolumesGetTest-784082675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-02c98207-5c67-4ba4-929e-6d9fba9a4bd8 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:17:54 devstack sudo[94633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-02c98207-5c67-4ba4-929e-6d9fba9a4bd8 1073741824 Aug 05 10:17:54 devstack sudo[94633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:17:55 devstack sudo[94633]: pam_unix(sudo:session): session closed for user root Aug 05 10:17:55 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c49e543d-e264-410f-b866-218df08e3120 tempest-VolumesGetTest-784082675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-02c98207-5c67-4ba4-929e-6d9fba9a4bd8 1073741824" returned: 0 in 0.517s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:17:55 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c49e543d-e264-410f-b866-218df08e3120 tempest-VolumesGetTest-784082675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-02c98207-5c67-4ba4-929e-6d9fba9a4bd8 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:17:55 devstack sudo[94645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-02c98207-5c67-4ba4-929e-6d9fba9a4bd8 Aug 05 10:17:55 devstack sudo[94645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:17:55 devstack sudo[94645]: pam_unix(sudo:session): session closed for user root Aug 05 10:17:55 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c49e543d-e264-410f-b866-218df08e3120 tempest-VolumesGetTest-784082675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-02c98207-5c67-4ba4-929e-6d9fba9a4bd8" returned: 0 in 0.262s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:17:55 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-c49e543d-e264-410f-b866-218df08e3120 tempest-VolumesGetTest-784082675 None] <== create_volume: return (827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:17:55 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c49e543d-e264-410f-b866-218df08e3120 tempest-VolumesGetTest-784082675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:17:55 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c49e543d-e264-410f-b866-218df08e3120 tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67c79eb9-ebf7-4673-8aa5-caf587a5f1a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02c98207-5c67-4ba4-929e-6d9fba9a4bd8', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:17:55 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c49e543d-e264-410f-b866-218df08e3120 tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f875d96-2ae7-4476-8a40-2d1087eb296b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:17:55 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-c49e543d-e264-410f-b866-218df08e3120 tempest-VolumesGetTest-784082675 None] Volume volume-02c98207-5c67-4ba4-929e-6d9fba9a4bd8 (02c98207-5c67-4ba4-929e-6d9fba9a4bd8): created successfully Aug 05 10:17:55 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c49e543d-e264-410f-b866-218df08e3120 tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f875d96-2ae7-4476-8a40-2d1087eb296b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:17:55 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c49e543d-e264-410f-b866-218df08e3120 tempest-VolumesGetTest-784082675 None] Flow 'volume_create_manager' (73c7b262-85d0-41da-a9cc-b7bfe1876f84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:17:55 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-c49e543d-e264-410f-b866-218df08e3120 tempest-VolumesGetTest-784082675 None] Created volume successfully. Aug 05 10:17:57 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-2189a52e-87a7-4206-a84e-767b2c1511ce tempest-VolumesGetTest-784082675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:17:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2189a52e-87a7-4206-a84e-767b2c1511ce tempest-VolumesGetTest-784082675 None] Flow 'volume_create_manager' (d507f73b-7e53-46da-a7c8-d4afe752e7be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:17:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2189a52e-87a7-4206-a84e-767b2c1511ce tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c9aa222-ac39-404d-aa60-049bd579203a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:17:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2189a52e-87a7-4206-a84e-767b2c1511ce tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c9aa222-ac39-404d-aa60-049bd579203a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:17:57Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-798053481',display_name='tempest-VolumesGetTest-Volume-1031569444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca8616a7-5e43-4ec8-a657-5cb576f56048,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a06c5d00bd44107a18e7ae90e338bde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:17:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:17:57Z,use_quota=True,user_id='02afcf118fdd4d2c9432655c62cfcfaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:17:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2189a52e-87a7-4206-a84e-767b2c1511ce tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce72e008-db45-4c9d-ba14-5a2314f6feb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:17:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2189a52e-87a7-4206-a84e-767b2c1511ce tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce72e008-db45-4c9d-ba14-5a2314f6feb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:17:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2189a52e-87a7-4206-a84e-767b2c1511ce tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cef1922-83f2-4396-a072-56f77ee02ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:17:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2189a52e-87a7-4206-a84e-767b2c1511ce tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cef1922-83f2-4396-a072-56f77ee02ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca8616a7-5e43-4ec8-a657-5cb576f56048', 'volume_name': 'volume-ca8616a7-5e43-4ec8-a657-5cb576f56048', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:17:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2189a52e-87a7-4206-a84e-767b2c1511ce tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a6d6907-8ade-473f-b36e-dd20b3f7232d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:17:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2189a52e-87a7-4206-a84e-767b2c1511ce tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a6d6907-8ade-473f-b36e-dd20b3f7232d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:17:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2189a52e-87a7-4206-a84e-767b2c1511ce tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d993608b-5049-4d80-bb18-96ec6ee274c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:17:57 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-2189a52e-87a7-4206-a84e-767b2c1511ce tempest-VolumesGetTest-784082675 None] Volume ca8616a7-5e43-4ec8-a657-5cb576f56048: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca8616a7-5e43-4ec8-a657-5cb576f56048', 'volume_size': 1} Aug 05 10:17:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2189a52e-87a7-4206-a84e-767b2c1511ce tempest-VolumesGetTest-784082675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:17:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2189a52e-87a7-4206-a84e-767b2c1511ce tempest-VolumesGetTest-784082675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:17:57 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-2189a52e-87a7-4206-a84e-767b2c1511ce tempest-VolumesGetTest-784082675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:17:57Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-798053481',display_name='tempest-VolumesGetTest-Volume-1031569444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca8616a7-5e43-4ec8-a657-5cb576f56048,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a06c5d00bd44107a18e7ae90e338bde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:17:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:17:57Z,use_quota=True,user_id='02afcf118fdd4d2c9432655c62cfcfaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:17:57 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-2189a52e-87a7-4206-a84e-767b2c1511ce tempest-VolumesGetTest-784082675 None] Creating volume ca8616a7-5e43-4ec8-a657-5cb576f56048 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:17:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2189a52e-87a7-4206-a84e-767b2c1511ce tempest-VolumesGetTest-784082675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:17:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2189a52e-87a7-4206-a84e-767b2c1511ce tempest-VolumesGetTest-784082675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:17:57 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-2189a52e-87a7-4206-a84e-767b2c1511ce tempest-VolumesGetTest-784082675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:17:57 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-2189a52e-87a7-4206-a84e-767b2c1511ce tempest-VolumesGetTest-784082675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:17:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2189a52e-87a7-4206-a84e-767b2c1511ce tempest-VolumesGetTest-784082675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:17:57 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-2189a52e-87a7-4206-a84e-767b2c1511ce tempest-VolumesGetTest-784082675 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:17:57 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-2189a52e-87a7-4206-a84e-767b2c1511ce tempest-VolumesGetTest-784082675 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:17:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2189a52e-87a7-4206-a84e-767b2c1511ce tempest-VolumesGetTest-784082675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ca8616a7-5e43-4ec8-a657-5cb576f56048 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:17:57 devstack sudo[94665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ca8616a7-5e43-4ec8-a657-5cb576f56048 1073741824 Aug 05 10:17:57 devstack sudo[94665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:17:57 devstack sudo[94665]: pam_unix(sudo:session): session closed for user root Aug 05 10:17:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2189a52e-87a7-4206-a84e-767b2c1511ce tempest-VolumesGetTest-784082675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ca8616a7-5e43-4ec8-a657-5cb576f56048 1073741824" returned: 0 in 0.462s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:17:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2189a52e-87a7-4206-a84e-767b2c1511ce tempest-VolumesGetTest-784082675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ca8616a7-5e43-4ec8-a657-5cb576f56048 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:17:58 devstack sudo[94671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ca8616a7-5e43-4ec8-a657-5cb576f56048 Aug 05 10:17:58 devstack sudo[94671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:17:58 devstack sudo[94671]: pam_unix(sudo:session): session closed for user root Aug 05 10:17:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2189a52e-87a7-4206-a84e-767b2c1511ce tempest-VolumesGetTest-784082675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ca8616a7-5e43-4ec8-a657-5cb576f56048" returned: 0 in 0.263s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:17:58 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-2189a52e-87a7-4206-a84e-767b2c1511ce tempest-VolumesGetTest-784082675 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:17:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2189a52e-87a7-4206-a84e-767b2c1511ce tempest-VolumesGetTest-784082675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:17:58 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2189a52e-87a7-4206-a84e-767b2c1511ce tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d993608b-5049-4d80-bb18-96ec6ee274c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca8616a7-5e43-4ec8-a657-5cb576f56048', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:17:58 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2189a52e-87a7-4206-a84e-767b2c1511ce tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dd678a3-062e-4b34-91e5-d91f16dd519c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:17:58 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-2189a52e-87a7-4206-a84e-767b2c1511ce tempest-VolumesGetTest-784082675 None] Volume volume-ca8616a7-5e43-4ec8-a657-5cb576f56048 (ca8616a7-5e43-4ec8-a657-5cb576f56048): created successfully Aug 05 10:17:58 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2189a52e-87a7-4206-a84e-767b2c1511ce tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dd678a3-062e-4b34-91e5-d91f16dd519c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:17:58 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2189a52e-87a7-4206-a84e-767b2c1511ce tempest-VolumesGetTest-784082675 None] Flow 'volume_create_manager' (d507f73b-7e53-46da-a7c8-d4afe752e7be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:17:58 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-2189a52e-87a7-4206-a84e-767b2c1511ce tempest-VolumesGetTest-784082675 None] Created volume successfully. Aug 05 10:17:58 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-64eb0cf7-d67c-4f06-852c-d9237cd8cbb1 tempest-VolumesGetTest-784082675 None] Acquiring lock "cinder-ca8616a7-5e43-4ec8-a657-5cb576f56048-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:17:58 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-64eb0cf7-d67c-4f06-852c-d9237cd8cbb1 tempest-VolumesGetTest-784082675 None] Lock "cinder-ca8616a7-5e43-4ec8-a657-5cb576f56048-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:17:58 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-64eb0cf7-d67c-4f06-852c-d9237cd8cbb1 tempest-VolumesGetTest-784082675 None] Acquiring lock "cinder-quobyte-ca8616a7-5e43-4ec8-a657-5cb576f56048" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:17:58 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-64eb0cf7-d67c-4f06-852c-d9237cd8cbb1 tempest-VolumesGetTest-784082675 None] Lock "cinder-quobyte-ca8616a7-5e43-4ec8-a657-5cb576f56048" acquired by "delete_volume" :: waited 0.020s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:17:58 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[de5a23b0-6487-4958-a3db-920bc5ca5d2a]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:17:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-64eb0cf7-d67c-4f06-852c-d9237cd8cbb1 tempest-VolumesGetTest-784082675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ca8616a7-5e43-4ec8-a657-5cb576f56048 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:17:58 devstack sudo[94674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ca8616a7-5e43-4ec8-a657-5cb576f56048 Aug 05 10:17:58 devstack sudo[94674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:17:59 devstack sudo[94674]: pam_unix(sudo:session): session closed for user root Aug 05 10:17:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-64eb0cf7-d67c-4f06-852c-d9237cd8cbb1 tempest-VolumesGetTest-784082675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ca8616a7-5e43-4ec8-a657-5cb576f56048" returned: 0 in 0.376s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:17:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-64eb0cf7-d67c-4f06-852c-d9237cd8cbb1 tempest-VolumesGetTest-784082675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ca8616a7-5e43-4ec8-a657-5cb576f56048 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:17:59 devstack sudo[94679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ca8616a7-5e43-4ec8-a657-5cb576f56048 Aug 05 10:17:59 devstack sudo[94679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:17:59 devstack sudo[94679]: pam_unix(sudo:session): session closed for user root Aug 05 10:17:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-64eb0cf7-d67c-4f06-852c-d9237cd8cbb1 tempest-VolumesGetTest-784082675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ca8616a7-5e43-4ec8-a657-5cb576f56048" returned: 0 in 0.264s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:17:59 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-64eb0cf7-d67c-4f06-852c-d9237cd8cbb1 tempest-VolumesGetTest-784082675 None] Lock "cinder-quobyte-ca8616a7-5e43-4ec8-a657-5cb576f56048" released by "delete_volume" :: held 0.694s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:17:59 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-64eb0cf7-d67c-4f06-852c-d9237cd8cbb1 tempest-VolumesGetTest-784082675 None] Created reservations ['1c8da797-fa48-4e05-b008-c470965605db', '50fdc2af-6aa7-4f4e-a13c-f6b484c12a2d', 'e03deed2-7ade-491b-bd91-b2a8f8d6551b', '4c150c48-59fb-4dc4-a6ce-a3505949d2bb'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:17:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-64eb0cf7-d67c-4f06-852c-d9237cd8cbb1 tempest-VolumesGetTest-784082675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:17:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-64eb0cf7-d67c-4f06-852c-d9237cd8cbb1 tempest-VolumesGetTest-784082675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:17:59 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-64eb0cf7-d67c-4f06-852c-d9237cd8cbb1 tempest-VolumesGetTest-784082675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:17:59 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-64eb0cf7-d67c-4f06-852c-d9237cd8cbb1 tempest-VolumesGetTest-784082675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:17:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-64eb0cf7-d67c-4f06-852c-d9237cd8cbb1 tempest-VolumesGetTest-784082675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:17:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-64eb0cf7-d67c-4f06-852c-d9237cd8cbb1 tempest-VolumesGetTest-784082675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:17:59 devstack sudo[94682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:17:59 devstack sudo[94682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:17:59 devstack sudo[94682]: pam_unix(sudo:session): session closed for user root Aug 05 10:17:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-64eb0cf7-d67c-4f06-852c-d9237cd8cbb1 tempest-VolumesGetTest-784082675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.275s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:17:59 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-64eb0cf7-d67c-4f06-852c-d9237cd8cbb1 tempest-VolumesGetTest-784082675 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:17:59 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-64eb0cf7-d67c-4f06-852c-d9237cd8cbb1 tempest-VolumesGetTest-784082675 None] Deleted volume successfully. Aug 05 10:17:59 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-64eb0cf7-d67c-4f06-852c-d9237cd8cbb1 tempest-VolumesGetTest-784082675 None] Lock "cinder-ca8616a7-5e43-4ec8-a657-5cb576f56048-delete_volume" released by "delete_volume" :: held 1.206s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:17:59 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-20eb8dce-e5e4-4ec8-a7f0-7524460a6953 tempest-VolumesGetTest-784082675 None] Acquiring lock "cinder-02c98207-5c67-4ba4-929e-6d9fba9a4bd8-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:17:59 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-20eb8dce-e5e4-4ec8-a7f0-7524460a6953 tempest-VolumesGetTest-784082675 None] Lock "cinder-02c98207-5c67-4ba4-929e-6d9fba9a4bd8-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:17:59 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-20eb8dce-e5e4-4ec8-a7f0-7524460a6953 tempest-VolumesGetTest-784082675 None] Acquiring lock "cinder-quobyte-02c98207-5c67-4ba4-929e-6d9fba9a4bd8" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:17:59 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-20eb8dce-e5e4-4ec8-a7f0-7524460a6953 tempest-VolumesGetTest-784082675 None] Lock "cinder-quobyte-02c98207-5c67-4ba4-929e-6d9fba9a4bd8" acquired by "delete_volume" :: waited 0.017s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:17:59 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe3e3b4-1015-40be-829c-7956947e33d4]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:17:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-20eb8dce-e5e4-4ec8-a7f0-7524460a6953 tempest-VolumesGetTest-784082675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-02c98207-5c67-4ba4-929e-6d9fba9a4bd8 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:00 devstack sudo[94685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-02c98207-5c67-4ba4-929e-6d9fba9a4bd8 Aug 05 10:18:00 devstack sudo[94685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:00 devstack sudo[94685]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:00 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-20eb8dce-e5e4-4ec8-a7f0-7524460a6953 tempest-VolumesGetTest-784082675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-02c98207-5c67-4ba4-929e-6d9fba9a4bd8" returned: 0 in 0.361s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:00 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-20eb8dce-e5e4-4ec8-a7f0-7524460a6953 tempest-VolumesGetTest-784082675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-02c98207-5c67-4ba4-929e-6d9fba9a4bd8 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:00 devstack sudo[94690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-02c98207-5c67-4ba4-929e-6d9fba9a4bd8 Aug 05 10:18:00 devstack sudo[94690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:00 devstack sudo[94690]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:00 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-20eb8dce-e5e4-4ec8-a7f0-7524460a6953 tempest-VolumesGetTest-784082675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-02c98207-5c67-4ba4-929e-6d9fba9a4bd8" returned: 0 in 0.234s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:00 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-20eb8dce-e5e4-4ec8-a7f0-7524460a6953 tempest-VolumesGetTest-784082675 None] Lock "cinder-quobyte-02c98207-5c67-4ba4-929e-6d9fba9a4bd8" released by "delete_volume" :: held 0.632s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:18:00 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-20eb8dce-e5e4-4ec8-a7f0-7524460a6953 tempest-VolumesGetTest-784082675 None] Created reservations ['a8136739-549a-49b4-bb80-09404fb7457b', '8fba6491-f179-4a08-8b0e-69490adca2a8', '4f9ef7f3-3308-470b-bdde-265850618d22', '43ad2ff1-d188-46db-8ea5-e90dc9cc17f3'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:18:00 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-20eb8dce-e5e4-4ec8-a7f0-7524460a6953 tempest-VolumesGetTest-784082675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:18:00 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-20eb8dce-e5e4-4ec8-a7f0-7524460a6953 tempest-VolumesGetTest-784082675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:18:00 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-20eb8dce-e5e4-4ec8-a7f0-7524460a6953 tempest-VolumesGetTest-784082675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:18:00 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-20eb8dce-e5e4-4ec8-a7f0-7524460a6953 tempest-VolumesGetTest-784082675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:18:00 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-20eb8dce-e5e4-4ec8-a7f0-7524460a6953 tempest-VolumesGetTest-784082675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:18:00 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-20eb8dce-e5e4-4ec8-a7f0-7524460a6953 tempest-VolumesGetTest-784082675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:00 devstack sudo[94693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:18:00 devstack sudo[94693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:00 devstack sudo[94693]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:00 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-20eb8dce-e5e4-4ec8-a7f0-7524460a6953 tempest-VolumesGetTest-784082675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.257s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:00 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-20eb8dce-e5e4-4ec8-a7f0-7524460a6953 tempest-VolumesGetTest-784082675 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:18:00 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-20eb8dce-e5e4-4ec8-a7f0-7524460a6953 tempest-VolumesGetTest-784082675 None] Deleted volume successfully. Aug 05 10:18:01 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-20eb8dce-e5e4-4ec8-a7f0-7524460a6953 tempest-VolumesGetTest-784082675 None] Lock "cinder-02c98207-5c67-4ba4-929e-6d9fba9a4bd8-delete_volume" released by "delete_volume" :: held 1.101s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:18:01 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce46634a-0508-4679-ba3d-fdcd1278e39b tempest-VolumesGetTest-784082675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:18:01 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ce46634a-0508-4679-ba3d-fdcd1278e39b tempest-VolumesGetTest-784082675 None] Flow 'volume_create_manager' (caf54e73-2e38-4fa7-99ef-4fad92a6612c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:18:01 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ce46634a-0508-4679-ba3d-fdcd1278e39b tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4a79df4-c76c-4a52-8152-38c84d320546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:18:01 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ce46634a-0508-4679-ba3d-fdcd1278e39b tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4a79df4-c76c-4a52-8152-38c84d320546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:18:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1758980834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7354f17-87a6-4fbf-a8b3-49e291f7da84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a06c5d00bd44107a18e7ae90e338bde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:18:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:18:01Z,use_quota=True,user_id='02afcf118fdd4d2c9432655c62cfcfaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:18:01 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ce46634a-0508-4679-ba3d-fdcd1278e39b tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b743850-3586-447d-ac88-1d0f3e43a048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:18:01 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ce46634a-0508-4679-ba3d-fdcd1278e39b tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b743850-3586-447d-ac88-1d0f3e43a048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:18:01 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ce46634a-0508-4679-ba3d-fdcd1278e39b tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b634aeab-c12c-49a0-b662-0174aca07c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:18:01 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ce46634a-0508-4679-ba3d-fdcd1278e39b tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b634aeab-c12c-49a0-b662-0174aca07c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7354f17-87a6-4fbf-a8b3-49e291f7da84', 'volume_name': 'volume-e7354f17-87a6-4fbf-a8b3-49e291f7da84', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:18:01 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ce46634a-0508-4679-ba3d-fdcd1278e39b tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5427bc43-5391-43dc-a82e-2e08661a8b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:18:01 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ce46634a-0508-4679-ba3d-fdcd1278e39b tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5427bc43-5391-43dc-a82e-2e08661a8b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:18:01 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ce46634a-0508-4679-ba3d-fdcd1278e39b tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bed90adc-673d-411b-a4ac-f4f652a1882c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:18:01 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-ce46634a-0508-4679-ba3d-fdcd1278e39b tempest-VolumesGetTest-784082675 None] Volume e7354f17-87a6-4fbf-a8b3-49e291f7da84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7354f17-87a6-4fbf-a8b3-49e291f7da84', 'volume_size': 1} Aug 05 10:18:01 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-ce46634a-0508-4679-ba3d-fdcd1278e39b tempest-VolumesGetTest-784082675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:18:01 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-ce46634a-0508-4679-ba3d-fdcd1278e39b tempest-VolumesGetTest-784082675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:18:01 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-ce46634a-0508-4679-ba3d-fdcd1278e39b tempest-VolumesGetTest-784082675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:18:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1758980834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7354f17-87a6-4fbf-a8b3-49e291f7da84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a06c5d00bd44107a18e7ae90e338bde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:18:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:18:01Z,use_quota=True,user_id='02afcf118fdd4d2c9432655c62cfcfaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:18:01 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-ce46634a-0508-4679-ba3d-fdcd1278e39b tempest-VolumesGetTest-784082675 None] Creating volume e7354f17-87a6-4fbf-a8b3-49e291f7da84 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:18:01 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-ce46634a-0508-4679-ba3d-fdcd1278e39b tempest-VolumesGetTest-784082675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:18:01 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-ce46634a-0508-4679-ba3d-fdcd1278e39b tempest-VolumesGetTest-784082675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:18:01 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-ce46634a-0508-4679-ba3d-fdcd1278e39b tempest-VolumesGetTest-784082675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:18:01 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-ce46634a-0508-4679-ba3d-fdcd1278e39b tempest-VolumesGetTest-784082675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:18:01 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-ce46634a-0508-4679-ba3d-fdcd1278e39b tempest-VolumesGetTest-784082675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:18:01 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-ce46634a-0508-4679-ba3d-fdcd1278e39b tempest-VolumesGetTest-784082675 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:18:01 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-ce46634a-0508-4679-ba3d-fdcd1278e39b tempest-VolumesGetTest-784082675 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:18:01 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ce46634a-0508-4679-ba3d-fdcd1278e39b tempest-VolumesGetTest-784082675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e7354f17-87a6-4fbf-a8b3-49e291f7da84 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:01 devstack sudo[94696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e7354f17-87a6-4fbf-a8b3-49e291f7da84 1073741824 Aug 05 10:18:01 devstack sudo[94696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:02 devstack sudo[94696]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:02 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ce46634a-0508-4679-ba3d-fdcd1278e39b tempest-VolumesGetTest-784082675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e7354f17-87a6-4fbf-a8b3-49e291f7da84 1073741824" returned: 0 in 0.420s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:02 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ce46634a-0508-4679-ba3d-fdcd1278e39b tempest-VolumesGetTest-784082675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e7354f17-87a6-4fbf-a8b3-49e291f7da84 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:02 devstack sudo[94706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e7354f17-87a6-4fbf-a8b3-49e291f7da84 Aug 05 10:18:02 devstack sudo[94706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:02 devstack sudo[94706]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:02 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ce46634a-0508-4679-ba3d-fdcd1278e39b tempest-VolumesGetTest-784082675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e7354f17-87a6-4fbf-a8b3-49e291f7da84" returned: 0 in 0.268s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:02 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-ce46634a-0508-4679-ba3d-fdcd1278e39b tempest-VolumesGetTest-784082675 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:18:02 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-ce46634a-0508-4679-ba3d-fdcd1278e39b tempest-VolumesGetTest-784082675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:18:02 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ce46634a-0508-4679-ba3d-fdcd1278e39b tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bed90adc-673d-411b-a4ac-f4f652a1882c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7354f17-87a6-4fbf-a8b3-49e291f7da84', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:18:02 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ce46634a-0508-4679-ba3d-fdcd1278e39b tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b172d83-c3da-4d74-818e-6943dabf8bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:18:02 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-ce46634a-0508-4679-ba3d-fdcd1278e39b tempest-VolumesGetTest-784082675 None] Volume volume-e7354f17-87a6-4fbf-a8b3-49e291f7da84 (e7354f17-87a6-4fbf-a8b3-49e291f7da84): created successfully Aug 05 10:18:02 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ce46634a-0508-4679-ba3d-fdcd1278e39b tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b172d83-c3da-4d74-818e-6943dabf8bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:18:02 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ce46634a-0508-4679-ba3d-fdcd1278e39b tempest-VolumesGetTest-784082675 None] Flow 'volume_create_manager' (caf54e73-2e38-4fa7-99ef-4fad92a6612c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:18:02 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-ce46634a-0508-4679-ba3d-fdcd1278e39b tempest-VolumesGetTest-784082675 None] Created volume successfully. Aug 05 10:18:02 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-52a90dd8-326c-40cb-b051-1a815233b9d7 tempest-AttachVolumeNegativeTest-1387927917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:18:02 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-52a90dd8-326c-40cb-b051-1a815233b9d7 tempest-AttachVolumeNegativeTest-1387927917 None] Flow 'volume_create_manager' (d9db21c0-ce6b-457f-9f5a-19da21cbd0ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:18:02 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-52a90dd8-326c-40cb-b051-1a815233b9d7 tempest-AttachVolumeNegativeTest-1387927917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56fc4d23-ea40-4e8b-8bad-1e608fa79de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:18:02 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-52a90dd8-326c-40cb-b051-1a815233b9d7 tempest-AttachVolumeNegativeTest-1387927917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56fc4d23-ea40-4e8b-8bad-1e608fa79de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:18:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1258617999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1d3a323-e9a3-40ed-b11d-0b315da9d2e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48672fc3cb8343618f2d2cd36237f130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:18:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:18:03Z,use_quota=True,user_id='47c1b556a85a4368a09d710fff39d27c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:18:02 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-52a90dd8-326c-40cb-b051-1a815233b9d7 tempest-AttachVolumeNegativeTest-1387927917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8627d8a0-6e43-4497-9fae-efba78b0b450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:18:02 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-52a90dd8-326c-40cb-b051-1a815233b9d7 tempest-AttachVolumeNegativeTest-1387927917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8627d8a0-6e43-4497-9fae-efba78b0b450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:18:02 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-52a90dd8-326c-40cb-b051-1a815233b9d7 tempest-AttachVolumeNegativeTest-1387927917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40e5aa71-b69a-45e7-b1ab-dfd33f087f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:18:02 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-52a90dd8-326c-40cb-b051-1a815233b9d7 tempest-AttachVolumeNegativeTest-1387927917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40e5aa71-b69a-45e7-b1ab-dfd33f087f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1d3a323-e9a3-40ed-b11d-0b315da9d2e8', 'volume_name': 'volume-f1d3a323-e9a3-40ed-b11d-0b315da9d2e8', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:18:02 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-52a90dd8-326c-40cb-b051-1a815233b9d7 tempest-AttachVolumeNegativeTest-1387927917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c57a86e6-459e-4623-bbfd-36118ff02e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:18:02 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-52a90dd8-326c-40cb-b051-1a815233b9d7 tempest-AttachVolumeNegativeTest-1387927917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c57a86e6-459e-4623-bbfd-36118ff02e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:18:03 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-52a90dd8-326c-40cb-b051-1a815233b9d7 tempest-AttachVolumeNegativeTest-1387927917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25768432-fb75-4bc5-afd2-79817c40944b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:18:03 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-52a90dd8-326c-40cb-b051-1a815233b9d7 tempest-AttachVolumeNegativeTest-1387927917 None] Volume f1d3a323-e9a3-40ed-b11d-0b315da9d2e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1d3a323-e9a3-40ed-b11d-0b315da9d2e8', 'volume_size': 1} Aug 05 10:18:03 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-52a90dd8-326c-40cb-b051-1a815233b9d7 tempest-AttachVolumeNegativeTest-1387927917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:18:03 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-52a90dd8-326c-40cb-b051-1a815233b9d7 tempest-AttachVolumeNegativeTest-1387927917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:18:03 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-52a90dd8-326c-40cb-b051-1a815233b9d7 tempest-AttachVolumeNegativeTest-1387927917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:18:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1258617999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1d3a323-e9a3-40ed-b11d-0b315da9d2e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48672fc3cb8343618f2d2cd36237f130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:18:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:18:03Z,use_quota=True,user_id='47c1b556a85a4368a09d710fff39d27c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:18:03 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-52a90dd8-326c-40cb-b051-1a815233b9d7 tempest-AttachVolumeNegativeTest-1387927917 None] Creating volume f1d3a323-e9a3-40ed-b11d-0b315da9d2e8 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:18:03 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-52a90dd8-326c-40cb-b051-1a815233b9d7 tempest-AttachVolumeNegativeTest-1387927917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:18:03 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-52a90dd8-326c-40cb-b051-1a815233b9d7 tempest-AttachVolumeNegativeTest-1387927917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:18:03 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-52a90dd8-326c-40cb-b051-1a815233b9d7 tempest-AttachVolumeNegativeTest-1387927917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:18:03 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-52a90dd8-326c-40cb-b051-1a815233b9d7 tempest-AttachVolumeNegativeTest-1387927917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:18:03 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-52a90dd8-326c-40cb-b051-1a815233b9d7 tempest-AttachVolumeNegativeTest-1387927917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:18:03 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-52a90dd8-326c-40cb-b051-1a815233b9d7 tempest-AttachVolumeNegativeTest-1387927917 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:18:03 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-52a90dd8-326c-40cb-b051-1a815233b9d7 tempest-AttachVolumeNegativeTest-1387927917 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:18:03 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-52a90dd8-326c-40cb-b051-1a815233b9d7 tempest-AttachVolumeNegativeTest-1387927917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f1d3a323-e9a3-40ed-b11d-0b315da9d2e8 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:03 devstack sudo[94714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f1d3a323-e9a3-40ed-b11d-0b315da9d2e8 1073741824 Aug 05 10:18:03 devstack sudo[94714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:03 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b201412-064f-46af-af0e-df119b52c37f tempest-VolumesGetTest-784082675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:18:03 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-4b201412-064f-46af-af0e-df119b52c37f tempest-VolumesGetTest-784082675 None] Flow 'volume_create_manager' (86cda484-5669-4c45-a96d-fd3a35687870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:18:03 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-4b201412-064f-46af-af0e-df119b52c37f tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9984c1a-f4e8-4ac9-bf6a-d3486d5bb577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:18:03 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-4b201412-064f-46af-af0e-df119b52c37f tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9984c1a-f4e8-4ac9-bf6a-d3486d5bb577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:18:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-625964025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3d91b1f-6828-4e36-9fc4-bab0a3a0a78c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6a06c5d00bd44107a18e7ae90e338bde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:18:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=e7354f17-87a6-4fbf-a8b3-49e291f7da84,status='creating',terminated_at=None,updated_at=2026-08-05T08:18:03Z,use_quota=True,user_id='02afcf118fdd4d2c9432655c62cfcfaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:18:03 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-4b201412-064f-46af-af0e-df119b52c37f tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11cef519-67cc-4ea1-811d-7f3cc27459db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:18:03 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-4b201412-064f-46af-af0e-df119b52c37f tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11cef519-67cc-4ea1-811d-7f3cc27459db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:18:03 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-4b201412-064f-46af-af0e-df119b52c37f tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f68f275c-a8ba-4ab0-b497-4f96b597731e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:18:03 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-4b201412-064f-46af-af0e-df119b52c37f tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f68f275c-a8ba-4ab0-b497-4f96b597731e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'a3d91b1f-6828-4e36-9fc4-bab0a3a0a78c', 'volume_name': 'volume-a3d91b1f-6828-4e36-9fc4-bab0a3a0a78c', 'volume_size': 1, 'source_volid': 'e7354f17-87a6-4fbf-a8b3-49e291f7da84', 'source_volstatus': 'available'}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:18:03 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-4b201412-064f-46af-af0e-df119b52c37f tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25df2446-5ac5-4152-a997-9d53b5793075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:18:03 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-4b201412-064f-46af-af0e-df119b52c37f tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25df2446-5ac5-4152-a997-9d53b5793075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:18:03 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-4b201412-064f-46af-af0e-df119b52c37f tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f828047-d786-4e60-bbc3-cad8b507a6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:18:03 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-4b201412-064f-46af-af0e-df119b52c37f tempest-VolumesGetTest-784082675 None] Volume a3d91b1f-6828-4e36-9fc4-bab0a3a0a78c: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-a3d91b1f-6828-4e36-9fc4-bab0a3a0a78c', 'volume_size': 1, 'source_volid': 'e7354f17-87a6-4fbf-a8b3-49e291f7da84', 'source_volstatus': 'available'} Aug 05 10:18:03 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-4b201412-064f-46af-af0e-df119b52c37f tempest-VolumesGetTest-784082675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:18:03 devstack sudo[94714]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:03 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-52a90dd8-326c-40cb-b051-1a815233b9d7 tempest-AttachVolumeNegativeTest-1387927917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f1d3a323-e9a3-40ed-b11d-0b315da9d2e8 1073741824" returned: 0 in 0.632s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:03 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-52a90dd8-326c-40cb-b051-1a815233b9d7 tempest-AttachVolumeNegativeTest-1387927917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f1d3a323-e9a3-40ed-b11d-0b315da9d2e8 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:03 devstack sudo[94726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f1d3a323-e9a3-40ed-b11d-0b315da9d2e8 Aug 05 10:18:03 devstack sudo[94726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:04 devstack sudo[94726]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-52a90dd8-326c-40cb-b051-1a815233b9d7 tempest-AttachVolumeNegativeTest-1387927917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f1d3a323-e9a3-40ed-b11d-0b315da9d2e8" returned: 0 in 0.489s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:04 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-52a90dd8-326c-40cb-b051-1a815233b9d7 tempest-AttachVolumeNegativeTest-1387927917 None] <== create_volume: return (1177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:18:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-52a90dd8-326c-40cb-b051-1a815233b9d7 tempest-AttachVolumeNegativeTest-1387927917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:18:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-4b201412-064f-46af-af0e-df119b52c37f tempest-VolumesGetTest-784082675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.639s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:18:04 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-4b201412-064f-46af-af0e-df119b52c37f tempest-VolumesGetTest-784082675 None] Cloning volume e7354f17-87a6-4fbf-a8b3-49e291f7da84 to volume a3d91b1f-6828-4e36-9fc4-bab0a3a0a78c Aug 05 10:18:04 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-52a90dd8-326c-40cb-b051-1a815233b9d7 tempest-AttachVolumeNegativeTest-1387927917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25768432-fb75-4bc5-afd2-79817c40944b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1d3a323-e9a3-40ed-b11d-0b315da9d2e8', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:18:04 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-52a90dd8-326c-40cb-b051-1a815233b9d7 tempest-AttachVolumeNegativeTest-1387927917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1623eb0d-ad67-4ade-8370-52a9c3762af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:18:04 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-52a90dd8-326c-40cb-b051-1a815233b9d7 tempest-AttachVolumeNegativeTest-1387927917 None] Volume volume-f1d3a323-e9a3-40ed-b11d-0b315da9d2e8 (f1d3a323-e9a3-40ed-b11d-0b315da9d2e8): created successfully Aug 05 10:18:04 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-52a90dd8-326c-40cb-b051-1a815233b9d7 tempest-AttachVolumeNegativeTest-1387927917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1623eb0d-ad67-4ade-8370-52a9c3762af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:18:04 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-52a90dd8-326c-40cb-b051-1a815233b9d7 tempest-AttachVolumeNegativeTest-1387927917 None] Flow 'volume_create_manager' (d9db21c0-ce6b-457f-9f5a-19da21cbd0ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:18:04 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-4b201412-064f-46af-af0e-df119b52c37f tempest-VolumesGetTest-784082675 None] Creating offline snapshot f63f9352-3d8a-47cc-87f6-bb1ea97c8b91 of volume e7354f17-87a6-4fbf-a8b3-49e291f7da84 {{(pid=88613) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:18:04 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-52a90dd8-326c-40cb-b051-1a815233b9d7 tempest-AttachVolumeNegativeTest-1387927917 None] Created volume successfully. Aug 05 10:18:04 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[2955440c-3050-482b-98c3-490481d68d1b]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:18:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4b201412-064f-46af-af0e-df119b52c37f tempest-VolumesGetTest-784082675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e7354f17-87a6-4fbf-a8b3-49e291f7da84 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:04 devstack sudo[94750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e7354f17-87a6-4fbf-a8b3-49e291f7da84 Aug 05 10:18:04 devstack sudo[94750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:04 devstack sudo[94750]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4b201412-064f-46af-af0e-df119b52c37f tempest-VolumesGetTest-784082675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e7354f17-87a6-4fbf-a8b3-49e291f7da84" returned: 0 in 0.437s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4b201412-064f-46af-af0e-df119b52c37f tempest-VolumesGetTest-784082675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e7354f17-87a6-4fbf-a8b3-49e291f7da84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e7354f17-87a6-4fbf-a8b3-49e291f7da84.f63f9352-3d8a-47cc-87f6-bb1ea97c8b91 1G {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:04 devstack sudo[94756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e7354f17-87a6-4fbf-a8b3-49e291f7da84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e7354f17-87a6-4fbf-a8b3-49e291f7da84.f63f9352-3d8a-47cc-87f6-bb1ea97c8b91 1G Aug 05 10:18:04 devstack sudo[94756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:05 devstack sudo[94756]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:05 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4b201412-064f-46af-af0e-df119b52c37f tempest-VolumesGetTest-784082675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e7354f17-87a6-4fbf-a8b3-49e291f7da84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e7354f17-87a6-4fbf-a8b3-49e291f7da84.f63f9352-3d8a-47cc-87f6-bb1ea97c8b91 1G" returned: 0 in 0.517s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:05 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4b201412-064f-46af-af0e-df119b52c37f tempest-VolumesGetTest-784082675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7354f17-87a6-4fbf-a8b3-49e291f7da84 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e7354f17-87a6-4fbf-a8b3-49e291f7da84.f63f9352-3d8a-47cc-87f6-bb1ea97c8b91 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:05 devstack sudo[94767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7354f17-87a6-4fbf-a8b3-49e291f7da84 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e7354f17-87a6-4fbf-a8b3-49e291f7da84.f63f9352-3d8a-47cc-87f6-bb1ea97c8b91 Aug 05 10:18:05 devstack sudo[94767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:05 devstack cinder-volume[88613]: INFO cinder.volume.manager [req-87d59348-a11e-4485-b8ed-acb26db9476b req-1f7e5ad5-295a-4742-8acb-b422610b692c tempest-ServerActionsTestOtherA-221436279 None] Terminate volume connection completed successfully. Aug 05 10:18:05 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [req-87d59348-a11e-4485-b8ed-acb26db9476b req-1f7e5ad5-295a-4742-8acb-b422610b692c tempest-ServerActionsTestOtherA-221436279 None] Deleting attachment 842a861c-285c-4952-9253-a70c33da3b80. {{(pid=88613) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 10:18:05 devstack sudo[94767]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:05 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4b201412-064f-46af-af0e-df119b52c37f tempest-VolumesGetTest-784082675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7354f17-87a6-4fbf-a8b3-49e291f7da84 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e7354f17-87a6-4fbf-a8b3-49e291f7da84.f63f9352-3d8a-47cc-87f6-bb1ea97c8b91" returned: 0 in 0.643s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:05 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-4b201412-064f-46af-af0e-df119b52c37f tempest-VolumesGetTest-784082675 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e7354f17-87a6-4fbf-a8b3-49e291f7da84.f63f9352-3d8a-47cc-87f6-bb1ea97c8b91 is being set with open permissions: ugo+rw Aug 05 10:18:05 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4b201412-064f-46af-af0e-df119b52c37f tempest-VolumesGetTest-784082675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e7354f17-87a6-4fbf-a8b3-49e291f7da84.f63f9352-3d8a-47cc-87f6-bb1ea97c8b91 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:05 devstack sudo[94776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e7354f17-87a6-4fbf-a8b3-49e291f7da84.f63f9352-3d8a-47cc-87f6-bb1ea97c8b91 Aug 05 10:18:05 devstack sudo[94776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:05 devstack cinder-volume[88613]: DEBUG cinder.coordination [req-87d59348-a11e-4485-b8ed-acb26db9476b req-1ee615d4-5d0c-4f9b-9415-6f0f809dbe1b tempest-ServerActionsTestOtherA-221436279 None] Acquiring lock "cinder-c9825d6b-f9aa-4743-9e57-160fb8860b66-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:18:05 devstack cinder-volume[88613]: DEBUG cinder.coordination [req-87d59348-a11e-4485-b8ed-acb26db9476b req-1ee615d4-5d0c-4f9b-9415-6f0f809dbe1b tempest-ServerActionsTestOtherA-221436279 None] Lock "cinder-c9825d6b-f9aa-4743-9e57-160fb8860b66-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:18:06 devstack cinder-volume[88613]: DEBUG cinder.coordination [req-87d59348-a11e-4485-b8ed-acb26db9476b req-1ee615d4-5d0c-4f9b-9415-6f0f809dbe1b tempest-ServerActionsTestOtherA-221436279 None] Acquiring lock "cinder-quobyte-c9825d6b-f9aa-4743-9e57-160fb8860b66" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:18:06 devstack cinder-volume[88613]: DEBUG cinder.coordination [req-87d59348-a11e-4485-b8ed-acb26db9476b req-1ee615d4-5d0c-4f9b-9415-6f0f809dbe1b tempest-ServerActionsTestOtherA-221436279 None] Lock "cinder-quobyte-c9825d6b-f9aa-4743-9e57-160fb8860b66" acquired by "delete_volume" :: waited 0.027s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:18:06 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff272774-d6c0-4620-b5dd-1fe7a5cd260b]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:18:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [req-87d59348-a11e-4485-b8ed-acb26db9476b req-1ee615d4-5d0c-4f9b-9415-6f0f809dbe1b tempest-ServerActionsTestOtherA-221436279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-c9825d6b-f9aa-4743-9e57-160fb8860b66 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:06 devstack sudo[94780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-c9825d6b-f9aa-4743-9e57-160fb8860b66 Aug 05 10:18:06 devstack sudo[94780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:06 devstack sudo[94776]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4b201412-064f-46af-af0e-df119b52c37f tempest-VolumesGetTest-784082675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e7354f17-87a6-4fbf-a8b3-49e291f7da84.f63f9352-3d8a-47cc-87f6-bb1ea97c8b91" returned: 0 in 0.363s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4b201412-064f-46af-af0e-df119b52c37f tempest-VolumesGetTest-784082675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e7354f17-87a6-4fbf-a8b3-49e291f7da84.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:06 devstack sudo[94789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e7354f17-87a6-4fbf-a8b3-49e291f7da84.info Aug 05 10:18:06 devstack sudo[94789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-243604fc-e700-490d-bb46-c91502ed434f req-c025cd8d-ebb0-4182-9b77-ed8f7309f113 tempest-AttachVolumeNegativeTest-1387927917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:18:06 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9ee1322-5302-4af4-8a78-76a40b775d79 tempest-AttachVolumeTestJSON-1120766613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:18:06 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-f9ee1322-5302-4af4-8a78-76a40b775d79 tempest-AttachVolumeTestJSON-1120766613 None] Flow 'volume_create_manager' (48708483-31aa-47b6-9840-40e167bd0227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:18:06 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-f9ee1322-5302-4af4-8a78-76a40b775d79 tempest-AttachVolumeTestJSON-1120766613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6feade1f-12f9-4887-b67c-c336edf4a1e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:18:06 devstack sudo[94789]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:06 devstack sudo[94780]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:06 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-f9ee1322-5302-4af4-8a78-76a40b775d79 tempest-AttachVolumeTestJSON-1120766613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6feade1f-12f9-4887-b67c-c336edf4a1e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:18:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1499318080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67b1103e-ece4-434f-b02f-ff3a651fe7d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55529e6fbfcc43c0b801e40e5d45472b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:18:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:18:07Z,use_quota=True,user_id='6a036a34de9d430b811b79242ff7f101',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:18:06 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-f9ee1322-5302-4af4-8a78-76a40b775d79 tempest-AttachVolumeTestJSON-1120766613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (289b2b3c-39f9-4a88-a2e3-44d6a8ad9ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:18:06 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-f9ee1322-5302-4af4-8a78-76a40b775d79 tempest-AttachVolumeTestJSON-1120766613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (289b2b3c-39f9-4a88-a2e3-44d6a8ad9ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:18:06 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-f9ee1322-5302-4af4-8a78-76a40b775d79 tempest-AttachVolumeTestJSON-1120766613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (770d9c50-96ca-42d8-a36e-ec3872d6753c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:18:06 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-f9ee1322-5302-4af4-8a78-76a40b775d79 tempest-AttachVolumeTestJSON-1120766613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (770d9c50-96ca-42d8-a36e-ec3872d6753c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67b1103e-ece4-434f-b02f-ff3a651fe7d3', 'volume_name': 'volume-67b1103e-ece4-434f-b02f-ff3a651fe7d3', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:18:06 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-f9ee1322-5302-4af4-8a78-76a40b775d79 tempest-AttachVolumeTestJSON-1120766613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22d56eef-e037-4f4f-a23e-2d25a409ef1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:18:06 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-f9ee1322-5302-4af4-8a78-76a40b775d79 tempest-AttachVolumeTestJSON-1120766613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22d56eef-e037-4f4f-a23e-2d25a409ef1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:18:06 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-f9ee1322-5302-4af4-8a78-76a40b775d79 tempest-AttachVolumeTestJSON-1120766613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77e40a74-f668-48f8-aa75-3b6fe5d56d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:18:06 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-f9ee1322-5302-4af4-8a78-76a40b775d79 tempest-AttachVolumeTestJSON-1120766613 None] Volume 67b1103e-ece4-434f-b02f-ff3a651fe7d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67b1103e-ece4-434f-b02f-ff3a651fe7d3', 'volume_size': 1} Aug 05 10:18:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-f9ee1322-5302-4af4-8a78-76a40b775d79 tempest-AttachVolumeTestJSON-1120766613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:18:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4b201412-064f-46af-af0e-df119b52c37f tempest-VolumesGetTest-784082675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e7354f17-87a6-4fbf-a8b3-49e291f7da84.info" returned: 0 in 0.358s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:06 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-4b201412-064f-46af-af0e-df119b52c37f tempest-VolumesGetTest-784082675 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e7354f17-87a6-4fbf-a8b3-49e291f7da84.info is being set with open permissions: ugo+rw Aug 05 10:18:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4b201412-064f-46af-af0e-df119b52c37f tempest-VolumesGetTest-784082675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e7354f17-87a6-4fbf-a8b3-49e291f7da84.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [req-87d59348-a11e-4485-b8ed-acb26db9476b req-1ee615d4-5d0c-4f9b-9415-6f0f809dbe1b tempest-ServerActionsTestOtherA-221436279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-c9825d6b-f9aa-4743-9e57-160fb8860b66" returned: 0 in 0.595s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [req-87d59348-a11e-4485-b8ed-acb26db9476b req-1ee615d4-5d0c-4f9b-9415-6f0f809dbe1b tempest-ServerActionsTestOtherA-221436279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-c9825d6b-f9aa-4743-9e57-160fb8860b66 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:06 devstack sudo[94795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e7354f17-87a6-4fbf-a8b3-49e291f7da84.info Aug 05 10:18:06 devstack sudo[94795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:06 devstack sudo[94796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-c9825d6b-f9aa-4743-9e57-160fb8860b66 Aug 05 10:18:06 devstack sudo[94796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:06 devstack sudo[94795]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4b201412-064f-46af-af0e-df119b52c37f tempest-VolumesGetTest-784082675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e7354f17-87a6-4fbf-a8b3-49e291f7da84.info" returned: 0 in 0.273s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:06 devstack sudo[94796]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:06 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-4b201412-064f-46af-af0e-df119b52c37f tempest-VolumesGetTest-784082675 None] Acquiring lock "cinder-quobyte-a3d91b1f-6828-4e36-9fc4-bab0a3a0a78c" by "_copy_volume_from_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:18:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [req-87d59348-a11e-4485-b8ed-acb26db9476b req-1ee615d4-5d0c-4f9b-9415-6f0f809dbe1b tempest-ServerActionsTestOtherA-221436279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-c9825d6b-f9aa-4743-9e57-160fb8860b66" returned: 0 in 0.292s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:07 devstack cinder-volume[88613]: DEBUG cinder.coordination [req-87d59348-a11e-4485-b8ed-acb26db9476b req-1ee615d4-5d0c-4f9b-9415-6f0f809dbe1b tempest-ServerActionsTestOtherA-221436279 None] Lock "cinder-quobyte-c9825d6b-f9aa-4743-9e57-160fb8860b66" released by "delete_volume" :: held 0.948s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:18:07 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-4b201412-064f-46af-af0e-df119b52c37f tempest-VolumesGetTest-784082675 None] Lock "cinder-quobyte-a3d91b1f-6828-4e36-9fc4-bab0a3a0a78c" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:18:07 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-4b201412-064f-46af-af0e-df119b52c37f tempest-VolumesGetTest-784082675 None] snapshot: f63f9352-3d8a-47cc-87f6-bb1ea97c8b91, volume: a3d91b1f-6828-4e36-9fc4-bab0a3a0a78c, {{(pid=88613) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 05 10:18:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-4b201412-064f-46af-af0e-df119b52c37f tempest-VolumesGetTest-784082675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:18:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-4b201412-064f-46af-af0e-df119b52c37f tempest-VolumesGetTest-784082675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:18:07 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-4b201412-064f-46af-af0e-df119b52c37f tempest-VolumesGetTest-784082675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:18:07 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-4b201412-064f-46af-af0e-df119b52c37f tempest-VolumesGetTest-784082675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:18:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-4b201412-064f-46af-af0e-df119b52c37f tempest-VolumesGetTest-784082675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:18:07 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f1959a-c8b0-484d-8243-79ac670fdaa5]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:18:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4b201412-064f-46af-af0e-df119b52c37f tempest-VolumesGetTest-784082675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e7354f17-87a6-4fbf-a8b3-49e291f7da84.f63f9352-3d8a-47cc-87f6-bb1ea97c8b91 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:07 devstack cinder-volume[88613]: DEBUG cinder.quota [req-87d59348-a11e-4485-b8ed-acb26db9476b req-1ee615d4-5d0c-4f9b-9415-6f0f809dbe1b tempest-ServerActionsTestOtherA-221436279 None] Created reservations ['29d093c1-148e-4942-a6ec-aa801e087f0a', 'dee5c1b9-57ff-44b5-b825-2b5424381e5a', '9c1135a9-c0fd-4e93-ae37-9995a4b680cb', 'b412aaea-7d07-413b-b3e1-81d6cebe35ad'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:18:07 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-951cb258-1d96-4f78-9fc8-7adec4cbb836 tempest-ServerActionsTestOtherA-221436279 None] Acquiring lock "cinder-7c2702d5-1ec9-441b-b550-a2b8ae9ab27f-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:18:07 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-951cb258-1d96-4f78-9fc8-7adec4cbb836 tempest-ServerActionsTestOtherA-221436279 None] Lock "cinder-7c2702d5-1ec9-441b-b550-a2b8ae9ab27f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:18:07 devstack sudo[94807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e7354f17-87a6-4fbf-a8b3-49e291f7da84.f63f9352-3d8a-47cc-87f6-bb1ea97c8b91 Aug 05 10:18:07 devstack sudo[94807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-87d59348-a11e-4485-b8ed-acb26db9476b req-1ee615d4-5d0c-4f9b-9415-6f0f809dbe1b tempest-ServerActionsTestOtherA-221436279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:18:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-87d59348-a11e-4485-b8ed-acb26db9476b req-1ee615d4-5d0c-4f9b-9415-6f0f809dbe1b tempest-ServerActionsTestOtherA-221436279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:18:07 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [req-87d59348-a11e-4485-b8ed-acb26db9476b req-1ee615d4-5d0c-4f9b-9415-6f0f809dbe1b tempest-ServerActionsTestOtherA-221436279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:18:07 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [req-87d59348-a11e-4485-b8ed-acb26db9476b req-1ee615d4-5d0c-4f9b-9415-6f0f809dbe1b tempest-ServerActionsTestOtherA-221436279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:18:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-87d59348-a11e-4485-b8ed-acb26db9476b req-1ee615d4-5d0c-4f9b-9415-6f0f809dbe1b tempest-ServerActionsTestOtherA-221436279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:18:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [req-87d59348-a11e-4485-b8ed-acb26db9476b req-1ee615d4-5d0c-4f9b-9415-6f0f809dbe1b tempest-ServerActionsTestOtherA-221436279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:07 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-951cb258-1d96-4f78-9fc8-7adec4cbb836 tempest-ServerActionsTestOtherA-221436279 None] Acquiring lock "cinder-quobyte-7c2702d5-1ec9-441b-b550-a2b8ae9ab27f" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:18:07 devstack sudo[94809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:18:07 devstack sudo[94809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:07 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-951cb258-1d96-4f78-9fc8-7adec4cbb836 tempest-ServerActionsTestOtherA-221436279 None] Lock "cinder-quobyte-7c2702d5-1ec9-441b-b550-a2b8ae9ab27f" acquired by "delete_volume" :: waited 0.021s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:18:07 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e2db4ac-b65f-4446-bb7c-036eb753f64d]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:18:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-951cb258-1d96-4f78-9fc8-7adec4cbb836 tempest-ServerActionsTestOtherA-221436279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7c2702d5-1ec9-441b-b550-a2b8ae9ab27f {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:07 devstack sudo[94811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7c2702d5-1ec9-441b-b550-a2b8ae9ab27f Aug 05 10:18:07 devstack sudo[94811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:07 devstack sudo[94807]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4b201412-064f-46af-af0e-df119b52c37f tempest-VolumesGetTest-784082675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e7354f17-87a6-4fbf-a8b3-49e291f7da84.f63f9352-3d8a-47cc-87f6-bb1ea97c8b91" returned: 0 in 0.368s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:07 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-4b201412-064f-46af-af0e-df119b52c37f tempest-VolumesGetTest-784082675 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7354f17-87a6-4fbf-a8b3-49e291f7da84(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88613) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:18:07 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb4d8f2-4bc6-4820-83b5-181f251da4f1]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:18:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4b201412-064f-46af-af0e-df119b52c37f tempest-VolumesGetTest-784082675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e7354f17-87a6-4fbf-a8b3-49e291f7da84 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:07 devstack sudo[94809]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [req-87d59348-a11e-4485-b8ed-acb26db9476b req-1ee615d4-5d0c-4f9b-9415-6f0f809dbe1b tempest-ServerActionsTestOtherA-221436279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.259s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:07 devstack cinder-volume[88613]: DEBUG cinder.manager [req-87d59348-a11e-4485-b8ed-acb26db9476b req-1ee615d4-5d0c-4f9b-9415-6f0f809dbe1b tempest-ServerActionsTestOtherA-221436279 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:18:07 devstack cinder-volume[88613]: INFO cinder.volume.manager [req-87d59348-a11e-4485-b8ed-acb26db9476b req-1ee615d4-5d0c-4f9b-9415-6f0f809dbe1b tempest-ServerActionsTestOtherA-221436279 None] Deleted volume successfully. Aug 05 10:18:07 devstack cinder-volume[88613]: DEBUG cinder.coordination [req-87d59348-a11e-4485-b8ed-acb26db9476b req-1ee615d4-5d0c-4f9b-9415-6f0f809dbe1b tempest-ServerActionsTestOtherA-221436279 None] Lock "cinder-c9825d6b-f9aa-4743-9e57-160fb8860b66-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:18:07 devstack sudo[94817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e7354f17-87a6-4fbf-a8b3-49e291f7da84 Aug 05 10:18:07 devstack sudo[94817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:07 devstack sudo[94811]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-951cb258-1d96-4f78-9fc8-7adec4cbb836 tempest-ServerActionsTestOtherA-221436279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7c2702d5-1ec9-441b-b550-a2b8ae9ab27f" returned: 0 in 0.389s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-951cb258-1d96-4f78-9fc8-7adec4cbb836 tempest-ServerActionsTestOtherA-221436279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7c2702d5-1ec9-441b-b550-a2b8ae9ab27f {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:07 devstack sudo[94822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7c2702d5-1ec9-441b-b550-a2b8ae9ab27f Aug 05 10:18:07 devstack sudo[94822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:07 devstack sudo[94817]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4b201412-064f-46af-af0e-df119b52c37f tempest-VolumesGetTest-784082675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e7354f17-87a6-4fbf-a8b3-49e291f7da84" returned: 0 in 0.401s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:07 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-4b201412-064f-46af-af0e-df119b52c37f tempest-VolumesGetTest-784082675 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e7354f17-87a6-4fbf-a8b3-49e291f7da84 {{(pid=88613) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 05 10:18:07 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-4b201412-064f-46af-af0e-df119b52c37f tempest-VolumesGetTest-784082675 None] Creating direct copy from snapshot {{(pid=88613) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 05 10:18:07 devstack cinder-volume[88613]: DEBUG cinder.utils [None req-4b201412-064f-46af-af0e-df119b52c37f tempest-VolumesGetTest-784082675 None] Path /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a3d91b1f-6828-4e36-9fc4-bab0a3a0a78c not found in is_blk_device check {{(pid=88613) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 05 10:18:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4b201412-064f-46af-af0e-df119b52c37f tempest-VolumesGetTest-784082675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e7354f17-87a6-4fbf-a8b3-49e291f7da84 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a3d91b1f-6828-4e36-9fc4-bab0a3a0a78c {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:07 devstack sudo[94828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e7354f17-87a6-4fbf-a8b3-49e291f7da84 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a3d91b1f-6828-4e36-9fc4-bab0a3a0a78c Aug 05 10:18:07 devstack sudo[94828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:07 devstack sudo[94822]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-951cb258-1d96-4f78-9fc8-7adec4cbb836 tempest-ServerActionsTestOtherA-221436279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7c2702d5-1ec9-441b-b550-a2b8ae9ab27f" returned: 0 in 0.245s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:07 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-951cb258-1d96-4f78-9fc8-7adec4cbb836 tempest-ServerActionsTestOtherA-221436279 None] Lock "cinder-quobyte-7c2702d5-1ec9-441b-b550-a2b8ae9ab27f" released by "delete_volume" :: held 0.667s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:18:07 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-951cb258-1d96-4f78-9fc8-7adec4cbb836 tempest-ServerActionsTestOtherA-221436279 None] Created reservations ['7d13febd-7f58-4966-978d-3f29988f0f68', 'f497277e-086c-4047-938f-55455ec48729', 'cec69b5c-af86-4dc7-8ff6-cb1773d6eabd', 'fe77cfa3-601e-4429-ace0-ac3a096523d4'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:18:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-951cb258-1d96-4f78-9fc8-7adec4cbb836 tempest-ServerActionsTestOtherA-221436279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:18:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-951cb258-1d96-4f78-9fc8-7adec4cbb836 tempest-ServerActionsTestOtherA-221436279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:18:08 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-951cb258-1d96-4f78-9fc8-7adec4cbb836 tempest-ServerActionsTestOtherA-221436279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:18:08 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-951cb258-1d96-4f78-9fc8-7adec4cbb836 tempest-ServerActionsTestOtherA-221436279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:18:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-951cb258-1d96-4f78-9fc8-7adec4cbb836 tempest-ServerActionsTestOtherA-221436279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:18:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-951cb258-1d96-4f78-9fc8-7adec4cbb836 tempest-ServerActionsTestOtherA-221436279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:08 devstack sudo[94830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:18:08 devstack sudo[94830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:08 devstack sudo[94830]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-951cb258-1d96-4f78-9fc8-7adec4cbb836 tempest-ServerActionsTestOtherA-221436279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.349s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:08 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-951cb258-1d96-4f78-9fc8-7adec4cbb836 tempest-ServerActionsTestOtherA-221436279 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:18:08 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-951cb258-1d96-4f78-9fc8-7adec4cbb836 tempest-ServerActionsTestOtherA-221436279 None] Deleted volume successfully. Aug 05 10:18:08 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-951cb258-1d96-4f78-9fc8-7adec4cbb836 tempest-ServerActionsTestOtherA-221436279 None] Lock "cinder-7c2702d5-1ec9-441b-b550-a2b8ae9ab27f-delete_volume" released by "delete_volume" :: held 1.277s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:18:13 devstack sudo[94828]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:13 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4b201412-064f-46af-af0e-df119b52c37f tempest-VolumesGetTest-784082675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e7354f17-87a6-4fbf-a8b3-49e291f7da84 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a3d91b1f-6828-4e36-9fc4-bab0a3a0a78c" returned: 0 in 5.279s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:13 devstack cinder-volume[88613]: DEBUG cinder.image.image_utils [None req-4b201412-064f-46af-af0e-df119b52c37f tempest-VolumesGetTest-784082675 None] Image conversion details: src /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e7354f17-87a6-4fbf-a8b3-49e291f7da84, size 1024.00 MB, duration 5.28 sec, destination /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a3d91b1f-6828-4e36-9fc4-bab0a3a0a78c {{(pid=88613) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 10:18:13 devstack cinder-volume[88613]: INFO cinder.image.image_utils [None req-4b201412-064f-46af-af0e-df119b52c37f tempest-VolumesGetTest-784082675 None] Converted 1024.00 MB image at 193.94 MB/s Aug 05 10:18:13 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-4b201412-064f-46af-af0e-df119b52c37f tempest-VolumesGetTest-784082675 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a3d91b1f-6828-4e36-9fc4-bab0a3a0a78c is being set with open permissions: ugo+rw Aug 05 10:18:13 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4b201412-064f-46af-af0e-df119b52c37f tempest-VolumesGetTest-784082675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a3d91b1f-6828-4e36-9fc4-bab0a3a0a78c {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:13 devstack sudo[94886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a3d91b1f-6828-4e36-9fc4-bab0a3a0a78c Aug 05 10:18:13 devstack sudo[94886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:13 devstack sudo[94886]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:13 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4b201412-064f-46af-af0e-df119b52c37f tempest-VolumesGetTest-784082675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a3d91b1f-6828-4e36-9fc4-bab0a3a0a78c" returned: 0 in 0.264s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:13 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-4b201412-064f-46af-af0e-df119b52c37f tempest-VolumesGetTest-784082675 None] Lock "cinder-quobyte-a3d91b1f-6828-4e36-9fc4-bab0a3a0a78c" released by "_copy_volume_from_snapshot" :: held 6.403s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:18:13 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-4b201412-064f-46af-af0e-df119b52c37f tempest-VolumesGetTest-784082675 None] Acquiring lock "cinder-quobyte-f63f9352-3d8a-47cc-87f6-bb1ea97c8b91" by "_delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:18:13 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-4b201412-064f-46af-af0e-df119b52c37f tempest-VolumesGetTest-784082675 None] Lock "cinder-quobyte-f63f9352-3d8a-47cc-87f6-bb1ea97c8b91" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:18:13 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-4b201412-064f-46af-af0e-df119b52c37f tempest-VolumesGetTest-784082675 None] Deleting offline snapshot f63f9352-3d8a-47cc-87f6-bb1ea97c8b91 of volume e7354f17-87a6-4fbf-a8b3-49e291f7da84 {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:18:13 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-4b201412-064f-46af-af0e-df119b52c37f tempest-VolumesGetTest-784082675 None] snapshot_file for this snap is: volume-e7354f17-87a6-4fbf-a8b3-49e291f7da84.f63f9352-3d8a-47cc-87f6-bb1ea97c8b91 {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:18:13 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[2feb64b5-3706-4edd-85c6-100494e6536d]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:18:13 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4b201412-064f-46af-af0e-df119b52c37f tempest-VolumesGetTest-784082675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e7354f17-87a6-4fbf-a8b3-49e291f7da84.f63f9352-3d8a-47cc-87f6-bb1ea97c8b91 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:13 devstack sudo[94889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e7354f17-87a6-4fbf-a8b3-49e291f7da84.f63f9352-3d8a-47cc-87f6-bb1ea97c8b91 Aug 05 10:18:13 devstack sudo[94889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:13 devstack sudo[94889]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:13 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4b201412-064f-46af-af0e-df119b52c37f tempest-VolumesGetTest-784082675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e7354f17-87a6-4fbf-a8b3-49e291f7da84.f63f9352-3d8a-47cc-87f6-bb1ea97c8b91" returned: 0 in 0.330s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:13 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-4b201412-064f-46af-af0e-df119b52c37f tempest-VolumesGetTest-784082675 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7354f17-87a6-4fbf-a8b3-49e291f7da84(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88613) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:18:13 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[15de09ab-f5ad-4600-afa3-987a8264caac]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:18:13 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4b201412-064f-46af-af0e-df119b52c37f tempest-VolumesGetTest-784082675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e7354f17-87a6-4fbf-a8b3-49e291f7da84 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:13 devstack sudo[94895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e7354f17-87a6-4fbf-a8b3-49e291f7da84 Aug 05 10:18:13 devstack sudo[94895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:14 devstack sudo[94895]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:14 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4b201412-064f-46af-af0e-df119b52c37f tempest-VolumesGetTest-784082675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e7354f17-87a6-4fbf-a8b3-49e291f7da84" returned: 0 in 0.501s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:14 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4b201412-064f-46af-af0e-df119b52c37f tempest-VolumesGetTest-784082675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e7354f17-87a6-4fbf-a8b3-49e291f7da84.f63f9352-3d8a-47cc-87f6-bb1ea97c8b91 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:14 devstack sudo[94901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e7354f17-87a6-4fbf-a8b3-49e291f7da84.f63f9352-3d8a-47cc-87f6-bb1ea97c8b91 Aug 05 10:18:14 devstack sudo[94901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:14 devstack sudo[94901]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:14 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4b201412-064f-46af-af0e-df119b52c37f tempest-VolumesGetTest-784082675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e7354f17-87a6-4fbf-a8b3-49e291f7da84.f63f9352-3d8a-47cc-87f6-bb1ea97c8b91" returned: 0 in 0.329s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:14 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4b201412-064f-46af-af0e-df119b52c37f tempest-VolumesGetTest-784082675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e7354f17-87a6-4fbf-a8b3-49e291f7da84.f63f9352-3d8a-47cc-87f6-bb1ea97c8b91 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:14 devstack sudo[94906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e7354f17-87a6-4fbf-a8b3-49e291f7da84.f63f9352-3d8a-47cc-87f6-bb1ea97c8b91 Aug 05 10:18:14 devstack sudo[94906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:14 devstack sudo[94906]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:14 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4b201412-064f-46af-af0e-df119b52c37f tempest-VolumesGetTest-784082675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e7354f17-87a6-4fbf-a8b3-49e291f7da84.f63f9352-3d8a-47cc-87f6-bb1ea97c8b91" returned: 0 in 0.247s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:14 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-4b201412-064f-46af-af0e-df119b52c37f tempest-VolumesGetTest-784082675 None] Lock "cinder-quobyte-f63f9352-3d8a-47cc-87f6-bb1ea97c8b91" released by "_delete_snapshot" :: held 1.487s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:18:14 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-4b201412-064f-46af-af0e-df119b52c37f tempest-VolumesGetTest-784082675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.782s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:18:14 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-243604fc-e700-490d-bb46-c91502ed434f req-c025cd8d-ebb0-4182-9b77-ed8f7309f113 tempest-AttachVolumeNegativeTest-1387927917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 8.542s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:18:14 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-243604fc-e700-490d-bb46-c91502ed434f req-c025cd8d-ebb0-4182-9b77-ed8f7309f113 tempest-AttachVolumeNegativeTest-1387927917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:18:14 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-f9ee1322-5302-4af4-8a78-76a40b775d79 tempest-AttachVolumeTestJSON-1120766613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.307s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:18:14 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-f9ee1322-5302-4af4-8a78-76a40b775d79 tempest-AttachVolumeTestJSON-1120766613 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:18:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1499318080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67b1103e-ece4-434f-b02f-ff3a651fe7d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55529e6fbfcc43c0b801e40e5d45472b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:18:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:18:07Z,use_quota=True,user_id='6a036a34de9d430b811b79242ff7f101',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:18:14 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-f9ee1322-5302-4af4-8a78-76a40b775d79 tempest-AttachVolumeTestJSON-1120766613 None] Creating volume 67b1103e-ece4-434f-b02f-ff3a651fe7d3 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:18:14 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-f9ee1322-5302-4af4-8a78-76a40b775d79 tempest-AttachVolumeTestJSON-1120766613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:18:14 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-f9ee1322-5302-4af4-8a78-76a40b775d79 tempest-AttachVolumeTestJSON-1120766613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:18:14 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-f9ee1322-5302-4af4-8a78-76a40b775d79 tempest-AttachVolumeTestJSON-1120766613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:18:15 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-f9ee1322-5302-4af4-8a78-76a40b775d79 tempest-AttachVolumeTestJSON-1120766613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:18:15 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-f9ee1322-5302-4af4-8a78-76a40b775d79 tempest-AttachVolumeTestJSON-1120766613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:18:15 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-f9ee1322-5302-4af4-8a78-76a40b775d79 tempest-AttachVolumeTestJSON-1120766613 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:18:15 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-f9ee1322-5302-4af4-8a78-76a40b775d79 tempest-AttachVolumeTestJSON-1120766613 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:18:15 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f9ee1322-5302-4af4-8a78-76a40b775d79 tempest-AttachVolumeTestJSON-1120766613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-67b1103e-ece4-434f-b02f-ff3a651fe7d3 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:15 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-4b201412-064f-46af-af0e-df119b52c37f tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f828047-d786-4e60-bbc3-cad8b507a6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3d91b1f-6828-4e36-9fc4-bab0a3a0a78c', 'volume_size': 1, 'source_volid': 'e7354f17-87a6-4fbf-a8b3-49e291f7da84', 'source_volstatus': 'available'}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:18:15 devstack sudo[94909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-67b1103e-ece4-434f-b02f-ff3a651fe7d3 1073741824 Aug 05 10:18:15 devstack sudo[94909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:15 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-4b201412-064f-46af-af0e-df119b52c37f tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (792e452d-fbc1-4bce-a974-cd8a7657268b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:18:15 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [req-243604fc-e700-490d-bb46-c91502ed434f req-c025cd8d-ebb0-4182-9b77-ed8f7309f113 tempest-AttachVolumeNegativeTest-1387927917 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1', 'name': 'volume-f1d3a323-e9a3-40ed-b11d-0b315da9d2e8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3629b5cf-1030-4587-9e1d-ee199eb7f943', 'enforce_multipath': True} {{(pid=88613) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 10:18:15 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-4b201412-064f-46af-af0e-df119b52c37f tempest-VolumesGetTest-784082675 None] Volume volume-a3d91b1f-6828-4e36-9fc4-bab0a3a0a78c (a3d91b1f-6828-4e36-9fc4-bab0a3a0a78c): created successfully Aug 05 10:18:15 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-4b201412-064f-46af-af0e-df119b52c37f tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (792e452d-fbc1-4bce-a974-cd8a7657268b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:18:15 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-4b201412-064f-46af-af0e-df119b52c37f tempest-VolumesGetTest-784082675 None] Flow 'volume_create_manager' (86cda484-5669-4c45-a96d-fd3a35687870) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:18:15 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-4b201412-064f-46af-af0e-df119b52c37f tempest-VolumesGetTest-784082675 None] Created volume successfully. Aug 05 10:18:15 devstack cinder-volume[88613]: INFO cinder.volume.manager [req-243604fc-e700-490d-bb46-c91502ed434f req-c025cd8d-ebb0-4182-9b77-ed8f7309f113 tempest-AttachVolumeNegativeTest-1387927917 None] attachment_update completed successfully. Aug 05 10:18:15 devstack sudo[94909]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:15 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f9ee1322-5302-4af4-8a78-76a40b775d79 tempest-AttachVolumeTestJSON-1120766613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-67b1103e-ece4-434f-b02f-ff3a651fe7d3 1073741824" returned: 0 in 0.600s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:15 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f9ee1322-5302-4af4-8a78-76a40b775d79 tempest-AttachVolumeTestJSON-1120766613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-67b1103e-ece4-434f-b02f-ff3a651fe7d3 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:15 devstack sudo[95299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-67b1103e-ece4-434f-b02f-ff3a651fe7d3 Aug 05 10:18:15 devstack sudo[95299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:16 devstack sudo[95299]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:16 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f9ee1322-5302-4af4-8a78-76a40b775d79 tempest-AttachVolumeTestJSON-1120766613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-67b1103e-ece4-434f-b02f-ff3a651fe7d3" returned: 0 in 0.417s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:16 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-f9ee1322-5302-4af4-8a78-76a40b775d79 tempest-AttachVolumeTestJSON-1120766613 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:18:16 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-f9ee1322-5302-4af4-8a78-76a40b775d79 tempest-AttachVolumeTestJSON-1120766613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:18:16 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-f9ee1322-5302-4af4-8a78-76a40b775d79 tempest-AttachVolumeTestJSON-1120766613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77e40a74-f668-48f8-aa75-3b6fe5d56d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67b1103e-ece4-434f-b02f-ff3a651fe7d3', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:18:16 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-f9ee1322-5302-4af4-8a78-76a40b775d79 tempest-AttachVolumeTestJSON-1120766613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b4048bf-5a5e-49fe-82d6-cb197892bd24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:18:16 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-f9ee1322-5302-4af4-8a78-76a40b775d79 tempest-AttachVolumeTestJSON-1120766613 None] Volume volume-67b1103e-ece4-434f-b02f-ff3a651fe7d3 (67b1103e-ece4-434f-b02f-ff3a651fe7d3): created successfully Aug 05 10:18:16 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-f9ee1322-5302-4af4-8a78-76a40b775d79 tempest-AttachVolumeTestJSON-1120766613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b4048bf-5a5e-49fe-82d6-cb197892bd24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:18:16 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-f9ee1322-5302-4af4-8a78-76a40b775d79 tempest-AttachVolumeTestJSON-1120766613 None] Flow 'volume_create_manager' (48708483-31aa-47b6-9840-40e167bd0227) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:18:16 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-f9ee1322-5302-4af4-8a78-76a40b775d79 tempest-AttachVolumeTestJSON-1120766613 None] Created volume successfully. Aug 05 10:18:16 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-521d7200-fc0e-41d9-b078-ca66751c9f80 tempest-VolumesGetTest-784082675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:18:16 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-521d7200-fc0e-41d9-b078-ca66751c9f80 tempest-VolumesGetTest-784082675 None] Flow 'volume_create_manager' (25ad7b28-d5cd-40e0-b786-cdcdedd60a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:18:16 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-521d7200-fc0e-41d9-b078-ca66751c9f80 tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cf1afb0-d7ab-4c74-8cf9-3b775c60dcfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:18:16 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-521d7200-fc0e-41d9-b078-ca66751c9f80 tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cf1afb0-d7ab-4c74-8cf9-3b775c60dcfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:18:16Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-942885048',display_name='tempest-VolumesGetTest-Volume-2010692348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fced9e2-da95-481e-bce5-ceb585780de0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a06c5d00bd44107a18e7ae90e338bde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:18:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:18:16Z,use_quota=True,user_id='02afcf118fdd4d2c9432655c62cfcfaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:18:16 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-521d7200-fc0e-41d9-b078-ca66751c9f80 tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc63dd98-233a-4701-910a-4273d185e38f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:18:16 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-521d7200-fc0e-41d9-b078-ca66751c9f80 tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc63dd98-233a-4701-910a-4273d185e38f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:18:16 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-521d7200-fc0e-41d9-b078-ca66751c9f80 tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38e3d694-c809-4c3e-91d9-55474e59bf92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:18:16 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-521d7200-fc0e-41d9-b078-ca66751c9f80 tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38e3d694-c809-4c3e-91d9-55474e59bf92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fced9e2-da95-481e-bce5-ceb585780de0', 'volume_name': 'volume-7fced9e2-da95-481e-bce5-ceb585780de0', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:18:16 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-521d7200-fc0e-41d9-b078-ca66751c9f80 tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10c52082-a8af-4f7d-8d6d-3511a94816f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:18:16 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-521d7200-fc0e-41d9-b078-ca66751c9f80 tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10c52082-a8af-4f7d-8d6d-3511a94816f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:18:16 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-521d7200-fc0e-41d9-b078-ca66751c9f80 tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (854a1448-cfef-4436-831a-dd41b92cf80c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:18:16 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-521d7200-fc0e-41d9-b078-ca66751c9f80 tempest-VolumesGetTest-784082675 None] Volume 7fced9e2-da95-481e-bce5-ceb585780de0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fced9e2-da95-481e-bce5-ceb585780de0', 'volume_size': 1} Aug 05 10:18:16 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-521d7200-fc0e-41d9-b078-ca66751c9f80 tempest-VolumesGetTest-784082675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:18:16 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-521d7200-fc0e-41d9-b078-ca66751c9f80 tempest-VolumesGetTest-784082675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:18:16 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-521d7200-fc0e-41d9-b078-ca66751c9f80 tempest-VolumesGetTest-784082675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:18:16Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-942885048',display_name='tempest-VolumesGetTest-Volume-2010692348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fced9e2-da95-481e-bce5-ceb585780de0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a06c5d00bd44107a18e7ae90e338bde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:18:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:18:16Z,use_quota=True,user_id='02afcf118fdd4d2c9432655c62cfcfaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:18:16 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-521d7200-fc0e-41d9-b078-ca66751c9f80 tempest-VolumesGetTest-784082675 None] Creating volume 7fced9e2-da95-481e-bce5-ceb585780de0 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:18:16 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-521d7200-fc0e-41d9-b078-ca66751c9f80 tempest-VolumesGetTest-784082675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:18:16 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-521d7200-fc0e-41d9-b078-ca66751c9f80 tempest-VolumesGetTest-784082675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:18:16 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-521d7200-fc0e-41d9-b078-ca66751c9f80 tempest-VolumesGetTest-784082675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:18:16 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-521d7200-fc0e-41d9-b078-ca66751c9f80 tempest-VolumesGetTest-784082675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:18:16 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-521d7200-fc0e-41d9-b078-ca66751c9f80 tempest-VolumesGetTest-784082675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:18:16 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-521d7200-fc0e-41d9-b078-ca66751c9f80 tempest-VolumesGetTest-784082675 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:18:16 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-521d7200-fc0e-41d9-b078-ca66751c9f80 tempest-VolumesGetTest-784082675 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:18:16 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-521d7200-fc0e-41d9-b078-ca66751c9f80 tempest-VolumesGetTest-784082675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7fced9e2-da95-481e-bce5-ceb585780de0 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:16 devstack sudo[95309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7fced9e2-da95-481e-bce5-ceb585780de0 1073741824 Aug 05 10:18:16 devstack sudo[95309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:17 devstack sudo[95309]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-521d7200-fc0e-41d9-b078-ca66751c9f80 tempest-VolumesGetTest-784082675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7fced9e2-da95-481e-bce5-ceb585780de0 1073741824" returned: 0 in 0.522s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-521d7200-fc0e-41d9-b078-ca66751c9f80 tempest-VolumesGetTest-784082675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7fced9e2-da95-481e-bce5-ceb585780de0 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-978d67c8-426a-4e5e-bf61-9467bce45ffb req-184eff2c-0208-47ef-b8ae-e9fe3cf2fc1b tempest-AttachVolumeTestJSON-1120766613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:18:17 devstack sudo[95324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7fced9e2-da95-481e-bce5-ceb585780de0 Aug 05 10:18:17 devstack sudo[95324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:17 devstack sudo[95324]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-521d7200-fc0e-41d9-b078-ca66751c9f80 tempest-VolumesGetTest-784082675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7fced9e2-da95-481e-bce5-ceb585780de0" returned: 0 in 0.319s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:17 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-521d7200-fc0e-41d9-b078-ca66751c9f80 tempest-VolumesGetTest-784082675 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:18:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-521d7200-fc0e-41d9-b078-ca66751c9f80 tempest-VolumesGetTest-784082675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:18:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-978d67c8-426a-4e5e-bf61-9467bce45ffb req-184eff2c-0208-47ef-b8ae-e9fe3cf2fc1b tempest-AttachVolumeTestJSON-1120766613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.289s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:18:17 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-521d7200-fc0e-41d9-b078-ca66751c9f80 tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (854a1448-cfef-4436-831a-dd41b92cf80c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fced9e2-da95-481e-bce5-ceb585780de0', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:18:17 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-521d7200-fc0e-41d9-b078-ca66751c9f80 tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9f2cfb9-742d-4ff5-8aa7-b3fe40c8db85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:18:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-978d67c8-426a-4e5e-bf61-9467bce45ffb req-184eff2c-0208-47ef-b8ae-e9fe3cf2fc1b tempest-AttachVolumeTestJSON-1120766613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.043s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:18:17 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-521d7200-fc0e-41d9-b078-ca66751c9f80 tempest-VolumesGetTest-784082675 None] Volume volume-7fced9e2-da95-481e-bce5-ceb585780de0 (7fced9e2-da95-481e-bce5-ceb585780de0): created successfully Aug 05 10:18:17 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-521d7200-fc0e-41d9-b078-ca66751c9f80 tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9f2cfb9-742d-4ff5-8aa7-b3fe40c8db85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:18:17 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-521d7200-fc0e-41d9-b078-ca66751c9f80 tempest-VolumesGetTest-784082675 None] Flow 'volume_create_manager' (25ad7b28-d5cd-40e0-b786-cdcdedd60a90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:18:17 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-521d7200-fc0e-41d9-b078-ca66751c9f80 tempest-VolumesGetTest-784082675 None] Created volume successfully. Aug 05 10:18:17 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [req-978d67c8-426a-4e5e-bf61-9467bce45ffb req-184eff2c-0208-47ef-b8ae-e9fe3cf2fc1b tempest-AttachVolumeTestJSON-1120766613 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1', 'name': 'volume-67b1103e-ece4-434f-b02f-ff3a651fe7d3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3b7879a2-80b7-4214-a7b3-d3ddf20e912a', 'enforce_multipath': True} {{(pid=88613) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 10:18:17 devstack cinder-volume[88613]: INFO cinder.volume.manager [req-978d67c8-426a-4e5e-bf61-9467bce45ffb req-184eff2c-0208-47ef-b8ae-e9fe3cf2fc1b tempest-AttachVolumeTestJSON-1120766613 None] attachment_update completed successfully. Aug 05 10:18:18 devstack cinder-volume[88613]: INFO cinder.volume.manager [req-9c57eac5-8e4d-4da3-b761-76333891cd3c req-90f7c5ae-c673-4d64-b528-ffaa7a922efd tempest-AttachVolumeNegativeTest-1387927917 None] Terminate volume connection completed successfully. Aug 05 10:18:18 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [req-9c57eac5-8e4d-4da3-b761-76333891cd3c req-90f7c5ae-c673-4d64-b528-ffaa7a922efd tempest-AttachVolumeNegativeTest-1387927917 None] Deleting attachment 3629b5cf-1030-4587-9e1d-ee199eb7f943. {{(pid=88613) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 10:18:18 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-bbdb00ed-3d1c-4843-8a16-27c06e942b50 tempest-VolumesGetTest-784082675 None] Acquiring lock "cinder-7fced9e2-da95-481e-bce5-ceb585780de0-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:18:18 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-bbdb00ed-3d1c-4843-8a16-27c06e942b50 tempest-VolumesGetTest-784082675 None] Lock "cinder-7fced9e2-da95-481e-bce5-ceb585780de0-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:18:18 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-bbdb00ed-3d1c-4843-8a16-27c06e942b50 tempest-VolumesGetTest-784082675 None] Acquiring lock "cinder-quobyte-7fced9e2-da95-481e-bce5-ceb585780de0" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:18:18 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-bbdb00ed-3d1c-4843-8a16-27c06e942b50 tempest-VolumesGetTest-784082675 None] Lock "cinder-quobyte-7fced9e2-da95-481e-bce5-ceb585780de0" acquired by "delete_volume" :: waited 0.023s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:18:18 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be166e1-35ee-4d11-998e-229837a6669a]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:18:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-bbdb00ed-3d1c-4843-8a16-27c06e942b50 tempest-VolumesGetTest-784082675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7fced9e2-da95-481e-bce5-ceb585780de0 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:18 devstack sudo[95339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7fced9e2-da95-481e-bce5-ceb585780de0 Aug 05 10:18:18 devstack sudo[95339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:19 devstack sudo[95339]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-bbdb00ed-3d1c-4843-8a16-27c06e942b50 tempest-VolumesGetTest-784082675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7fced9e2-da95-481e-bce5-ceb585780de0" returned: 0 in 0.466s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-bbdb00ed-3d1c-4843-8a16-27c06e942b50 tempest-VolumesGetTest-784082675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7fced9e2-da95-481e-bce5-ceb585780de0 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:19 devstack sudo[95345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7fced9e2-da95-481e-bce5-ceb585780de0 Aug 05 10:18:19 devstack sudo[95345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:19 devstack sudo[95345]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-bbdb00ed-3d1c-4843-8a16-27c06e942b50 tempest-VolumesGetTest-784082675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7fced9e2-da95-481e-bce5-ceb585780de0" returned: 0 in 0.434s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:19 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-bbdb00ed-3d1c-4843-8a16-27c06e942b50 tempest-VolumesGetTest-784082675 None] Lock "cinder-quobyte-7fced9e2-da95-481e-bce5-ceb585780de0" released by "delete_volume" :: held 0.957s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:18:19 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-bbdb00ed-3d1c-4843-8a16-27c06e942b50 tempest-VolumesGetTest-784082675 None] Created reservations ['5c16efc1-8105-4246-944e-de7700d91e2e', '3a830f88-9ed4-4797-baca-92dce67e102e', 'f59df6e7-3067-4eb0-bbfd-79e7544af12b', 'ddf3c1e7-3a62-41cf-905f-98e71d117014'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:18:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-bbdb00ed-3d1c-4843-8a16-27c06e942b50 tempest-VolumesGetTest-784082675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:18:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-bbdb00ed-3d1c-4843-8a16-27c06e942b50 tempest-VolumesGetTest-784082675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:18:19 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-bbdb00ed-3d1c-4843-8a16-27c06e942b50 tempest-VolumesGetTest-784082675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:18:19 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-bbdb00ed-3d1c-4843-8a16-27c06e942b50 tempest-VolumesGetTest-784082675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:18:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-bbdb00ed-3d1c-4843-8a16-27c06e942b50 tempest-VolumesGetTest-784082675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:18:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-bbdb00ed-3d1c-4843-8a16-27c06e942b50 tempest-VolumesGetTest-784082675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:19 devstack sudo[95358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:18:19 devstack sudo[95358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:20 devstack sudo[95358]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:20 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-aca575cf-08c8-4398-9ca8-66b07cbbd765 tempest-AttachVolumeTestJSON-1120766613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:18:20 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-aca575cf-08c8-4398-9ca8-66b07cbbd765 tempest-AttachVolumeTestJSON-1120766613 None] Flow 'volume_create_manager' (075236a7-e9f6-4b05-968c-c047985d4a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:18:20 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-aca575cf-08c8-4398-9ca8-66b07cbbd765 tempest-AttachVolumeTestJSON-1120766613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fc44290-eea3-4703-82cd-db6f214d2718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:18:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-bbdb00ed-3d1c-4843-8a16-27c06e942b50 tempest-VolumesGetTest-784082675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.439s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:20 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-bbdb00ed-3d1c-4843-8a16-27c06e942b50 tempest-VolumesGetTest-784082675 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:18:20 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-bbdb00ed-3d1c-4843-8a16-27c06e942b50 tempest-VolumesGetTest-784082675 None] Deleted volume successfully. Aug 05 10:18:20 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-aca575cf-08c8-4398-9ca8-66b07cbbd765 tempest-AttachVolumeTestJSON-1120766613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fc44290-eea3-4703-82cd-db6f214d2718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:18:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-751336622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=072d33d2-77e7-4635-9183-bc1f6d1482ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55529e6fbfcc43c0b801e40e5d45472b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:18:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:18:20Z,use_quota=True,user_id='6a036a34de9d430b811b79242ff7f101',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:18:20 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-aca575cf-08c8-4398-9ca8-66b07cbbd765 tempest-AttachVolumeTestJSON-1120766613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95cd079d-92e3-4cf2-be49-dcacb735e6db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:18:20 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-aca575cf-08c8-4398-9ca8-66b07cbbd765 tempest-AttachVolumeTestJSON-1120766613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95cd079d-92e3-4cf2-be49-dcacb735e6db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:18:20 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-aca575cf-08c8-4398-9ca8-66b07cbbd765 tempest-AttachVolumeTestJSON-1120766613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4770c46b-0e9f-4cc6-b2a1-0bbcc3576f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:18:20 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-aca575cf-08c8-4398-9ca8-66b07cbbd765 tempest-AttachVolumeTestJSON-1120766613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4770c46b-0e9f-4cc6-b2a1-0bbcc3576f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '072d33d2-77e7-4635-9183-bc1f6d1482ed', 'volume_name': 'volume-072d33d2-77e7-4635-9183-bc1f6d1482ed', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:18:20 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-aca575cf-08c8-4398-9ca8-66b07cbbd765 tempest-AttachVolumeTestJSON-1120766613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae88f00a-816c-4192-9278-a086023ee678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:18:20 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-aca575cf-08c8-4398-9ca8-66b07cbbd765 tempest-AttachVolumeTestJSON-1120766613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae88f00a-816c-4192-9278-a086023ee678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:18:20 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-aca575cf-08c8-4398-9ca8-66b07cbbd765 tempest-AttachVolumeTestJSON-1120766613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f3d914f-abbd-40b0-a737-8519d5a49370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:18:20 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-aca575cf-08c8-4398-9ca8-66b07cbbd765 tempest-AttachVolumeTestJSON-1120766613 None] Volume 072d33d2-77e7-4635-9183-bc1f6d1482ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-072d33d2-77e7-4635-9183-bc1f6d1482ed', 'volume_size': 1} Aug 05 10:18:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-aca575cf-08c8-4398-9ca8-66b07cbbd765 tempest-AttachVolumeTestJSON-1120766613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:18:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-aca575cf-08c8-4398-9ca8-66b07cbbd765 tempest-AttachVolumeTestJSON-1120766613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:18:20 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-aca575cf-08c8-4398-9ca8-66b07cbbd765 tempest-AttachVolumeTestJSON-1120766613 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:18:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-751336622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=072d33d2-77e7-4635-9183-bc1f6d1482ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55529e6fbfcc43c0b801e40e5d45472b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:18:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:18:20Z,use_quota=True,user_id='6a036a34de9d430b811b79242ff7f101',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:18:20 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-aca575cf-08c8-4398-9ca8-66b07cbbd765 tempest-AttachVolumeTestJSON-1120766613 None] Creating volume 072d33d2-77e7-4635-9183-bc1f6d1482ed {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:18:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-aca575cf-08c8-4398-9ca8-66b07cbbd765 tempest-AttachVolumeTestJSON-1120766613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:18:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-aca575cf-08c8-4398-9ca8-66b07cbbd765 tempest-AttachVolumeTestJSON-1120766613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:18:20 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-aca575cf-08c8-4398-9ca8-66b07cbbd765 tempest-AttachVolumeTestJSON-1120766613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:18:20 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-aca575cf-08c8-4398-9ca8-66b07cbbd765 tempest-AttachVolumeTestJSON-1120766613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:18:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-aca575cf-08c8-4398-9ca8-66b07cbbd765 tempest-AttachVolumeTestJSON-1120766613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:18:20 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-aca575cf-08c8-4398-9ca8-66b07cbbd765 tempest-AttachVolumeTestJSON-1120766613 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:18:20 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-aca575cf-08c8-4398-9ca8-66b07cbbd765 tempest-AttachVolumeTestJSON-1120766613 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:18:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-aca575cf-08c8-4398-9ca8-66b07cbbd765 tempest-AttachVolumeTestJSON-1120766613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-072d33d2-77e7-4635-9183-bc1f6d1482ed 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:20 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-bbdb00ed-3d1c-4843-8a16-27c06e942b50 tempest-VolumesGetTest-784082675 None] Lock "cinder-7fced9e2-da95-481e-bce5-ceb585780de0-delete_volume" released by "delete_volume" :: held 1.805s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:18:20 devstack sudo[95376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-072d33d2-77e7-4635-9183-bc1f6d1482ed 1073741824 Aug 05 10:18:20 devstack sudo[95376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:21 devstack sudo[95376]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-aca575cf-08c8-4398-9ca8-66b07cbbd765 tempest-AttachVolumeTestJSON-1120766613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-072d33d2-77e7-4635-9183-bc1f6d1482ed 1073741824" returned: 0 in 0.646s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:21 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-4dc239e0-7086-4a55-8365-38eaec795362 tempest-VolumesGetTest-784082675 None] Acquiring lock "cinder-a3d91b1f-6828-4e36-9fc4-bab0a3a0a78c-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:18:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-aca575cf-08c8-4398-9ca8-66b07cbbd765 tempest-AttachVolumeTestJSON-1120766613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-072d33d2-77e7-4635-9183-bc1f6d1482ed {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:21 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-4dc239e0-7086-4a55-8365-38eaec795362 tempest-VolumesGetTest-784082675 None] Lock "cinder-a3d91b1f-6828-4e36-9fc4-bab0a3a0a78c-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:18:21 devstack sudo[95383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-072d33d2-77e7-4635-9183-bc1f6d1482ed Aug 05 10:18:21 devstack sudo[95383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:21 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-4dc239e0-7086-4a55-8365-38eaec795362 tempest-VolumesGetTest-784082675 None] Acquiring lock "cinder-quobyte-a3d91b1f-6828-4e36-9fc4-bab0a3a0a78c" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:18:21 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-4dc239e0-7086-4a55-8365-38eaec795362 tempest-VolumesGetTest-784082675 None] Lock "cinder-quobyte-a3d91b1f-6828-4e36-9fc4-bab0a3a0a78c" acquired by "delete_volume" :: waited 0.020s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:18:21 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a038b96-a29e-40fd-8c3c-7c1b03c3dc3c]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:18:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4dc239e0-7086-4a55-8365-38eaec795362 tempest-VolumesGetTest-784082675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a3d91b1f-6828-4e36-9fc4-bab0a3a0a78c {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:21 devstack sudo[95383]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-aca575cf-08c8-4398-9ca8-66b07cbbd765 tempest-AttachVolumeTestJSON-1120766613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-072d33d2-77e7-4635-9183-bc1f6d1482ed" returned: 0 in 0.360s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:21 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-aca575cf-08c8-4398-9ca8-66b07cbbd765 tempest-AttachVolumeTestJSON-1120766613 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:18:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-aca575cf-08c8-4398-9ca8-66b07cbbd765 tempest-AttachVolumeTestJSON-1120766613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:18:21 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-aca575cf-08c8-4398-9ca8-66b07cbbd765 tempest-AttachVolumeTestJSON-1120766613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f3d914f-abbd-40b0-a737-8519d5a49370) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-072d33d2-77e7-4635-9183-bc1f6d1482ed', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:18:21 devstack sudo[95386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a3d91b1f-6828-4e36-9fc4-bab0a3a0a78c Aug 05 10:18:21 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-aca575cf-08c8-4398-9ca8-66b07cbbd765 tempest-AttachVolumeTestJSON-1120766613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2145fe34-d4a4-4a5d-8d89-86ab31cbe134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:18:21 devstack sudo[95386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:21 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-aca575cf-08c8-4398-9ca8-66b07cbbd765 tempest-AttachVolumeTestJSON-1120766613 None] Volume volume-072d33d2-77e7-4635-9183-bc1f6d1482ed (072d33d2-77e7-4635-9183-bc1f6d1482ed): created successfully Aug 05 10:18:21 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-aca575cf-08c8-4398-9ca8-66b07cbbd765 tempest-AttachVolumeTestJSON-1120766613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2145fe34-d4a4-4a5d-8d89-86ab31cbe134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:18:21 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-aca575cf-08c8-4398-9ca8-66b07cbbd765 tempest-AttachVolumeTestJSON-1120766613 None] Flow 'volume_create_manager' (075236a7-e9f6-4b05-968c-c047985d4a8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:18:21 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-aca575cf-08c8-4398-9ca8-66b07cbbd765 tempest-AttachVolumeTestJSON-1120766613 None] Created volume successfully. Aug 05 10:18:21 devstack cinder-volume[88613]: DEBUG oslo_service.periodic_task [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88613) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:18:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:18:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:18:21 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:18:21 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:18:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:18:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:21 devstack sudo[95390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:18:21 devstack sudo[95390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:22 devstack sudo[95386]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4dc239e0-7086-4a55-8365-38eaec795362 tempest-VolumesGetTest-784082675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a3d91b1f-6828-4e36-9fc4-bab0a3a0a78c" returned: 0 in 0.640s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4dc239e0-7086-4a55-8365-38eaec795362 tempest-VolumesGetTest-784082675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a3d91b1f-6828-4e36-9fc4-bab0a3a0a78c {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:22 devstack sudo[95390]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.290s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:22 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:18:22 devstack cinder-volume[88613]: DEBUG oslo_service.periodic_task [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Running periodic task VolumeManager._thread_info {{(pid=88613) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:18:22 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] thread count: 28 {{(pid=88613) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 10:18:22 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] thread info: [<_MainThread(MainThread, started 126173666128000)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88613) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 10:18:22 devstack sudo[95397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a3d91b1f-6828-4e36-9fc4-bab0a3a0a78c Aug 05 10:18:22 devstack sudo[95397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:22 devstack sudo[95397]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4dc239e0-7086-4a55-8365-38eaec795362 tempest-VolumesGetTest-784082675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a3d91b1f-6828-4e36-9fc4-bab0a3a0a78c" returned: 0 in 0.421s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:22 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-4dc239e0-7086-4a55-8365-38eaec795362 tempest-VolumesGetTest-784082675 None] Lock "cinder-quobyte-a3d91b1f-6828-4e36-9fc4-bab0a3a0a78c" released by "delete_volume" :: held 1.121s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:18:22 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-4dc239e0-7086-4a55-8365-38eaec795362 tempest-VolumesGetTest-784082675 None] Created reservations ['68d71764-5c37-4355-baa9-94d75e6e4ad3', '9d7d2308-8f0f-456a-80ff-2b55f2dc50b5', '2b884f8b-e068-4984-bb96-4cabeb4a39ad', 'c9a0bb83-de87-4632-b73b-392c94ac402c'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:18:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-4dc239e0-7086-4a55-8365-38eaec795362 tempest-VolumesGetTest-784082675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:18:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-4dc239e0-7086-4a55-8365-38eaec795362 tempest-VolumesGetTest-784082675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:18:22 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-4dc239e0-7086-4a55-8365-38eaec795362 tempest-VolumesGetTest-784082675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:18:22 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-4dc239e0-7086-4a55-8365-38eaec795362 tempest-VolumesGetTest-784082675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:18:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-4dc239e0-7086-4a55-8365-38eaec795362 tempest-VolumesGetTest-784082675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:18:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4dc239e0-7086-4a55-8365-38eaec795362 tempest-VolumesGetTest-784082675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:22 devstack sudo[95404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:18:22 devstack sudo[95404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:23 devstack sudo[95404]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4dc239e0-7086-4a55-8365-38eaec795362 tempest-VolumesGetTest-784082675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.367s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:23 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-4dc239e0-7086-4a55-8365-38eaec795362 tempest-VolumesGetTest-784082675 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:18:23 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-4dc239e0-7086-4a55-8365-38eaec795362 tempest-VolumesGetTest-784082675 None] Deleted volume successfully. Aug 05 10:18:23 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-4dc239e0-7086-4a55-8365-38eaec795362 tempest-VolumesGetTest-784082675 None] Lock "cinder-a3d91b1f-6828-4e36-9fc4-bab0a3a0a78c-delete_volume" released by "delete_volume" :: held 1.859s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:18:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-4c4d5a12-51b5-4644-a621-d4fc0767f58b req-aadd85d5-036e-4468-a0a0-4d3b22380c24 tempest-AttachVolumeTestJSON-1120766613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:18:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-4c4d5a12-51b5-4644-a621-d4fc0767f58b req-aadd85d5-036e-4468-a0a0-4d3b22380c24 tempest-AttachVolumeTestJSON-1120766613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:18:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-4c4d5a12-51b5-4644-a621-d4fc0767f58b req-aadd85d5-036e-4468-a0a0-4d3b22380c24 tempest-AttachVolumeTestJSON-1120766613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:18:23 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [req-4c4d5a12-51b5-4644-a621-d4fc0767f58b req-aadd85d5-036e-4468-a0a0-4d3b22380c24 tempest-AttachVolumeTestJSON-1120766613 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1', 'name': 'volume-072d33d2-77e7-4635-9183-bc1f6d1482ed', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7ef4ecc1-45dd-4800-8caa-0423098474d4', 'enforce_multipath': True} {{(pid=88613) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 10:18:23 devstack cinder-volume[88613]: INFO cinder.volume.manager [req-4c4d5a12-51b5-4644-a621-d4fc0767f58b req-aadd85d5-036e-4468-a0a0-4d3b22380c24 tempest-AttachVolumeTestJSON-1120766613 None] attachment_update completed successfully. Aug 05 10:18:23 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-1f1c281b-07de-452b-8fcd-0fd0cb2f606f tempest-VolumesGetTest-784082675 None] Acquiring lock "cinder-e7354f17-87a6-4fbf-a8b3-49e291f7da84-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:18:23 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-1f1c281b-07de-452b-8fcd-0fd0cb2f606f tempest-VolumesGetTest-784082675 None] Lock "cinder-e7354f17-87a6-4fbf-a8b3-49e291f7da84-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:18:23 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-1f1c281b-07de-452b-8fcd-0fd0cb2f606f tempest-VolumesGetTest-784082675 None] Acquiring lock "cinder-quobyte-e7354f17-87a6-4fbf-a8b3-49e291f7da84" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:18:23 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-1f1c281b-07de-452b-8fcd-0fd0cb2f606f tempest-VolumesGetTest-784082675 None] Lock "cinder-quobyte-e7354f17-87a6-4fbf-a8b3-49e291f7da84" acquired by "delete_volume" :: waited 0.021s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:18:23 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdfdf97b-02f9-4c3e-a4b7-f7e8dbb69e25]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:18:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1f1c281b-07de-452b-8fcd-0fd0cb2f606f tempest-VolumesGetTest-784082675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e7354f17-87a6-4fbf-a8b3-49e291f7da84 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:23 devstack sudo[95421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e7354f17-87a6-4fbf-a8b3-49e291f7da84 Aug 05 10:18:23 devstack sudo[95421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:24 devstack sudo[95421]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:24 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1f1c281b-07de-452b-8fcd-0fd0cb2f606f tempest-VolumesGetTest-784082675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e7354f17-87a6-4fbf-a8b3-49e291f7da84" returned: 0 in 0.599s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:24 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1f1c281b-07de-452b-8fcd-0fd0cb2f606f tempest-VolumesGetTest-784082675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e7354f17-87a6-4fbf-a8b3-49e291f7da84 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:24 devstack sudo[95427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e7354f17-87a6-4fbf-a8b3-49e291f7da84 Aug 05 10:18:24 devstack sudo[95427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:24 devstack sudo[95427]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:24 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1f1c281b-07de-452b-8fcd-0fd0cb2f606f tempest-VolumesGetTest-784082675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e7354f17-87a6-4fbf-a8b3-49e291f7da84" returned: 0 in 0.350s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:24 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-1f1c281b-07de-452b-8fcd-0fd0cb2f606f tempest-VolumesGetTest-784082675 None] Lock "cinder-quobyte-e7354f17-87a6-4fbf-a8b3-49e291f7da84" released by "delete_volume" :: held 1.049s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:18:24 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-1f1c281b-07de-452b-8fcd-0fd0cb2f606f tempest-VolumesGetTest-784082675 None] Created reservations ['0bfc6712-19f7-45f2-b624-0c61effe1d84', 'bdefdbff-5aea-4a3e-b6f7-3b88e84092c4', '429fef82-27b9-45b9-8d68-a69d2aa2ad7f', 'fed59b2c-d85c-44ea-86c4-4b1ac7bf2f40'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:18:24 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-1f1c281b-07de-452b-8fcd-0fd0cb2f606f tempest-VolumesGetTest-784082675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:18:24 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-1f1c281b-07de-452b-8fcd-0fd0cb2f606f tempest-VolumesGetTest-784082675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:18:24 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-1f1c281b-07de-452b-8fcd-0fd0cb2f606f tempest-VolumesGetTest-784082675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:18:24 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-1f1c281b-07de-452b-8fcd-0fd0cb2f606f tempest-VolumesGetTest-784082675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:18:24 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-1f1c281b-07de-452b-8fcd-0fd0cb2f606f tempest-VolumesGetTest-784082675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:18:24 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1f1c281b-07de-452b-8fcd-0fd0cb2f606f tempest-VolumesGetTest-784082675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:24 devstack sudo[95430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:18:24 devstack sudo[95430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:25 devstack sudo[95430]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1f1c281b-07de-452b-8fcd-0fd0cb2f606f tempest-VolumesGetTest-784082675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.314s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:25 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-1f1c281b-07de-452b-8fcd-0fd0cb2f606f tempest-VolumesGetTest-784082675 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:18:25 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-1f1c281b-07de-452b-8fcd-0fd0cb2f606f tempest-VolumesGetTest-784082675 None] Deleted volume successfully. Aug 05 10:18:25 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-1f1c281b-07de-452b-8fcd-0fd0cb2f606f tempest-VolumesGetTest-784082675 None] Lock "cinder-e7354f17-87a6-4fbf-a8b3-49e291f7da84-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:18:26 devstack cinder-volume[88613]: INFO cinder.volume.manager [req-c18f606c-e847-4066-be3d-b7e76f327769 req-a6096de1-4d2b-44bf-ac3a-20925a9425d3 tempest-AttachVolumeTestJSON-1120766613 None] Terminate volume connection completed successfully. Aug 05 10:18:26 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [req-c18f606c-e847-4066-be3d-b7e76f327769 req-a6096de1-4d2b-44bf-ac3a-20925a9425d3 tempest-AttachVolumeTestJSON-1120766613 None] Deleting attachment 3b7879a2-80b7-4214-a7b3-d3ddf20e912a. {{(pid=88613) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 10:18:26 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6003d43-6e06-4d45-b939-f3332e288ac6 tempest-VolumesGetTest-784082675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:18:26 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c6003d43-6e06-4d45-b939-f3332e288ac6 tempest-VolumesGetTest-784082675 None] Flow 'volume_create_manager' (370443a0-b046-4d68-8d1e-00bcc6d69021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:18:26 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c6003d43-6e06-4d45-b939-f3332e288ac6 tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaaa2212-ac8f-4f2e-a299-d1d6bd4d802b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:18:27 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c6003d43-6e06-4d45-b939-f3332e288ac6 tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaaa2212-ac8f-4f2e-a299-d1d6bd4d802b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:18:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-828547021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31ce3ce9-10ae-447f-888d-9370b25d6b39,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6a06c5d00bd44107a18e7ae90e338bde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:18:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:18:27Z,use_quota=True,user_id='02afcf118fdd4d2c9432655c62cfcfaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:18:27 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c6003d43-6e06-4d45-b939-f3332e288ac6 tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42a879f1-a4b3-4f1b-bc1f-a0ec46ba8735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:18:27 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c6003d43-6e06-4d45-b939-f3332e288ac6 tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42a879f1-a4b3-4f1b-bc1f-a0ec46ba8735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:18:27 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c6003d43-6e06-4d45-b939-f3332e288ac6 tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fad0e2c9-e040-49a6-a242-7f3e559a4e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:18:27 devstack cinder-volume[88613]: DEBUG cinder.image.glance [None req-c6003d43-6e06-4d45-b939-f3332e288ac6 tempest-VolumesGetTest-784082675 None] Creating Keystone auth plugin from conf {{(pid=88613) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 05 10:18:27 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c6003d43-6e06-4d45-b939-f3332e288ac6 tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fad0e2c9-e040-49a6-a242-7f3e559a4e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '31ce3ce9-10ae-447f-888d-9370b25d6b39', 'volume_name': 'volume-31ce3ce9-10ae-447f-888d-9370b25d6b39', 'volume_size': 1, 'image_id': '89278436-b56f-45f7-8c42-c9afd7bd7453', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/89278436-b56f-45f7-8c42-c9afd7bd7453', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '654c7af809d145caaadc8738d3dc3df2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '89278436-b56f-45f7-8c42-c9afd7bd7453', 'created_at': datetime.datetime(2026, 8, 5, 8, 7, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 8, 7, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/89278436-b56f-45f7-8c42-c9afd7bd7453/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:18:27 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c6003d43-6e06-4d45-b939-f3332e288ac6 tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98c97fae-5888-49f5-83ea-ea15569386f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:18:27 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c6003d43-6e06-4d45-b939-f3332e288ac6 tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98c97fae-5888-49f5-83ea-ea15569386f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:18:27 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c6003d43-6e06-4d45-b939-f3332e288ac6 tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4552937-a8ce-494b-a812-d0d6b1899ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:18:27 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-c6003d43-6e06-4d45-b939-f3332e288ac6 tempest-VolumesGetTest-784082675 None] Volume 31ce3ce9-10ae-447f-888d-9370b25d6b39: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-31ce3ce9-10ae-447f-888d-9370b25d6b39', 'volume_size': 1, 'image_id': '89278436-b56f-45f7-8c42-c9afd7bd7453', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/89278436-b56f-45f7-8c42-c9afd7bd7453', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '654c7af809d145caaadc8738d3dc3df2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '89278436-b56f-45f7-8c42-c9afd7bd7453', 'created_at': datetime.datetime(2026, 8, 5, 8, 7, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 8, 7, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/89278436-b56f-45f7-8c42-c9afd7bd7453/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 05 10:18:27 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6003d43-6e06-4d45-b939-f3332e288ac6 tempest-VolumesGetTest-784082675 None] Trying to clone 31ce3ce9-10ae-447f-888d-9370b25d6b39 from image 89278436-b56f-45f7-8c42-c9afd7bd7453 at location (None, [{'url': 'file:///opt/stack/data/glance/images/89278436-b56f-45f7-8c42-c9afd7bd7453', 'metadata': {}}]). {{(pid=88613) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 05 10:18:28 devstack cinder-volume[88613]: DEBUG cinder.image.image_utils [None req-c6003d43-6e06-4d45-b939-f3332e288ac6 tempest-VolumesGetTest-784082675 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_89278436-b56f-45f7-8c42-c9afd7bd7453_3risv84sdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88613) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 05 10:18:28 devstack cinder-volume[88613]: INFO cinder.image.image_utils [None req-c6003d43-6e06-4d45-b939-f3332e288ac6 tempest-VolumesGetTest-784082675 None] Image download 20.69 MB at 20.69 MB/s Aug 05 10:18:28 devstack cinder-volume[88613]: INFO cinder.volume.manager [req-5ced10d8-bd1a-4734-b3fe-5a265764f20b req-8f17d48e-73e3-4a17-a8e5-aef150af1c11 tempest-AttachVolumeTestJSON-1120766613 None] Terminate volume connection completed successfully. Aug 05 10:18:28 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [req-5ced10d8-bd1a-4734-b3fe-5a265764f20b req-8f17d48e-73e3-4a17-a8e5-aef150af1c11 tempest-AttachVolumeTestJSON-1120766613 None] Deleting attachment 7ef4ecc1-45dd-4800-8caa-0423098474d4. {{(pid=88613) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 10:18:28 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[23178ed6-db42-4b0c-a053-5b8232d020cb]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:18:28 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c6003d43-6e06-4d45-b939-f3332e288ac6 tempest-VolumesGetTest-784082675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89278436-b56f-45f7-8c42-c9afd7bd7453_3risv84sdevstack@QuobyteHD {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:28 devstack sudo[95481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89278436-b56f-45f7-8c42-c9afd7bd7453_3risv84sdevstack@QuobyteHD Aug 05 10:18:28 devstack sudo[95481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:28 devstack sudo[95481]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:28 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c6003d43-6e06-4d45-b939-f3332e288ac6 tempest-VolumesGetTest-784082675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89278436-b56f-45f7-8c42-c9afd7bd7453_3risv84sdevstack@QuobyteHD" returned: 0 in 0.501s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:28 devstack cinder-volume[88613]: DEBUG cinder.image.image_utils [None req-c6003d43-6e06-4d45-b939-f3332e288ac6 tempest-VolumesGetTest-784082675 None] Temporary image 89278436-b56f-45f7-8c42-c9afd7bd7453 is fetched for user 02afcf118fdd4d2c9432655c62cfcfaa. {{(pid=88613) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 05 10:18:29 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b1fedb-07c6-4b73-95bf-6b4bf24b0e1a]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:18:29 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c6003d43-6e06-4d45-b939-f3332e288ac6 tempest-VolumesGetTest-784082675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89278436-b56f-45f7-8c42-c9afd7bd7453_3risv84sdevstack@QuobyteHD {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:29 devstack sudo[95487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89278436-b56f-45f7-8c42-c9afd7bd7453_3risv84sdevstack@QuobyteHD Aug 05 10:18:29 devstack sudo[95487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:29 devstack sudo[95487]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:29 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c6003d43-6e06-4d45-b939-f3332e288ac6 tempest-VolumesGetTest-784082675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89278436-b56f-45f7-8c42-c9afd7bd7453_3risv84sdevstack@QuobyteHD" returned: 0 in 0.366s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:29 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c6003d43-6e06-4d45-b939-f3332e288ac6 tempest-VolumesGetTest-784082675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:18:29 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c6003d43-6e06-4d45-b939-f3332e288ac6 tempest-VolumesGetTest-784082675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:18:29 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-c6003d43-6e06-4d45-b939-f3332e288ac6 tempest-VolumesGetTest-784082675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:18:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-828547021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31ce3ce9-10ae-447f-888d-9370b25d6b39,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6a06c5d00bd44107a18e7ae90e338bde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:18:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:18:27Z,use_quota=True,user_id='02afcf118fdd4d2c9432655c62cfcfaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:18:29 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-c6003d43-6e06-4d45-b939-f3332e288ac6 tempest-VolumesGetTest-784082675 None] Creating volume 31ce3ce9-10ae-447f-888d-9370b25d6b39 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:18:29 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c6003d43-6e06-4d45-b939-f3332e288ac6 tempest-VolumesGetTest-784082675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:18:29 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c6003d43-6e06-4d45-b939-f3332e288ac6 tempest-VolumesGetTest-784082675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:18:29 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-c6003d43-6e06-4d45-b939-f3332e288ac6 tempest-VolumesGetTest-784082675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:18:29 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-c6003d43-6e06-4d45-b939-f3332e288ac6 tempest-VolumesGetTest-784082675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:18:29 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c6003d43-6e06-4d45-b939-f3332e288ac6 tempest-VolumesGetTest-784082675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:18:29 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-c6003d43-6e06-4d45-b939-f3332e288ac6 tempest-VolumesGetTest-784082675 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:18:29 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-c6003d43-6e06-4d45-b939-f3332e288ac6 tempest-VolumesGetTest-784082675 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:18:29 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c6003d43-6e06-4d45-b939-f3332e288ac6 tempest-VolumesGetTest-784082675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-31ce3ce9-10ae-447f-888d-9370b25d6b39 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:29 devstack sudo[95495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-31ce3ce9-10ae-447f-888d-9370b25d6b39 1073741824 Aug 05 10:18:29 devstack sudo[95495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:30 devstack sudo[95495]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:30 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c6003d43-6e06-4d45-b939-f3332e288ac6 tempest-VolumesGetTest-784082675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-31ce3ce9-10ae-447f-888d-9370b25d6b39 1073741824" returned: 0 in 0.656s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:30 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c6003d43-6e06-4d45-b939-f3332e288ac6 tempest-VolumesGetTest-784082675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-31ce3ce9-10ae-447f-888d-9370b25d6b39 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:30 devstack sudo[95510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-31ce3ce9-10ae-447f-888d-9370b25d6b39 Aug 05 10:18:30 devstack sudo[95510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:30 devstack sudo[95510]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:30 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c6003d43-6e06-4d45-b939-f3332e288ac6 tempest-VolumesGetTest-784082675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-31ce3ce9-10ae-447f-888d-9370b25d6b39" returned: 0 in 0.545s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:30 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-c6003d43-6e06-4d45-b939-f3332e288ac6 tempest-VolumesGetTest-784082675 None] <== create_volume: return (1377ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:18:30 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c6003d43-6e06-4d45-b939-f3332e288ac6 tempest-VolumesGetTest-784082675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.380s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:18:30 devstack cinder-volume[88613]: DEBUG cinder.volume.volume_utils [None req-c6003d43-6e06-4d45-b939-f3332e288ac6 tempest-VolumesGetTest-784082675 None] Attempting download of 89278436-b56f-45f7-8c42-c9afd7bd7453 ((None, [{'url': 'file:///opt/stack/data/glance/images/89278436-b56f-45f7-8c42-c9afd7bd7453', 'metadata': {}}])) to volume 31ce3ce9-10ae-447f-888d-9370b25d6b39. {{(pid=88613) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 05 10:18:30 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc4947e-6aac-499d-a404-e00a7dfc980e]: (4, 'raw') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:18:30 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c6003d43-6e06-4d45-b939-f3332e288ac6 tempest-VolumesGetTest-784082675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_89278436-b56f-45f7-8c42-c9afd7bd7453_6q1euma0 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:31 devstack sudo[95529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_89278436-b56f-45f7-8c42-c9afd7bd7453_6q1euma0 Aug 05 10:18:31 devstack sudo[95529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:31 devstack sudo[95529]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:31 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c6003d43-6e06-4d45-b939-f3332e288ac6 tempest-VolumesGetTest-784082675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_89278436-b56f-45f7-8c42-c9afd7bd7453_6q1euma0" returned: 0 in 0.526s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:31 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c6003d43-6e06-4d45-b939-f3332e288ac6 tempest-VolumesGetTest-784082675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_89278436-b56f-45f7-8c42-c9afd7bd7453_6q1euma0 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:31 devstack sudo[95533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_89278436-b56f-45f7-8c42-c9afd7bd7453_6q1euma0 Aug 05 10:18:31 devstack sudo[95533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:31 devstack sudo[95533]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:31 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c6003d43-6e06-4d45-b939-f3332e288ac6 tempest-VolumesGetTest-784082675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_89278436-b56f-45f7-8c42-c9afd7bd7453_6q1euma0" returned: 1 in 0.438s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:31 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c6003d43-6e06-4d45-b939-f3332e288ac6 tempest-VolumesGetTest-784082675 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_89278436-b56f-45f7-8c42-c9afd7bd7453_6q1euma0' failed. Not Retrying. {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 10:18:31 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2cadb6-a878-4dd7-a800-7960282de926]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:18:31 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c6003d43-6e06-4d45-b939-f3332e288ac6 tempest-VolumesGetTest-784082675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89278436-b56f-45f7-8c42-c9afd7bd7453_3risv84sdevstack@QuobyteHD {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:32 devstack sudo[95538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89278436-b56f-45f7-8c42-c9afd7bd7453_3risv84sdevstack@QuobyteHD Aug 05 10:18:32 devstack sudo[95538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:32 devstack sudo[95538]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:32 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c6003d43-6e06-4d45-b939-f3332e288ac6 tempest-VolumesGetTest-784082675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89278436-b56f-45f7-8c42-c9afd7bd7453_3risv84sdevstack@QuobyteHD" returned: 0 in 0.506s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:32 devstack cinder-volume[88613]: DEBUG cinder.image.image_utils [None req-c6003d43-6e06-4d45-b939-f3332e288ac6 tempest-VolumesGetTest-784082675 None] 89278436-b56f-45f7-8c42-c9afd7bd7453 was qcow2, converting to qcow2 {{(pid=88613) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 05 10:18:32 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c6003d43-6e06-4d45-b939-f3332e288ac6 tempest-VolumesGetTest-784082675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_89278436-b56f-45f7-8c42-c9afd7bd7453_3risv84sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-31ce3ce9-10ae-447f-888d-9370b25d6b39 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:32 devstack sudo[95545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_89278436-b56f-45f7-8c42-c9afd7bd7453_3risv84sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-31ce3ce9-10ae-447f-888d-9370b25d6b39 Aug 05 10:18:32 devstack sudo[95545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:34 devstack sudo[95545]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:34 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c6003d43-6e06-4d45-b939-f3332e288ac6 tempest-VolumesGetTest-784082675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_89278436-b56f-45f7-8c42-c9afd7bd7453_3risv84sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-31ce3ce9-10ae-447f-888d-9370b25d6b39" returned: 0 in 2.538s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:34 devstack cinder-volume[88613]: DEBUG cinder.image.image_utils [None req-c6003d43-6e06-4d45-b939-f3332e288ac6 tempest-VolumesGetTest-784082675 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_89278436-b56f-45f7-8c42-c9afd7bd7453_3risv84sdevstack@QuobyteHD, size 112.00 MB, duration 2.54 sec, destination /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-31ce3ce9-10ae-447f-888d-9370b25d6b39 {{(pid=88613) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 10:18:34 devstack cinder-volume[88613]: INFO cinder.image.image_utils [None req-c6003d43-6e06-4d45-b939-f3332e288ac6 tempest-VolumesGetTest-784082675 None] Converted 112.00 MB image at 44.11 MB/s Aug 05 10:18:34 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c6003d43-6e06-4d45-b939-f3332e288ac6 tempest-VolumesGetTest-784082675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-31ce3ce9-10ae-447f-888d-9370b25d6b39 1G {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:34 devstack sudo[95573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-31ce3ce9-10ae-447f-888d-9370b25d6b39 1G Aug 05 10:18:34 devstack sudo[95573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:35 devstack sudo[95573]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:35 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c6003d43-6e06-4d45-b939-f3332e288ac6 tempest-VolumesGetTest-784082675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-31ce3ce9-10ae-447f-888d-9370b25d6b39 1G" returned: 0 in 0.380s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:35 devstack cinder-volume[88613]: DEBUG cinder.volume.volume_utils [None req-c6003d43-6e06-4d45-b939-f3332e288ac6 tempest-VolumesGetTest-784082675 None] Downloaded image 89278436-b56f-45f7-8c42-c9afd7bd7453 ((None, [{'url': 'file:///opt/stack/data/glance/images/89278436-b56f-45f7-8c42-c9afd7bd7453', 'metadata': {}}])) to volume 31ce3ce9-10ae-447f-888d-9370b25d6b39 successfully. {{(pid=88613) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 05 10:18:35 devstack cinder-volume[88613]: DEBUG cinder.image.image_utils [None req-c6003d43-6e06-4d45-b939-f3332e288ac6 tempest-VolumesGetTest-784082675 None] Temporary image 89278436-b56f-45f7-8c42-c9afd7bd7453 for user 02afcf118fdd4d2c9432655c62cfcfaa is deleted. {{(pid=88613) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 05 10:18:35 devstack cinder-volume[88613]: DEBUG cinder.volume.volume_utils [None req-c6003d43-6e06-4d45-b939-f3332e288ac6 tempest-VolumesGetTest-784082675 None] Marking volume 31ce3ce9-10ae-447f-888d-9370b25d6b39 as bootable. {{(pid=88613) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 05 10:18:35 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6003d43-6e06-4d45-b939-f3332e288ac6 tempest-VolumesGetTest-784082675 None] Copying metadata from image 89278436-b56f-45f7-8c42-c9afd7bd7453 to 31ce3ce9-10ae-447f-888d-9370b25d6b39. {{(pid=88613) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 05 10:18:35 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6003d43-6e06-4d45-b939-f3332e288ac6 tempest-VolumesGetTest-784082675 None] Creating volume glance metadata for volume 31ce3ce9-10ae-447f-888d-9370b25d6b39 backed by image 89278436-b56f-45f7-8c42-c9afd7bd7453 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '89278436-b56f-45f7-8c42-c9afd7bd7453', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88613) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 05 10:18:35 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c6003d43-6e06-4d45-b939-f3332e288ac6 tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4552937-a8ce-494b-a812-d0d6b1899ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31ce3ce9-10ae-447f-888d-9370b25d6b39', 'volume_size': 1, 'image_id': '89278436-b56f-45f7-8c42-c9afd7bd7453', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/89278436-b56f-45f7-8c42-c9afd7bd7453', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '654c7af809d145caaadc8738d3dc3df2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '89278436-b56f-45f7-8c42-c9afd7bd7453', 'created_at': datetime.datetime(2026, 8, 5, 8, 7, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 8, 7, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/89278436-b56f-45f7-8c42-c9afd7bd7453/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:18:35 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c6003d43-6e06-4d45-b939-f3332e288ac6 tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d113d588-65e4-4093-9d67-50908b5568e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:18:35 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-c6003d43-6e06-4d45-b939-f3332e288ac6 tempest-VolumesGetTest-784082675 None] Volume volume-31ce3ce9-10ae-447f-888d-9370b25d6b39 (31ce3ce9-10ae-447f-888d-9370b25d6b39): created successfully Aug 05 10:18:35 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c6003d43-6e06-4d45-b939-f3332e288ac6 tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d113d588-65e4-4093-9d67-50908b5568e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:18:35 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c6003d43-6e06-4d45-b939-f3332e288ac6 tempest-VolumesGetTest-784082675 None] Flow 'volume_create_manager' (370443a0-b046-4d68-8d1e-00bcc6d69021) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:18:35 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-c6003d43-6e06-4d45-b939-f3332e288ac6 tempest-VolumesGetTest-784082675 None] Created volume successfully. Aug 05 10:18:36 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-8e78fc0a-34b3-47cd-8cc4-b963212fc6a1 tempest-AttachVolumeTestJSON-1120766613 None] Acquiring lock "cinder-072d33d2-77e7-4635-9183-bc1f6d1482ed-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:18:36 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-8e78fc0a-34b3-47cd-8cc4-b963212fc6a1 tempest-AttachVolumeTestJSON-1120766613 None] Lock "cinder-072d33d2-77e7-4635-9183-bc1f6d1482ed-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:18:36 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-8e78fc0a-34b3-47cd-8cc4-b963212fc6a1 tempest-AttachVolumeTestJSON-1120766613 None] Acquiring lock "cinder-quobyte-072d33d2-77e7-4635-9183-bc1f6d1482ed" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:18:36 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-8e78fc0a-34b3-47cd-8cc4-b963212fc6a1 tempest-AttachVolumeTestJSON-1120766613 None] Lock "cinder-quobyte-072d33d2-77e7-4635-9183-bc1f6d1482ed" acquired by "delete_volume" :: waited 0.029s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:18:36 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d207b4f-11bd-490e-a6e7-27778ea7fe7d]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:18:36 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-8e78fc0a-34b3-47cd-8cc4-b963212fc6a1 tempest-AttachVolumeTestJSON-1120766613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-072d33d2-77e7-4635-9183-bc1f6d1482ed {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:36 devstack sudo[95580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-072d33d2-77e7-4635-9183-bc1f6d1482ed Aug 05 10:18:36 devstack sudo[95580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:36 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a7e9e4a-340a-4c8b-903b-2ba58df19182 tempest-VolumesGetTest-784082675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:18:36 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9a7e9e4a-340a-4c8b-903b-2ba58df19182 tempest-VolumesGetTest-784082675 None] Flow 'volume_create_manager' (614f7bbe-ca6f-497a-adb9-0f7e6d30ee3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:18:36 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9a7e9e4a-340a-4c8b-903b-2ba58df19182 tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f528b8f6-f4dd-45e3-8d9e-b10490269250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:18:36 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9a7e9e4a-340a-4c8b-903b-2ba58df19182 tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f528b8f6-f4dd-45e3-8d9e-b10490269250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:18:36Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-961558305',display_name='tempest-VolumesGetTest-Volume-707179062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55c6c654-30b2-445a-88d1-8fb0b6d741da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a06c5d00bd44107a18e7ae90e338bde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:18:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:18:37Z,use_quota=True,user_id='02afcf118fdd4d2c9432655c62cfcfaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:18:36 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9a7e9e4a-340a-4c8b-903b-2ba58df19182 tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5247341-6e94-4d95-9346-650fcb7d8b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:18:36 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9a7e9e4a-340a-4c8b-903b-2ba58df19182 tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5247341-6e94-4d95-9346-650fcb7d8b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:18:36 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9a7e9e4a-340a-4c8b-903b-2ba58df19182 tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc3efc2c-77b4-4609-9ead-8c5ecb6e0c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:18:37 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9a7e9e4a-340a-4c8b-903b-2ba58df19182 tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc3efc2c-77b4-4609-9ead-8c5ecb6e0c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55c6c654-30b2-445a-88d1-8fb0b6d741da', 'volume_name': 'volume-55c6c654-30b2-445a-88d1-8fb0b6d741da', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:18:37 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9a7e9e4a-340a-4c8b-903b-2ba58df19182 tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c89beed-39b7-40bd-a17a-2dff50e01616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:18:37 devstack sudo[95580]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:37 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9a7e9e4a-340a-4c8b-903b-2ba58df19182 tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c89beed-39b7-40bd-a17a-2dff50e01616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:18:37 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9a7e9e4a-340a-4c8b-903b-2ba58df19182 tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8906d173-1570-40b0-a6f6-a7823b05c0c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:18:37 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-9a7e9e4a-340a-4c8b-903b-2ba58df19182 tempest-VolumesGetTest-784082675 None] Volume 55c6c654-30b2-445a-88d1-8fb0b6d741da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55c6c654-30b2-445a-88d1-8fb0b6d741da', 'volume_size': 1} Aug 05 10:18:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-9a7e9e4a-340a-4c8b-903b-2ba58df19182 tempest-VolumesGetTest-784082675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:18:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-9a7e9e4a-340a-4c8b-903b-2ba58df19182 tempest-VolumesGetTest-784082675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:18:37 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-9a7e9e4a-340a-4c8b-903b-2ba58df19182 tempest-VolumesGetTest-784082675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:18:36Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-961558305',display_name='tempest-VolumesGetTest-Volume-707179062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55c6c654-30b2-445a-88d1-8fb0b6d741da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a06c5d00bd44107a18e7ae90e338bde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:18:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:18:37Z,use_quota=True,user_id='02afcf118fdd4d2c9432655c62cfcfaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:18:37 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-9a7e9e4a-340a-4c8b-903b-2ba58df19182 tempest-VolumesGetTest-784082675 None] Creating volume 55c6c654-30b2-445a-88d1-8fb0b6d741da {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:18:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-9a7e9e4a-340a-4c8b-903b-2ba58df19182 tempest-VolumesGetTest-784082675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:18:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-9a7e9e4a-340a-4c8b-903b-2ba58df19182 tempest-VolumesGetTest-784082675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:18:37 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-9a7e9e4a-340a-4c8b-903b-2ba58df19182 tempest-VolumesGetTest-784082675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:18:37 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-9a7e9e4a-340a-4c8b-903b-2ba58df19182 tempest-VolumesGetTest-784082675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:18:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-9a7e9e4a-340a-4c8b-903b-2ba58df19182 tempest-VolumesGetTest-784082675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:18:37 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-9a7e9e4a-340a-4c8b-903b-2ba58df19182 tempest-VolumesGetTest-784082675 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:18:37 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-9a7e9e4a-340a-4c8b-903b-2ba58df19182 tempest-VolumesGetTest-784082675 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:18:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9a7e9e4a-340a-4c8b-903b-2ba58df19182 tempest-VolumesGetTest-784082675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-55c6c654-30b2-445a-88d1-8fb0b6d741da 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:37 devstack sudo[95606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-55c6c654-30b2-445a-88d1-8fb0b6d741da 1073741824 Aug 05 10:18:37 devstack sudo[95606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-8e78fc0a-34b3-47cd-8cc4-b963212fc6a1 tempest-AttachVolumeTestJSON-1120766613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-072d33d2-77e7-4635-9183-bc1f6d1482ed" returned: 0 in 0.715s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-8e78fc0a-34b3-47cd-8cc4-b963212fc6a1 tempest-AttachVolumeTestJSON-1120766613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-072d33d2-77e7-4635-9183-bc1f6d1482ed {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:37 devstack sudo[95615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-072d33d2-77e7-4635-9183-bc1f6d1482ed Aug 05 10:18:37 devstack sudo[95615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:37 devstack sudo[95615]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-8e78fc0a-34b3-47cd-8cc4-b963212fc6a1 tempest-AttachVolumeTestJSON-1120766613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-072d33d2-77e7-4635-9183-bc1f6d1482ed" returned: 0 in 0.465s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:37 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-8e78fc0a-34b3-47cd-8cc4-b963212fc6a1 tempest-AttachVolumeTestJSON-1120766613 None] Lock "cinder-quobyte-072d33d2-77e7-4635-9183-bc1f6d1482ed" released by "delete_volume" :: held 1.270s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:18:37 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-8e78fc0a-34b3-47cd-8cc4-b963212fc6a1 tempest-AttachVolumeTestJSON-1120766613 None] Created reservations ['38c5af0f-47e5-40e2-9736-2f1bc18a8ede', '04c536ec-7dc7-4ea8-8846-c13362baf452', '1839f665-b024-4203-901a-1b5d30e5b982', '83361cbc-1906-464c-a0f8-51f1b491106b'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:18:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-8e78fc0a-34b3-47cd-8cc4-b963212fc6a1 tempest-AttachVolumeTestJSON-1120766613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:18:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-8e78fc0a-34b3-47cd-8cc4-b963212fc6a1 tempest-AttachVolumeTestJSON-1120766613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:18:37 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-8e78fc0a-34b3-47cd-8cc4-b963212fc6a1 tempest-AttachVolumeTestJSON-1120766613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:18:37 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-8e78fc0a-34b3-47cd-8cc4-b963212fc6a1 tempest-AttachVolumeTestJSON-1120766613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:18:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-8e78fc0a-34b3-47cd-8cc4-b963212fc6a1 tempest-AttachVolumeTestJSON-1120766613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:18:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-8e78fc0a-34b3-47cd-8cc4-b963212fc6a1 tempest-AttachVolumeTestJSON-1120766613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:37 devstack sudo[95647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:18:37 devstack sudo[95647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:37 devstack sudo[95606]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9a7e9e4a-340a-4c8b-903b-2ba58df19182 tempest-VolumesGetTest-784082675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-55c6c654-30b2-445a-88d1-8fb0b6d741da 1073741824" returned: 0 in 0.819s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9a7e9e4a-340a-4c8b-903b-2ba58df19182 tempest-VolumesGetTest-784082675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-55c6c654-30b2-445a-88d1-8fb0b6d741da {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:38 devstack sudo[95653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-55c6c654-30b2-445a-88d1-8fb0b6d741da Aug 05 10:18:38 devstack sudo[95653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:38 devstack sudo[95647]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:38 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-8e78fc0a-34b3-47cd-8cc4-b963212fc6a1 tempest-AttachVolumeTestJSON-1120766613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.335s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:38 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-8e78fc0a-34b3-47cd-8cc4-b963212fc6a1 tempest-AttachVolumeTestJSON-1120766613 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:18:38 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-8e78fc0a-34b3-47cd-8cc4-b963212fc6a1 tempest-AttachVolumeTestJSON-1120766613 None] Deleted volume successfully. Aug 05 10:18:38 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-8e78fc0a-34b3-47cd-8cc4-b963212fc6a1 tempest-AttachVolumeTestJSON-1120766613 None] Lock "cinder-072d33d2-77e7-4635-9183-bc1f6d1482ed-delete_volume" released by "delete_volume" :: held 1.964s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:18:38 devstack sudo[95653]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:38 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9a7e9e4a-340a-4c8b-903b-2ba58df19182 tempest-VolumesGetTest-784082675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-55c6c654-30b2-445a-88d1-8fb0b6d741da" returned: 0 in 0.321s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:38 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-9a7e9e4a-340a-4c8b-903b-2ba58df19182 tempest-VolumesGetTest-784082675 None] <== create_volume: return (1229ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:18:38 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-9a7e9e4a-340a-4c8b-903b-2ba58df19182 tempest-VolumesGetTest-784082675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.234s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:18:38 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9a7e9e4a-340a-4c8b-903b-2ba58df19182 tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8906d173-1570-40b0-a6f6-a7823b05c0c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55c6c654-30b2-445a-88d1-8fb0b6d741da', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:18:38 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9a7e9e4a-340a-4c8b-903b-2ba58df19182 tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f2e947f-49ce-4b99-900b-21d31e1c689f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:18:38 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-9a7e9e4a-340a-4c8b-903b-2ba58df19182 tempest-VolumesGetTest-784082675 None] Volume volume-55c6c654-30b2-445a-88d1-8fb0b6d741da (55c6c654-30b2-445a-88d1-8fb0b6d741da): created successfully Aug 05 10:18:38 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9a7e9e4a-340a-4c8b-903b-2ba58df19182 tempest-VolumesGetTest-784082675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f2e947f-49ce-4b99-900b-21d31e1c689f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:18:38 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9a7e9e4a-340a-4c8b-903b-2ba58df19182 tempest-VolumesGetTest-784082675 None] Flow 'volume_create_manager' (614f7bbe-ca6f-497a-adb9-0f7e6d30ee3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:18:38 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-9a7e9e4a-340a-4c8b-903b-2ba58df19182 tempest-VolumesGetTest-784082675 None] Created volume successfully. Aug 05 10:18:38 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-288bfb89-e989-4980-b810-5507b59729dd tempest-AttachVolumeTestJSON-1120766613 None] Acquiring lock "cinder-67b1103e-ece4-434f-b02f-ff3a651fe7d3-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:18:38 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-288bfb89-e989-4980-b810-5507b59729dd tempest-AttachVolumeTestJSON-1120766613 None] Lock "cinder-67b1103e-ece4-434f-b02f-ff3a651fe7d3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:18:38 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-288bfb89-e989-4980-b810-5507b59729dd tempest-AttachVolumeTestJSON-1120766613 None] Acquiring lock "cinder-quobyte-67b1103e-ece4-434f-b02f-ff3a651fe7d3" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:18:38 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-288bfb89-e989-4980-b810-5507b59729dd tempest-AttachVolumeTestJSON-1120766613 None] Lock "cinder-quobyte-67b1103e-ece4-434f-b02f-ff3a651fe7d3" acquired by "delete_volume" :: waited 0.034s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:18:38 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[759f3908-0e3d-4595-92ca-a938e56f0457]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:18:38 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-288bfb89-e989-4980-b810-5507b59729dd tempest-AttachVolumeTestJSON-1120766613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-67b1103e-ece4-434f-b02f-ff3a651fe7d3 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:38 devstack sudo[95679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-67b1103e-ece4-434f-b02f-ff3a651fe7d3 Aug 05 10:18:38 devstack sudo[95679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:39 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-fef27b5d-642d-4632-bdbc-c617cfebdff3 tempest-VolumesGetTest-784082675 None] Acquiring lock "cinder-55c6c654-30b2-445a-88d1-8fb0b6d741da-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:18:39 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-fef27b5d-642d-4632-bdbc-c617cfebdff3 tempest-VolumesGetTest-784082675 None] Lock "cinder-55c6c654-30b2-445a-88d1-8fb0b6d741da-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:18:39 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-fef27b5d-642d-4632-bdbc-c617cfebdff3 tempest-VolumesGetTest-784082675 None] Acquiring lock "cinder-quobyte-55c6c654-30b2-445a-88d1-8fb0b6d741da" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:18:39 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-fef27b5d-642d-4632-bdbc-c617cfebdff3 tempest-VolumesGetTest-784082675 None] Lock "cinder-quobyte-55c6c654-30b2-445a-88d1-8fb0b6d741da" acquired by "delete_volume" :: waited 0.035s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:18:39 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[661ba5cb-d02d-4289-9a5b-b75ebf4be045]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:18:39 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-fef27b5d-642d-4632-bdbc-c617cfebdff3 tempest-VolumesGetTest-784082675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-55c6c654-30b2-445a-88d1-8fb0b6d741da {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:39 devstack sudo[95679]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:39 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-288bfb89-e989-4980-b810-5507b59729dd tempest-AttachVolumeTestJSON-1120766613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-67b1103e-ece4-434f-b02f-ff3a651fe7d3" returned: 0 in 0.641s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:39 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-288bfb89-e989-4980-b810-5507b59729dd tempest-AttachVolumeTestJSON-1120766613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-67b1103e-ece4-434f-b02f-ff3a651fe7d3 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:39 devstack sudo[95685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-67b1103e-ece4-434f-b02f-ff3a651fe7d3 Aug 05 10:18:39 devstack sudo[95685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:39 devstack sudo[95684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-55c6c654-30b2-445a-88d1-8fb0b6d741da Aug 05 10:18:39 devstack sudo[95684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:39 devstack sudo[95685]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:39 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-288bfb89-e989-4980-b810-5507b59729dd tempest-AttachVolumeTestJSON-1120766613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-67b1103e-ece4-434f-b02f-ff3a651fe7d3" returned: 0 in 0.409s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:39 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-288bfb89-e989-4980-b810-5507b59729dd tempest-AttachVolumeTestJSON-1120766613 None] Lock "cinder-quobyte-67b1103e-ece4-434f-b02f-ff3a651fe7d3" released by "delete_volume" :: held 1.119s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:18:39 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-288bfb89-e989-4980-b810-5507b59729dd tempest-AttachVolumeTestJSON-1120766613 None] Created reservations ['c418e4e6-b561-4f04-8a29-6ce05d8ba624', '6fe18bd1-90bb-46bc-a5c8-ad3b1be89f26', 'a590f9a1-9db7-49fe-b204-0c5165742491', '97a5b711-2501-49aa-9420-404d40d55711'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:18:39 devstack sudo[95684]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:40 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-fef27b5d-642d-4632-bdbc-c617cfebdff3 tempest-VolumesGetTest-784082675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-55c6c654-30b2-445a-88d1-8fb0b6d741da" returned: 0 in 0.642s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:40 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-fef27b5d-642d-4632-bdbc-c617cfebdff3 tempest-VolumesGetTest-784082675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-55c6c654-30b2-445a-88d1-8fb0b6d741da {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:40 devstack sudo[95695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-55c6c654-30b2-445a-88d1-8fb0b6d741da Aug 05 10:18:40 devstack sudo[95695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:40 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-288bfb89-e989-4980-b810-5507b59729dd tempest-AttachVolumeTestJSON-1120766613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:18:40 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-288bfb89-e989-4980-b810-5507b59729dd tempest-AttachVolumeTestJSON-1120766613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:18:40 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-288bfb89-e989-4980-b810-5507b59729dd tempest-AttachVolumeTestJSON-1120766613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:18:40 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-288bfb89-e989-4980-b810-5507b59729dd tempest-AttachVolumeTestJSON-1120766613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:18:40 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-288bfb89-e989-4980-b810-5507b59729dd tempest-AttachVolumeTestJSON-1120766613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:18:40 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-288bfb89-e989-4980-b810-5507b59729dd tempest-AttachVolumeTestJSON-1120766613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:40 devstack sudo[95697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:18:40 devstack sudo[95697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:40 devstack sudo[95695]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:40 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-fef27b5d-642d-4632-bdbc-c617cfebdff3 tempest-VolumesGetTest-784082675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-55c6c654-30b2-445a-88d1-8fb0b6d741da" returned: 0 in 0.608s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:40 devstack sudo[95697]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:40 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-fef27b5d-642d-4632-bdbc-c617cfebdff3 tempest-VolumesGetTest-784082675 None] Lock "cinder-quobyte-55c6c654-30b2-445a-88d1-8fb0b6d741da" released by "delete_volume" :: held 1.342s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:18:40 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-288bfb89-e989-4980-b810-5507b59729dd tempest-AttachVolumeTestJSON-1120766613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.360s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:40 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-288bfb89-e989-4980-b810-5507b59729dd tempest-AttachVolumeTestJSON-1120766613 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:18:40 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-288bfb89-e989-4980-b810-5507b59729dd tempest-AttachVolumeTestJSON-1120766613 None] Deleted volume successfully. Aug 05 10:18:40 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-288bfb89-e989-4980-b810-5507b59729dd tempest-AttachVolumeTestJSON-1120766613 None] Lock "cinder-67b1103e-ece4-434f-b02f-ff3a651fe7d3-delete_volume" released by "delete_volume" :: held 2.088s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:18:40 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-fef27b5d-642d-4632-bdbc-c617cfebdff3 tempest-VolumesGetTest-784082675 None] Created reservations ['2313c48b-3f73-481a-a310-5b7cd884220c', '52cc6d96-f81f-4be8-8356-a2190d3e04c4', '2de396fc-f9ff-4432-ba7f-d60f5cf2c9da', 'd01f5e8b-8f0c-4557-b52c-e2874cc65af4'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:18:40 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-fef27b5d-642d-4632-bdbc-c617cfebdff3 tempest-VolumesGetTest-784082675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:18:40 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-fef27b5d-642d-4632-bdbc-c617cfebdff3 tempest-VolumesGetTest-784082675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:18:40 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-fef27b5d-642d-4632-bdbc-c617cfebdff3 tempest-VolumesGetTest-784082675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:18:40 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-fef27b5d-642d-4632-bdbc-c617cfebdff3 tempest-VolumesGetTest-784082675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:18:40 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-fef27b5d-642d-4632-bdbc-c617cfebdff3 tempest-VolumesGetTest-784082675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:18:40 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-fef27b5d-642d-4632-bdbc-c617cfebdff3 tempest-VolumesGetTest-784082675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:40 devstack sudo[95701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:18:40 devstack sudo[95701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:41 devstack sudo[95701]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:41 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-fef27b5d-642d-4632-bdbc-c617cfebdff3 tempest-VolumesGetTest-784082675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.404s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:41 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-fef27b5d-642d-4632-bdbc-c617cfebdff3 tempest-VolumesGetTest-784082675 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:18:41 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-fef27b5d-642d-4632-bdbc-c617cfebdff3 tempest-VolumesGetTest-784082675 None] Deleted volume successfully. Aug 05 10:18:41 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-fef27b5d-642d-4632-bdbc-c617cfebdff3 tempest-VolumesGetTest-784082675 None] Lock "cinder-55c6c654-30b2-445a-88d1-8fb0b6d741da-delete_volume" released by "delete_volume" :: held 2.157s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:18:41 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-abe95c1b-d16a-4e46-9ee0-6ff8cf69bfbd tempest-AttachVolumeTestJSON-1120766613 None] Acquiring lock "cinder-6bd911e2-d72e-4233-bfe3-79fe19722869-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:18:41 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-abe95c1b-d16a-4e46-9ee0-6ff8cf69bfbd tempest-AttachVolumeTestJSON-1120766613 None] Lock "cinder-6bd911e2-d72e-4233-bfe3-79fe19722869-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:18:41 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-abe95c1b-d16a-4e46-9ee0-6ff8cf69bfbd tempest-AttachVolumeTestJSON-1120766613 None] Acquiring lock "cinder-quobyte-6bd911e2-d72e-4233-bfe3-79fe19722869" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:18:41 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-abe95c1b-d16a-4e46-9ee0-6ff8cf69bfbd tempest-AttachVolumeTestJSON-1120766613 None] Lock "cinder-quobyte-6bd911e2-d72e-4233-bfe3-79fe19722869" acquired by "delete_volume" :: waited 0.041s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:18:41 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d7eab8-418c-44ab-b6bd-f9ad43c5d0fc]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:18:41 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-abe95c1b-d16a-4e46-9ee0-6ff8cf69bfbd tempest-AttachVolumeTestJSON-1120766613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6bd911e2-d72e-4233-bfe3-79fe19722869 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:41 devstack sudo[95705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6bd911e2-d72e-4233-bfe3-79fe19722869 Aug 05 10:18:41 devstack sudo[95705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:41 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-db4aaa3c-712b-4364-be10-f53abe37cd26 tempest-VolumesGetTest-784082675 None] Acquiring lock "cinder-31ce3ce9-10ae-447f-888d-9370b25d6b39-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:18:41 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-db4aaa3c-712b-4364-be10-f53abe37cd26 tempest-VolumesGetTest-784082675 None] Lock "cinder-31ce3ce9-10ae-447f-888d-9370b25d6b39-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:18:41 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-db4aaa3c-712b-4364-be10-f53abe37cd26 tempest-VolumesGetTest-784082675 None] Acquiring lock "cinder-quobyte-31ce3ce9-10ae-447f-888d-9370b25d6b39" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:18:41 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-db4aaa3c-712b-4364-be10-f53abe37cd26 tempest-VolumesGetTest-784082675 None] Lock "cinder-quobyte-31ce3ce9-10ae-447f-888d-9370b25d6b39" acquired by "delete_volume" :: waited 0.022s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:18:41 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b37fa5-aca6-488b-bc7e-34ab17740f35]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:18:41 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-db4aaa3c-712b-4364-be10-f53abe37cd26 tempest-VolumesGetTest-784082675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-31ce3ce9-10ae-447f-888d-9370b25d6b39 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:42 devstack sudo[95707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-31ce3ce9-10ae-447f-888d-9370b25d6b39 Aug 05 10:18:42 devstack sudo[95707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:42 devstack sudo[95705]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:42 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-abe95c1b-d16a-4e46-9ee0-6ff8cf69bfbd tempest-AttachVolumeTestJSON-1120766613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6bd911e2-d72e-4233-bfe3-79fe19722869" returned: 0 in 0.711s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:42 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-abe95c1b-d16a-4e46-9ee0-6ff8cf69bfbd tempest-AttachVolumeTestJSON-1120766613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6bd911e2-d72e-4233-bfe3-79fe19722869 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:42 devstack sudo[95712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6bd911e2-d72e-4233-bfe3-79fe19722869 Aug 05 10:18:42 devstack sudo[95712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:42 devstack sudo[95707]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:42 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-db4aaa3c-712b-4364-be10-f53abe37cd26 tempest-VolumesGetTest-784082675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-31ce3ce9-10ae-447f-888d-9370b25d6b39" returned: 0 in 0.692s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:42 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-db4aaa3c-712b-4364-be10-f53abe37cd26 tempest-VolumesGetTest-784082675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-31ce3ce9-10ae-447f-888d-9370b25d6b39 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:42 devstack sudo[95720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-31ce3ce9-10ae-447f-888d-9370b25d6b39 Aug 05 10:18:42 devstack sudo[95720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:42 devstack sudo[95712]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:42 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-abe95c1b-d16a-4e46-9ee0-6ff8cf69bfbd tempest-AttachVolumeTestJSON-1120766613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6bd911e2-d72e-4233-bfe3-79fe19722869" returned: 0 in 0.527s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:42 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-abe95c1b-d16a-4e46-9ee0-6ff8cf69bfbd tempest-AttachVolumeTestJSON-1120766613 None] Lock "cinder-quobyte-6bd911e2-d72e-4233-bfe3-79fe19722869" released by "delete_volume" :: held 1.362s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:18:43 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-abe95c1b-d16a-4e46-9ee0-6ff8cf69bfbd tempest-AttachVolumeTestJSON-1120766613 None] Created reservations ['154b4ad4-655c-4ab6-8228-98ed4defcadc', '3e44dd13-d077-4812-8fab-a6758fd54781', '699ec9dc-2233-4cae-86a4-89ea6b230f99', '84fb4a68-aadd-4efb-a12d-4d83b62d0074'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:18:43 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-abe95c1b-d16a-4e46-9ee0-6ff8cf69bfbd tempest-AttachVolumeTestJSON-1120766613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:18:43 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-abe95c1b-d16a-4e46-9ee0-6ff8cf69bfbd tempest-AttachVolumeTestJSON-1120766613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:18:43 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-abe95c1b-d16a-4e46-9ee0-6ff8cf69bfbd tempest-AttachVolumeTestJSON-1120766613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:18:43 devstack sudo[95720]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:43 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-abe95c1b-d16a-4e46-9ee0-6ff8cf69bfbd tempest-AttachVolumeTestJSON-1120766613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:18:43 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-abe95c1b-d16a-4e46-9ee0-6ff8cf69bfbd tempest-AttachVolumeTestJSON-1120766613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:18:43 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-abe95c1b-d16a-4e46-9ee0-6ff8cf69bfbd tempest-AttachVolumeTestJSON-1120766613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:43 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-db4aaa3c-712b-4364-be10-f53abe37cd26 tempest-VolumesGetTest-784082675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-31ce3ce9-10ae-447f-888d-9370b25d6b39" returned: 0 in 0.521s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:43 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-db4aaa3c-712b-4364-be10-f53abe37cd26 tempest-VolumesGetTest-784082675 None] Lock "cinder-quobyte-31ce3ce9-10ae-447f-888d-9370b25d6b39" released by "delete_volume" :: held 1.271s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:18:43 devstack sudo[95724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:18:43 devstack sudo[95724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:43 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-db4aaa3c-712b-4364-be10-f53abe37cd26 tempest-VolumesGetTest-784082675 None] Created reservations ['8a2a59c7-c515-472d-93b7-0edd6c301f10', '47d4c3de-bbcb-439a-ac10-32ce801792f4', '76f42907-acf7-4a5e-918e-5f09c951408e', '3632faf5-7c1d-4953-ba0a-0f375d49ee5f'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:18:43 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-db4aaa3c-712b-4364-be10-f53abe37cd26 tempest-VolumesGetTest-784082675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:18:43 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-db4aaa3c-712b-4364-be10-f53abe37cd26 tempest-VolumesGetTest-784082675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:18:43 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-db4aaa3c-712b-4364-be10-f53abe37cd26 tempest-VolumesGetTest-784082675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:18:43 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-db4aaa3c-712b-4364-be10-f53abe37cd26 tempest-VolumesGetTest-784082675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:18:43 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-db4aaa3c-712b-4364-be10-f53abe37cd26 tempest-VolumesGetTest-784082675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:18:43 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-db4aaa3c-712b-4364-be10-f53abe37cd26 tempest-VolumesGetTest-784082675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:43 devstack sudo[95727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:18:43 devstack sudo[95727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:43 devstack sudo[95724]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:43 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-abe95c1b-d16a-4e46-9ee0-6ff8cf69bfbd tempest-AttachVolumeTestJSON-1120766613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.332s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:43 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-abe95c1b-d16a-4e46-9ee0-6ff8cf69bfbd tempest-AttachVolumeTestJSON-1120766613 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:18:43 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-abe95c1b-d16a-4e46-9ee0-6ff8cf69bfbd tempest-AttachVolumeTestJSON-1120766613 None] Deleted volume successfully. Aug 05 10:18:43 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-abe95c1b-d16a-4e46-9ee0-6ff8cf69bfbd tempest-AttachVolumeTestJSON-1120766613 None] Lock "cinder-6bd911e2-d72e-4233-bfe3-79fe19722869-delete_volume" released by "delete_volume" :: held 2.139s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:18:43 devstack sudo[95727]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:43 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-db4aaa3c-712b-4364-be10-f53abe37cd26 tempest-VolumesGetTest-784082675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.347s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:43 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-db4aaa3c-712b-4364-be10-f53abe37cd26 tempest-VolumesGetTest-784082675 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:18:43 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-db4aaa3c-712b-4364-be10-f53abe37cd26 tempest-VolumesGetTest-784082675 None] Deleted volume successfully. Aug 05 10:18:43 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-db4aaa3c-712b-4364-be10-f53abe37cd26 tempest-VolumesGetTest-784082675 None] Lock "cinder-31ce3ce9-10ae-447f-888d-9370b25d6b39-delete_volume" released by "delete_volume" :: held 1.987s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:18:49 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-45cbcc63-4d35-42ff-8814-959f01c406c1 tempest-VolumesListTestJSON-1772353282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:18:49 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-45cbcc63-4d35-42ff-8814-959f01c406c1 tempest-VolumesListTestJSON-1772353282 None] Flow 'volume_create_manager' (b9c194f2-8e65-44c0-932b-05596f1fd884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:18:49 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-45cbcc63-4d35-42ff-8814-959f01c406c1 tempest-VolumesListTestJSON-1772353282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd7503bb-58b3-495c-b145-c1a10dc0a040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:18:50 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-45cbcc63-4d35-42ff-8814-959f01c406c1 tempest-VolumesListTestJSON-1772353282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd7503bb-58b3-495c-b145-c1a10dc0a040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:18:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1905104505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a0789cf-6a37-49ad-8447-4da10d5794e3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='582d371d809b4c318459a151c70643b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:18:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:18:50Z,use_quota=True,user_id='f2a12aebf8234605bac8949fca93c274',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:18:50 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-45cbcc63-4d35-42ff-8814-959f01c406c1 tempest-VolumesListTestJSON-1772353282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37716b00-d71b-4614-b9a2-0f026a3f6bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:18:50 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-45cbcc63-4d35-42ff-8814-959f01c406c1 tempest-VolumesListTestJSON-1772353282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37716b00-d71b-4614-b9a2-0f026a3f6bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:18:50 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-45cbcc63-4d35-42ff-8814-959f01c406c1 tempest-VolumesListTestJSON-1772353282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7e2f72a-1805-4773-9333-d87bf351a449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:18:50 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-45cbcc63-4d35-42ff-8814-959f01c406c1 tempest-VolumesListTestJSON-1772353282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7e2f72a-1805-4773-9333-d87bf351a449) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a0789cf-6a37-49ad-8447-4da10d5794e3', 'volume_name': 'volume-8a0789cf-6a37-49ad-8447-4da10d5794e3', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:18:50 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-45cbcc63-4d35-42ff-8814-959f01c406c1 tempest-VolumesListTestJSON-1772353282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e69ba99-e3c5-428b-ae55-05100cf758ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:18:50 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-45cbcc63-4d35-42ff-8814-959f01c406c1 tempest-VolumesListTestJSON-1772353282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e69ba99-e3c5-428b-ae55-05100cf758ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:18:50 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-45cbcc63-4d35-42ff-8814-959f01c406c1 tempest-VolumesListTestJSON-1772353282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c0ff3b9-3bdd-432d-82ec-b8dcc677fe81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:18:50 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-45cbcc63-4d35-42ff-8814-959f01c406c1 tempest-VolumesListTestJSON-1772353282 None] Volume 8a0789cf-6a37-49ad-8447-4da10d5794e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a0789cf-6a37-49ad-8447-4da10d5794e3', 'volume_size': 1} Aug 05 10:18:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-45cbcc63-4d35-42ff-8814-959f01c406c1 tempest-VolumesListTestJSON-1772353282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:18:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-45cbcc63-4d35-42ff-8814-959f01c406c1 tempest-VolumesListTestJSON-1772353282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:18:50 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-45cbcc63-4d35-42ff-8814-959f01c406c1 tempest-VolumesListTestJSON-1772353282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:18:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1905104505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a0789cf-6a37-49ad-8447-4da10d5794e3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='582d371d809b4c318459a151c70643b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:18:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:18:50Z,use_quota=True,user_id='f2a12aebf8234605bac8949fca93c274',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:18:50 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-45cbcc63-4d35-42ff-8814-959f01c406c1 tempest-VolumesListTestJSON-1772353282 None] Creating volume 8a0789cf-6a37-49ad-8447-4da10d5794e3 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:18:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-45cbcc63-4d35-42ff-8814-959f01c406c1 tempest-VolumesListTestJSON-1772353282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:18:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-45cbcc63-4d35-42ff-8814-959f01c406c1 tempest-VolumesListTestJSON-1772353282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:18:50 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-45cbcc63-4d35-42ff-8814-959f01c406c1 tempest-VolumesListTestJSON-1772353282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:18:50 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-45cbcc63-4d35-42ff-8814-959f01c406c1 tempest-VolumesListTestJSON-1772353282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:18:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-45cbcc63-4d35-42ff-8814-959f01c406c1 tempest-VolumesListTestJSON-1772353282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:18:50 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-45cbcc63-4d35-42ff-8814-959f01c406c1 tempest-VolumesListTestJSON-1772353282 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:18:50 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-45cbcc63-4d35-42ff-8814-959f01c406c1 tempest-VolumesListTestJSON-1772353282 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:18:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-45cbcc63-4d35-42ff-8814-959f01c406c1 tempest-VolumesListTestJSON-1772353282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8a0789cf-6a37-49ad-8447-4da10d5794e3 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:50 devstack sudo[95810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8a0789cf-6a37-49ad-8447-4da10d5794e3 1073741824 Aug 05 10:18:50 devstack sudo[95810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:50 devstack sudo[95810]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-45cbcc63-4d35-42ff-8814-959f01c406c1 tempest-VolumesListTestJSON-1772353282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8a0789cf-6a37-49ad-8447-4da10d5794e3 1073741824" returned: 0 in 0.743s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-45cbcc63-4d35-42ff-8814-959f01c406c1 tempest-VolumesListTestJSON-1772353282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8a0789cf-6a37-49ad-8447-4da10d5794e3 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:50 devstack sudo[95817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8a0789cf-6a37-49ad-8447-4da10d5794e3 Aug 05 10:18:50 devstack sudo[95817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:51 devstack sudo[95817]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-45cbcc63-4d35-42ff-8814-959f01c406c1 tempest-VolumesListTestJSON-1772353282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8a0789cf-6a37-49ad-8447-4da10d5794e3" returned: 0 in 0.318s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:51 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-45cbcc63-4d35-42ff-8814-959f01c406c1 tempest-VolumesListTestJSON-1772353282 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:18:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-45cbcc63-4d35-42ff-8814-959f01c406c1 tempest-VolumesListTestJSON-1772353282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.155s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:18:51 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-45cbcc63-4d35-42ff-8814-959f01c406c1 tempest-VolumesListTestJSON-1772353282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c0ff3b9-3bdd-432d-82ec-b8dcc677fe81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a0789cf-6a37-49ad-8447-4da10d5794e3', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:18:51 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-45cbcc63-4d35-42ff-8814-959f01c406c1 tempest-VolumesListTestJSON-1772353282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ecab759-f1a6-4050-94c2-5e926389e6fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:18:51 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-45cbcc63-4d35-42ff-8814-959f01c406c1 tempest-VolumesListTestJSON-1772353282 None] Volume volume-8a0789cf-6a37-49ad-8447-4da10d5794e3 (8a0789cf-6a37-49ad-8447-4da10d5794e3): created successfully Aug 05 10:18:51 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-45cbcc63-4d35-42ff-8814-959f01c406c1 tempest-VolumesListTestJSON-1772353282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ecab759-f1a6-4050-94c2-5e926389e6fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:18:51 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-45cbcc63-4d35-42ff-8814-959f01c406c1 tempest-VolumesListTestJSON-1772353282 None] Flow 'volume_create_manager' (b9c194f2-8e65-44c0-932b-05596f1fd884) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:18:51 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-45cbcc63-4d35-42ff-8814-959f01c406c1 tempest-VolumesListTestJSON-1772353282 None] Created volume successfully. Aug 05 10:18:53 devstack cinder-volume[88613]: DEBUG dbcounter [-] [88613] Writing DB stats cinder:UPDATE=130,cinder:SELECT=119,cinder:INSERT=35,cinder:DELETE=13 {{(pid=88613) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:18:53 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-1edf16c4-02e2-4949-b155-aa96f8b013e8 tempest-VolumesListTestJSON-1772353282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:18:53 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1edf16c4-02e2-4949-b155-aa96f8b013e8 tempest-VolumesListTestJSON-1772353282 None] Flow 'volume_create_manager' (92a98f3b-da34-4ead-bb36-b102982f29ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:18:53 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1edf16c4-02e2-4949-b155-aa96f8b013e8 tempest-VolumesListTestJSON-1772353282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bb41d16-df8a-4577-bbf5-74a46fcc5bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:18:53 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1edf16c4-02e2-4949-b155-aa96f8b013e8 tempest-VolumesListTestJSON-1772353282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bb41d16-df8a-4577-bbf5-74a46fcc5bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:18:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-306544224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de477a2b-863e-475e-a468-d573cb43eb43,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='582d371d809b4c318459a151c70643b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:18:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:18:53Z,use_quota=True,user_id='f2a12aebf8234605bac8949fca93c274',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:18:53 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1edf16c4-02e2-4949-b155-aa96f8b013e8 tempest-VolumesListTestJSON-1772353282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adca95d0-41ef-4a91-90d3-a0ec7dbac2bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:18:53 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1edf16c4-02e2-4949-b155-aa96f8b013e8 tempest-VolumesListTestJSON-1772353282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adca95d0-41ef-4a91-90d3-a0ec7dbac2bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:18:53 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1edf16c4-02e2-4949-b155-aa96f8b013e8 tempest-VolumesListTestJSON-1772353282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e6e53bd-1021-453f-be37-76b6072cb4c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:18:53 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1edf16c4-02e2-4949-b155-aa96f8b013e8 tempest-VolumesListTestJSON-1772353282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e6e53bd-1021-453f-be37-76b6072cb4c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de477a2b-863e-475e-a468-d573cb43eb43', 'volume_name': 'volume-de477a2b-863e-475e-a468-d573cb43eb43', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:18:53 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1edf16c4-02e2-4949-b155-aa96f8b013e8 tempest-VolumesListTestJSON-1772353282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01f6c4f5-ba7b-4971-881a-346228fb0711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:18:53 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1edf16c4-02e2-4949-b155-aa96f8b013e8 tempest-VolumesListTestJSON-1772353282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01f6c4f5-ba7b-4971-881a-346228fb0711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:18:53 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1edf16c4-02e2-4949-b155-aa96f8b013e8 tempest-VolumesListTestJSON-1772353282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18af657f-d675-465c-86b9-70fa219eb92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:18:53 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-1edf16c4-02e2-4949-b155-aa96f8b013e8 tempest-VolumesListTestJSON-1772353282 None] Volume de477a2b-863e-475e-a468-d573cb43eb43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de477a2b-863e-475e-a468-d573cb43eb43', 'volume_size': 1} Aug 05 10:18:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-1edf16c4-02e2-4949-b155-aa96f8b013e8 tempest-VolumesListTestJSON-1772353282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:18:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-1edf16c4-02e2-4949-b155-aa96f8b013e8 tempest-VolumesListTestJSON-1772353282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:18:53 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-1edf16c4-02e2-4949-b155-aa96f8b013e8 tempest-VolumesListTestJSON-1772353282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:18:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-306544224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de477a2b-863e-475e-a468-d573cb43eb43,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='582d371d809b4c318459a151c70643b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:18:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:18:53Z,use_quota=True,user_id='f2a12aebf8234605bac8949fca93c274',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:18:53 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-1edf16c4-02e2-4949-b155-aa96f8b013e8 tempest-VolumesListTestJSON-1772353282 None] Creating volume de477a2b-863e-475e-a468-d573cb43eb43 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:18:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-1edf16c4-02e2-4949-b155-aa96f8b013e8 tempest-VolumesListTestJSON-1772353282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:18:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-1edf16c4-02e2-4949-b155-aa96f8b013e8 tempest-VolumesListTestJSON-1772353282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:18:53 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-1edf16c4-02e2-4949-b155-aa96f8b013e8 tempest-VolumesListTestJSON-1772353282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:18:53 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-1edf16c4-02e2-4949-b155-aa96f8b013e8 tempest-VolumesListTestJSON-1772353282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:18:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-1edf16c4-02e2-4949-b155-aa96f8b013e8 tempest-VolumesListTestJSON-1772353282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:18:53 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-1edf16c4-02e2-4949-b155-aa96f8b013e8 tempest-VolumesListTestJSON-1772353282 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:18:53 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-1edf16c4-02e2-4949-b155-aa96f8b013e8 tempest-VolumesListTestJSON-1772353282 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:18:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1edf16c4-02e2-4949-b155-aa96f8b013e8 tempest-VolumesListTestJSON-1772353282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-de477a2b-863e-475e-a468-d573cb43eb43 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:53 devstack sudo[95888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-de477a2b-863e-475e-a468-d573cb43eb43 1073741824 Aug 05 10:18:53 devstack sudo[95888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:54 devstack sudo[95888]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1edf16c4-02e2-4949-b155-aa96f8b013e8 tempest-VolumesListTestJSON-1772353282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-de477a2b-863e-475e-a468-d573cb43eb43 1073741824" returned: 0 in 0.799s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:54 devstack cinder-volume[88613]: DEBUG dbcounter [-] [88613] Writing DB stats cinder:SELECT=116,cinder:UPDATE=146,cinder:DELETE=10,cinder:INSERT=39 {{(pid=88613) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:18:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1edf16c4-02e2-4949-b155-aa96f8b013e8 tempest-VolumesListTestJSON-1772353282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-de477a2b-863e-475e-a468-d573cb43eb43 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:54 devstack sudo[95928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-de477a2b-863e-475e-a468-d573cb43eb43 Aug 05 10:18:54 devstack sudo[95928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:55 devstack sudo[95928]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:55 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1edf16c4-02e2-4949-b155-aa96f8b013e8 tempest-VolumesListTestJSON-1772353282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-de477a2b-863e-475e-a468-d573cb43eb43" returned: 0 in 0.460s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:55 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-1edf16c4-02e2-4949-b155-aa96f8b013e8 tempest-VolumesListTestJSON-1772353282 None] <== create_volume: return (1344ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:18:55 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-1edf16c4-02e2-4949-b155-aa96f8b013e8 tempest-VolumesListTestJSON-1772353282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.347s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:18:55 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1edf16c4-02e2-4949-b155-aa96f8b013e8 tempest-VolumesListTestJSON-1772353282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18af657f-d675-465c-86b9-70fa219eb92c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de477a2b-863e-475e-a468-d573cb43eb43', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:18:55 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1edf16c4-02e2-4949-b155-aa96f8b013e8 tempest-VolumesListTestJSON-1772353282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78c4b0bd-12a4-4499-b896-0f11e0656f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:18:55 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-1edf16c4-02e2-4949-b155-aa96f8b013e8 tempest-VolumesListTestJSON-1772353282 None] Volume volume-de477a2b-863e-475e-a468-d573cb43eb43 (de477a2b-863e-475e-a468-d573cb43eb43): created successfully Aug 05 10:18:55 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1edf16c4-02e2-4949-b155-aa96f8b013e8 tempest-VolumesListTestJSON-1772353282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78c4b0bd-12a4-4499-b896-0f11e0656f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:18:55 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1edf16c4-02e2-4949-b155-aa96f8b013e8 tempest-VolumesListTestJSON-1772353282 None] Flow 'volume_create_manager' (92a98f3b-da34-4ead-bb36-b102982f29ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:18:55 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-1edf16c4-02e2-4949-b155-aa96f8b013e8 tempest-VolumesListTestJSON-1772353282 None] Created volume successfully. Aug 05 10:18:56 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-b002ed9f-1688-4046-a2ef-fa441fd7d285 tempest-VolumesListTestJSON-1772353282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:18:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-b002ed9f-1688-4046-a2ef-fa441fd7d285 tempest-VolumesListTestJSON-1772353282 None] Flow 'volume_create_manager' (b51bedae-e1b5-4d55-8794-1ab317e7e9ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:18:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-b002ed9f-1688-4046-a2ef-fa441fd7d285 tempest-VolumesListTestJSON-1772353282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83fcccb2-ead0-442b-933d-f2bd32075fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:18:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-b002ed9f-1688-4046-a2ef-fa441fd7d285 tempest-VolumesListTestJSON-1772353282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83fcccb2-ead0-442b-933d-f2bd32075fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:18:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2010284722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6a35572-1fdc-4c57-b0a0-a8cf410c4ddb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='582d371d809b4c318459a151c70643b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:18:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:18:56Z,use_quota=True,user_id='f2a12aebf8234605bac8949fca93c274',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:18:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-b002ed9f-1688-4046-a2ef-fa441fd7d285 tempest-VolumesListTestJSON-1772353282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (893c591e-a3be-4792-9abc-58b896280a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:18:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-b002ed9f-1688-4046-a2ef-fa441fd7d285 tempest-VolumesListTestJSON-1772353282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (893c591e-a3be-4792-9abc-58b896280a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:18:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-b002ed9f-1688-4046-a2ef-fa441fd7d285 tempest-VolumesListTestJSON-1772353282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70fa09ef-cb35-46e2-837d-146c208eff3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:18:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-b002ed9f-1688-4046-a2ef-fa441fd7d285 tempest-VolumesListTestJSON-1772353282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70fa09ef-cb35-46e2-837d-146c208eff3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6a35572-1fdc-4c57-b0a0-a8cf410c4ddb', 'volume_name': 'volume-f6a35572-1fdc-4c57-b0a0-a8cf410c4ddb', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:18:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-b002ed9f-1688-4046-a2ef-fa441fd7d285 tempest-VolumesListTestJSON-1772353282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57fff0dc-ac83-4599-b97f-e4031e7c479d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:18:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-b002ed9f-1688-4046-a2ef-fa441fd7d285 tempest-VolumesListTestJSON-1772353282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57fff0dc-ac83-4599-b97f-e4031e7c479d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:18:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-b002ed9f-1688-4046-a2ef-fa441fd7d285 tempest-VolumesListTestJSON-1772353282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec0e93be-6224-4ca0-aa07-9f895f92fab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:18:56 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-b002ed9f-1688-4046-a2ef-fa441fd7d285 tempest-VolumesListTestJSON-1772353282 None] Volume f6a35572-1fdc-4c57-b0a0-a8cf410c4ddb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6a35572-1fdc-4c57-b0a0-a8cf410c4ddb', 'volume_size': 1} Aug 05 10:18:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-b002ed9f-1688-4046-a2ef-fa441fd7d285 tempest-VolumesListTestJSON-1772353282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:18:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-b002ed9f-1688-4046-a2ef-fa441fd7d285 tempest-VolumesListTestJSON-1772353282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:18:56 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-b002ed9f-1688-4046-a2ef-fa441fd7d285 tempest-VolumesListTestJSON-1772353282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:18:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2010284722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6a35572-1fdc-4c57-b0a0-a8cf410c4ddb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='582d371d809b4c318459a151c70643b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:18:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:18:56Z,use_quota=True,user_id='f2a12aebf8234605bac8949fca93c274',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:18:56 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-b002ed9f-1688-4046-a2ef-fa441fd7d285 tempest-VolumesListTestJSON-1772353282 None] Creating volume f6a35572-1fdc-4c57-b0a0-a8cf410c4ddb {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:18:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-b002ed9f-1688-4046-a2ef-fa441fd7d285 tempest-VolumesListTestJSON-1772353282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:18:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-b002ed9f-1688-4046-a2ef-fa441fd7d285 tempest-VolumesListTestJSON-1772353282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:18:56 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-b002ed9f-1688-4046-a2ef-fa441fd7d285 tempest-VolumesListTestJSON-1772353282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:18:56 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-b002ed9f-1688-4046-a2ef-fa441fd7d285 tempest-VolumesListTestJSON-1772353282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:18:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-b002ed9f-1688-4046-a2ef-fa441fd7d285 tempest-VolumesListTestJSON-1772353282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:18:56 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-b002ed9f-1688-4046-a2ef-fa441fd7d285 tempest-VolumesListTestJSON-1772353282 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:18:56 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-b002ed9f-1688-4046-a2ef-fa441fd7d285 tempest-VolumesListTestJSON-1772353282 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:18:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b002ed9f-1688-4046-a2ef-fa441fd7d285 tempest-VolumesListTestJSON-1772353282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f6a35572-1fdc-4c57-b0a0-a8cf410c4ddb 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:56 devstack sudo[95984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f6a35572-1fdc-4c57-b0a0-a8cf410c4ddb 1073741824 Aug 05 10:18:56 devstack sudo[95984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:56 devstack sudo[95984]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b002ed9f-1688-4046-a2ef-fa441fd7d285 tempest-VolumesListTestJSON-1772353282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f6a35572-1fdc-4c57-b0a0-a8cf410c4ddb 1073741824" returned: 0 in 0.639s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b002ed9f-1688-4046-a2ef-fa441fd7d285 tempest-VolumesListTestJSON-1772353282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f6a35572-1fdc-4c57-b0a0-a8cf410c4ddb {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:57 devstack sudo[95989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f6a35572-1fdc-4c57-b0a0-a8cf410c4ddb Aug 05 10:18:57 devstack sudo[95989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:57 devstack sudo[95989]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b002ed9f-1688-4046-a2ef-fa441fd7d285 tempest-VolumesListTestJSON-1772353282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f6a35572-1fdc-4c57-b0a0-a8cf410c4ddb" returned: 0 in 0.613s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:57 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-b002ed9f-1688-4046-a2ef-fa441fd7d285 tempest-VolumesListTestJSON-1772353282 None] <== create_volume: return (1340ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:18:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-b002ed9f-1688-4046-a2ef-fa441fd7d285 tempest-VolumesListTestJSON-1772353282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.342s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:18:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-b002ed9f-1688-4046-a2ef-fa441fd7d285 tempest-VolumesListTestJSON-1772353282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec0e93be-6224-4ca0-aa07-9f895f92fab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6a35572-1fdc-4c57-b0a0-a8cf410c4ddb', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:18:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-b002ed9f-1688-4046-a2ef-fa441fd7d285 tempest-VolumesListTestJSON-1772353282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cd7653d-e9a9-4ad2-9d50-d4cbf090ca47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:18:57 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-b002ed9f-1688-4046-a2ef-fa441fd7d285 tempest-VolumesListTestJSON-1772353282 None] Volume volume-f6a35572-1fdc-4c57-b0a0-a8cf410c4ddb (f6a35572-1fdc-4c57-b0a0-a8cf410c4ddb): created successfully Aug 05 10:18:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-b002ed9f-1688-4046-a2ef-fa441fd7d285 tempest-VolumesListTestJSON-1772353282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cd7653d-e9a9-4ad2-9d50-d4cbf090ca47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:18:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-b002ed9f-1688-4046-a2ef-fa441fd7d285 tempest-VolumesListTestJSON-1772353282 None] Flow 'volume_create_manager' (b51bedae-e1b5-4d55-8794-1ab317e7e9ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:18:57 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-b002ed9f-1688-4046-a2ef-fa441fd7d285 tempest-VolumesListTestJSON-1772353282 None] Created volume successfully. Aug 05 10:18:58 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [req-3d8d7515-0a05-4dca-8731-685d9e187f75 req-0c979d68-8b09-464b-b094-f39cb5689294 tempest-VolumesGetTestJSON-138056775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:18:58 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [req-3d8d7515-0a05-4dca-8731-685d9e187f75 req-0c979d68-8b09-464b-b094-f39cb5689294 tempest-VolumesGetTestJSON-138056775 None] Flow 'volume_create_manager' (570fe28e-678c-40d2-ac7e-0fbba7975c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:18:58 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [req-3d8d7515-0a05-4dca-8731-685d9e187f75 req-0c979d68-8b09-464b-b094-f39cb5689294 tempest-VolumesGetTestJSON-138056775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (748b91a3-c329-4a2b-a4fb-69383d5903b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:18:58 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [req-3d8d7515-0a05-4dca-8731-685d9e187f75 req-0c979d68-8b09-464b-b094-f39cb5689294 tempest-VolumesGetTestJSON-138056775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (748b91a3-c329-4a2b-a4fb-69383d5903b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:18:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-538033172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd96cbe9-9e50-46cd-894c-c323d9d77ae8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ad2e703bf6e0419196296db7e834b68a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:18:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:18:59Z,use_quota=True,user_id='2693917a19ad4ab6957dcc133826c522',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:18:58 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [req-3d8d7515-0a05-4dca-8731-685d9e187f75 req-0c979d68-8b09-464b-b094-f39cb5689294 tempest-VolumesGetTestJSON-138056775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (574587ee-5270-41ab-aaeb-841553334278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:18:58 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [req-3d8d7515-0a05-4dca-8731-685d9e187f75 req-0c979d68-8b09-464b-b094-f39cb5689294 tempest-VolumesGetTestJSON-138056775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (574587ee-5270-41ab-aaeb-841553334278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:18:58 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [req-3d8d7515-0a05-4dca-8731-685d9e187f75 req-0c979d68-8b09-464b-b094-f39cb5689294 tempest-VolumesGetTestJSON-138056775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ff5d670-45ee-4671-9874-59706c235bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:18:58 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [req-3d8d7515-0a05-4dca-8731-685d9e187f75 req-0c979d68-8b09-464b-b094-f39cb5689294 tempest-VolumesGetTestJSON-138056775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ff5d670-45ee-4671-9874-59706c235bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd96cbe9-9e50-46cd-894c-c323d9d77ae8', 'volume_name': 'volume-fd96cbe9-9e50-46cd-894c-c323d9d77ae8', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:18:59 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [req-3d8d7515-0a05-4dca-8731-685d9e187f75 req-0c979d68-8b09-464b-b094-f39cb5689294 tempest-VolumesGetTestJSON-138056775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f352f936-d36a-4ab7-9f70-f73b74b8a44f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:18:59 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [req-3d8d7515-0a05-4dca-8731-685d9e187f75 req-0c979d68-8b09-464b-b094-f39cb5689294 tempest-VolumesGetTestJSON-138056775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f352f936-d36a-4ab7-9f70-f73b74b8a44f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:18:59 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [req-3d8d7515-0a05-4dca-8731-685d9e187f75 req-0c979d68-8b09-464b-b094-f39cb5689294 tempest-VolumesGetTestJSON-138056775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e81472e6-e0b8-4f0b-b59a-209b491669f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:18:59 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [req-3d8d7515-0a05-4dca-8731-685d9e187f75 req-0c979d68-8b09-464b-b094-f39cb5689294 tempest-VolumesGetTestJSON-138056775 None] Volume fd96cbe9-9e50-46cd-894c-c323d9d77ae8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd96cbe9-9e50-46cd-894c-c323d9d77ae8', 'volume_size': 1} Aug 05 10:18:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-3d8d7515-0a05-4dca-8731-685d9e187f75 req-0c979d68-8b09-464b-b094-f39cb5689294 tempest-VolumesGetTestJSON-138056775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:18:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-3d8d7515-0a05-4dca-8731-685d9e187f75 req-0c979d68-8b09-464b-b094-f39cb5689294 tempest-VolumesGetTestJSON-138056775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:18:59 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [req-3d8d7515-0a05-4dca-8731-685d9e187f75 req-0c979d68-8b09-464b-b094-f39cb5689294 tempest-VolumesGetTestJSON-138056775 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:18:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-538033172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd96cbe9-9e50-46cd-894c-c323d9d77ae8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ad2e703bf6e0419196296db7e834b68a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:18:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:18:59Z,use_quota=True,user_id='2693917a19ad4ab6957dcc133826c522',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:18:59 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [req-3d8d7515-0a05-4dca-8731-685d9e187f75 req-0c979d68-8b09-464b-b094-f39cb5689294 tempest-VolumesGetTestJSON-138056775 None] Creating volume fd96cbe9-9e50-46cd-894c-c323d9d77ae8 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:18:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-3d8d7515-0a05-4dca-8731-685d9e187f75 req-0c979d68-8b09-464b-b094-f39cb5689294 tempest-VolumesGetTestJSON-138056775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:18:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-3d8d7515-0a05-4dca-8731-685d9e187f75 req-0c979d68-8b09-464b-b094-f39cb5689294 tempest-VolumesGetTestJSON-138056775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:18:59 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [req-3d8d7515-0a05-4dca-8731-685d9e187f75 req-0c979d68-8b09-464b-b094-f39cb5689294 tempest-VolumesGetTestJSON-138056775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:18:59 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [req-3d8d7515-0a05-4dca-8731-685d9e187f75 req-0c979d68-8b09-464b-b094-f39cb5689294 tempest-VolumesGetTestJSON-138056775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:18:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-3d8d7515-0a05-4dca-8731-685d9e187f75 req-0c979d68-8b09-464b-b094-f39cb5689294 tempest-VolumesGetTestJSON-138056775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:18:59 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [req-3d8d7515-0a05-4dca-8731-685d9e187f75 req-0c979d68-8b09-464b-b094-f39cb5689294 tempest-VolumesGetTestJSON-138056775 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:18:59 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [req-3d8d7515-0a05-4dca-8731-685d9e187f75 req-0c979d68-8b09-464b-b094-f39cb5689294 tempest-VolumesGetTestJSON-138056775 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:18:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [req-3d8d7515-0a05-4dca-8731-685d9e187f75 req-0c979d68-8b09-464b-b094-f39cb5689294 tempest-VolumesGetTestJSON-138056775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-fd96cbe9-9e50-46cd-894c-c323d9d77ae8 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:59 devstack sudo[95996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-fd96cbe9-9e50-46cd-894c-c323d9d77ae8 1073741824 Aug 05 10:18:59 devstack sudo[95996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:19:00 devstack sudo[95996]: pam_unix(sudo:session): session closed for user root Aug 05 10:19:00 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [req-3d8d7515-0a05-4dca-8731-685d9e187f75 req-0c979d68-8b09-464b-b094-f39cb5689294 tempest-VolumesGetTestJSON-138056775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-fd96cbe9-9e50-46cd-894c-c323d9d77ae8 1073741824" returned: 0 in 1.213s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:19:00 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [req-3d8d7515-0a05-4dca-8731-685d9e187f75 req-0c979d68-8b09-464b-b094-f39cb5689294 tempest-VolumesGetTestJSON-138056775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-fd96cbe9-9e50-46cd-894c-c323d9d77ae8 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:19:00 devstack sudo[96003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-fd96cbe9-9e50-46cd-894c-c323d9d77ae8 Aug 05 10:19:00 devstack sudo[96003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:19:00 devstack sudo[96003]: pam_unix(sudo:session): session closed for user root Aug 05 10:19:00 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [req-3d8d7515-0a05-4dca-8731-685d9e187f75 req-0c979d68-8b09-464b-b094-f39cb5689294 tempest-VolumesGetTestJSON-138056775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-fd96cbe9-9e50-46cd-894c-c323d9d77ae8" returned: 0 in 0.564s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:19:00 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [req-3d8d7515-0a05-4dca-8731-685d9e187f75 req-0c979d68-8b09-464b-b094-f39cb5689294 tempest-VolumesGetTestJSON-138056775 None] <== create_volume: return (1883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:19:00 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-3d8d7515-0a05-4dca-8731-685d9e187f75 req-0c979d68-8b09-464b-b094-f39cb5689294 tempest-VolumesGetTestJSON-138056775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.900s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:19:01 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [req-3d8d7515-0a05-4dca-8731-685d9e187f75 req-0c979d68-8b09-464b-b094-f39cb5689294 tempest-VolumesGetTestJSON-138056775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e81472e6-e0b8-4f0b-b59a-209b491669f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd96cbe9-9e50-46cd-894c-c323d9d77ae8', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:19:01 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [req-3d8d7515-0a05-4dca-8731-685d9e187f75 req-0c979d68-8b09-464b-b094-f39cb5689294 tempest-VolumesGetTestJSON-138056775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a308a67-51d1-4b9c-b963-a922d82868d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:19:01 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [req-3d8d7515-0a05-4dca-8731-685d9e187f75 req-0c979d68-8b09-464b-b094-f39cb5689294 tempest-VolumesGetTestJSON-138056775 None] Volume volume-fd96cbe9-9e50-46cd-894c-c323d9d77ae8 (fd96cbe9-9e50-46cd-894c-c323d9d77ae8): created successfully Aug 05 10:19:01 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [req-3d8d7515-0a05-4dca-8731-685d9e187f75 req-0c979d68-8b09-464b-b094-f39cb5689294 tempest-VolumesGetTestJSON-138056775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a308a67-51d1-4b9c-b963-a922d82868d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:19:01 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [req-3d8d7515-0a05-4dca-8731-685d9e187f75 req-0c979d68-8b09-464b-b094-f39cb5689294 tempest-VolumesGetTestJSON-138056775 None] Flow 'volume_create_manager' (570fe28e-678c-40d2-ac7e-0fbba7975c83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:19:01 devstack cinder-volume[88613]: INFO cinder.volume.manager [req-3d8d7515-0a05-4dca-8731-685d9e187f75 req-0c979d68-8b09-464b-b094-f39cb5689294 tempest-VolumesGetTestJSON-138056775 None] Created volume successfully. Aug 05 10:19:02 devstack cinder-volume[88613]: DEBUG cinder.coordination [req-ab4f9a29-7c9d-4629-9d36-8dbda6042853 req-cb075551-307e-4c8c-8345-6a9657bf96dd tempest-VolumesGetTestJSON-138056775 None] Acquiring lock "cinder-fd96cbe9-9e50-46cd-894c-c323d9d77ae8-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:19:02 devstack cinder-volume[88613]: DEBUG cinder.coordination [req-ab4f9a29-7c9d-4629-9d36-8dbda6042853 req-cb075551-307e-4c8c-8345-6a9657bf96dd tempest-VolumesGetTestJSON-138056775 None] Lock "cinder-fd96cbe9-9e50-46cd-894c-c323d9d77ae8-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:19:02 devstack cinder-volume[88613]: DEBUG cinder.coordination [req-ab4f9a29-7c9d-4629-9d36-8dbda6042853 req-cb075551-307e-4c8c-8345-6a9657bf96dd tempest-VolumesGetTestJSON-138056775 None] Acquiring lock "cinder-quobyte-fd96cbe9-9e50-46cd-894c-c323d9d77ae8" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:19:02 devstack cinder-volume[88613]: DEBUG cinder.coordination [req-ab4f9a29-7c9d-4629-9d36-8dbda6042853 req-cb075551-307e-4c8c-8345-6a9657bf96dd tempest-VolumesGetTestJSON-138056775 None] Lock "cinder-quobyte-fd96cbe9-9e50-46cd-894c-c323d9d77ae8" acquired by "delete_volume" :: waited 0.027s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:19:02 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a530426-849d-48ef-968a-bd5e4dd85a91]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:19:02 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [req-ab4f9a29-7c9d-4629-9d36-8dbda6042853 req-cb075551-307e-4c8c-8345-6a9657bf96dd tempest-VolumesGetTestJSON-138056775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-fd96cbe9-9e50-46cd-894c-c323d9d77ae8 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:19:02 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d4e9a898-96b0-40e0-8e3d-95a7a76d8958 tempest-VolumesListTestJSON-1772353282 None] Acquiring lock "cinder-f6a35572-1fdc-4c57-b0a0-a8cf410c4ddb-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:19:03 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d4e9a898-96b0-40e0-8e3d-95a7a76d8958 tempest-VolumesListTestJSON-1772353282 None] Lock "cinder-f6a35572-1fdc-4c57-b0a0-a8cf410c4ddb-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:19:03 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d4e9a898-96b0-40e0-8e3d-95a7a76d8958 tempest-VolumesListTestJSON-1772353282 None] Acquiring lock "cinder-quobyte-f6a35572-1fdc-4c57-b0a0-a8cf410c4ddb" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:19:03 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d4e9a898-96b0-40e0-8e3d-95a7a76d8958 tempest-VolumesListTestJSON-1772353282 None] Lock "cinder-quobyte-f6a35572-1fdc-4c57-b0a0-a8cf410c4ddb" acquired by "delete_volume" :: waited 0.028s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:19:03 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a7cf5e-d3d0-4f14-91f5-06d0bf3f02bf]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:19:03 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d4e9a898-96b0-40e0-8e3d-95a7a76d8958 tempest-VolumesListTestJSON-1772353282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f6a35572-1fdc-4c57-b0a0-a8cf410c4ddb {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:19:03 devstack sudo[96044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-fd96cbe9-9e50-46cd-894c-c323d9d77ae8 Aug 05 10:19:03 devstack sudo[96044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:19:03 devstack sudo[96045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f6a35572-1fdc-4c57-b0a0-a8cf410c4ddb Aug 05 10:19:03 devstack sudo[96045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:19:03 devstack sudo[96044]: pam_unix(sudo:session): session closed for user root Aug 05 10:19:03 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [req-ab4f9a29-7c9d-4629-9d36-8dbda6042853 req-cb075551-307e-4c8c-8345-6a9657bf96dd tempest-VolumesGetTestJSON-138056775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-fd96cbe9-9e50-46cd-894c-c323d9d77ae8" returned: 0 in 0.533s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:19:03 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [req-ab4f9a29-7c9d-4629-9d36-8dbda6042853 req-cb075551-307e-4c8c-8345-6a9657bf96dd tempest-VolumesGetTestJSON-138056775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-fd96cbe9-9e50-46cd-894c-c323d9d77ae8 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:19:03 devstack sudo[96066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-fd96cbe9-9e50-46cd-894c-c323d9d77ae8 Aug 05 10:19:03 devstack sudo[96066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:19:03 devstack sudo[96045]: pam_unix(sudo:session): session closed for user root Aug 05 10:19:03 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d4e9a898-96b0-40e0-8e3d-95a7a76d8958 tempest-VolumesListTestJSON-1772353282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f6a35572-1fdc-4c57-b0a0-a8cf410c4ddb" returned: 0 in 0.441s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:19:03 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d4e9a898-96b0-40e0-8e3d-95a7a76d8958 tempest-VolumesListTestJSON-1772353282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f6a35572-1fdc-4c57-b0a0-a8cf410c4ddb {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:19:03 devstack sudo[96071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f6a35572-1fdc-4c57-b0a0-a8cf410c4ddb Aug 05 10:19:03 devstack sudo[96071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:19:03 devstack sudo[96066]: pam_unix(sudo:session): session closed for user root Aug 05 10:19:03 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [req-ab4f9a29-7c9d-4629-9d36-8dbda6042853 req-cb075551-307e-4c8c-8345-6a9657bf96dd tempest-VolumesGetTestJSON-138056775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-fd96cbe9-9e50-46cd-894c-c323d9d77ae8" returned: 0 in 0.289s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:19:03 devstack cinder-volume[88613]: DEBUG cinder.coordination [req-ab4f9a29-7c9d-4629-9d36-8dbda6042853 req-cb075551-307e-4c8c-8345-6a9657bf96dd tempest-VolumesGetTestJSON-138056775 None] Lock "cinder-quobyte-fd96cbe9-9e50-46cd-894c-c323d9d77ae8" released by "delete_volume" :: held 0.940s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:19:03 devstack cinder-volume[88613]: DEBUG cinder.quota [req-ab4f9a29-7c9d-4629-9d36-8dbda6042853 req-cb075551-307e-4c8c-8345-6a9657bf96dd tempest-VolumesGetTestJSON-138056775 None] Created reservations ['74f9a886-b1ff-4fff-8ff5-c23436a758fd', '2b801c43-8149-442a-a6bc-43d37e81cfed', '2cd238e8-01bc-431f-9777-6392dee60c03', '66c68282-5e5d-4ed5-9088-aed6984bd19d'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:19:03 devstack sudo[96071]: pam_unix(sudo:session): session closed for user root Aug 05 10:19:03 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d4e9a898-96b0-40e0-8e3d-95a7a76d8958 tempest-VolumesListTestJSON-1772353282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f6a35572-1fdc-4c57-b0a0-a8cf410c4ddb" returned: 0 in 0.313s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:19:03 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d4e9a898-96b0-40e0-8e3d-95a7a76d8958 tempest-VolumesListTestJSON-1772353282 None] Lock "cinder-quobyte-f6a35572-1fdc-4c57-b0a0-a8cf410c4ddb" released by "delete_volume" :: held 0.834s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:19:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-ab4f9a29-7c9d-4629-9d36-8dbda6042853 req-cb075551-307e-4c8c-8345-6a9657bf96dd tempest-VolumesGetTestJSON-138056775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:19:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-ab4f9a29-7c9d-4629-9d36-8dbda6042853 req-cb075551-307e-4c8c-8345-6a9657bf96dd tempest-VolumesGetTestJSON-138056775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:19:04 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [req-ab4f9a29-7c9d-4629-9d36-8dbda6042853 req-cb075551-307e-4c8c-8345-6a9657bf96dd tempest-VolumesGetTestJSON-138056775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:19:04 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [req-ab4f9a29-7c9d-4629-9d36-8dbda6042853 req-cb075551-307e-4c8c-8345-6a9657bf96dd tempest-VolumesGetTestJSON-138056775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:19:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-ab4f9a29-7c9d-4629-9d36-8dbda6042853 req-cb075551-307e-4c8c-8345-6a9657bf96dd tempest-VolumesGetTestJSON-138056775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:19:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [req-ab4f9a29-7c9d-4629-9d36-8dbda6042853 req-cb075551-307e-4c8c-8345-6a9657bf96dd tempest-VolumesGetTestJSON-138056775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:19:04 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-d4e9a898-96b0-40e0-8e3d-95a7a76d8958 tempest-VolumesListTestJSON-1772353282 None] Created reservations ['a40ef039-da8e-45e4-ba4d-3d700845b278', 'de2e629d-589b-4e32-b046-b4986145c107', 'f3e7ab7a-99f9-4c1d-b5aa-9b42291a732b', '18932ec6-d3ec-44ab-a451-85349b3215b8'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:19:04 devstack sudo[96076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:19:04 devstack sudo[96076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:19:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-d4e9a898-96b0-40e0-8e3d-95a7a76d8958 tempest-VolumesListTestJSON-1772353282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:19:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-d4e9a898-96b0-40e0-8e3d-95a7a76d8958 tempest-VolumesListTestJSON-1772353282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:19:04 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-d4e9a898-96b0-40e0-8e3d-95a7a76d8958 tempest-VolumesListTestJSON-1772353282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:19:04 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-d4e9a898-96b0-40e0-8e3d-95a7a76d8958 tempest-VolumesListTestJSON-1772353282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:19:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-d4e9a898-96b0-40e0-8e3d-95a7a76d8958 tempest-VolumesListTestJSON-1772353282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:19:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d4e9a898-96b0-40e0-8e3d-95a7a76d8958 tempest-VolumesListTestJSON-1772353282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:19:04 devstack sudo[96078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:19:04 devstack sudo[96078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:19:04 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-2bb55b5d-ffda-4743-9886-21e80f7ec8ae tempest-VolumesListTestJSON-1772353282 None] Acquiring lock "cinder-de477a2b-863e-475e-a468-d573cb43eb43-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:19:04 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-2bb55b5d-ffda-4743-9886-21e80f7ec8ae tempest-VolumesListTestJSON-1772353282 None] Lock "cinder-de477a2b-863e-475e-a468-d573cb43eb43-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:19:04 devstack sudo[96076]: pam_unix(sudo:session): session closed for user root Aug 05 10:19:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [req-ab4f9a29-7c9d-4629-9d36-8dbda6042853 req-cb075551-307e-4c8c-8345-6a9657bf96dd tempest-VolumesGetTestJSON-138056775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.811s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:19:04 devstack cinder-volume[88613]: DEBUG cinder.manager [req-ab4f9a29-7c9d-4629-9d36-8dbda6042853 req-cb075551-307e-4c8c-8345-6a9657bf96dd tempest-VolumesGetTestJSON-138056775 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:19:04 devstack cinder-volume[88613]: INFO cinder.volume.manager [req-ab4f9a29-7c9d-4629-9d36-8dbda6042853 req-cb075551-307e-4c8c-8345-6a9657bf96dd tempest-VolumesGetTestJSON-138056775 None] Deleted volume successfully. Aug 05 10:19:04 devstack cinder-volume[88613]: DEBUG cinder.coordination [req-ab4f9a29-7c9d-4629-9d36-8dbda6042853 req-cb075551-307e-4c8c-8345-6a9657bf96dd tempest-VolumesGetTestJSON-138056775 None] Lock "cinder-fd96cbe9-9e50-46cd-894c-c323d9d77ae8-delete_volume" released by "delete_volume" :: held 2.232s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:19:05 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-2bb55b5d-ffda-4743-9886-21e80f7ec8ae tempest-VolumesListTestJSON-1772353282 None] Acquiring lock "cinder-quobyte-de477a2b-863e-475e-a468-d573cb43eb43" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:19:05 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-2bb55b5d-ffda-4743-9886-21e80f7ec8ae tempest-VolumesListTestJSON-1772353282 None] Lock "cinder-quobyte-de477a2b-863e-475e-a468-d573cb43eb43" acquired by "delete_volume" :: waited 0.038s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:19:05 devstack sudo[96078]: pam_unix(sudo:session): session closed for user root Aug 05 10:19:05 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d4e9a898-96b0-40e0-8e3d-95a7a76d8958 tempest-VolumesListTestJSON-1772353282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.851s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:19:05 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-d4e9a898-96b0-40e0-8e3d-95a7a76d8958 tempest-VolumesListTestJSON-1772353282 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:19:05 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-d4e9a898-96b0-40e0-8e3d-95a7a76d8958 tempest-VolumesListTestJSON-1772353282 None] Deleted volume successfully. Aug 05 10:19:05 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de4efbf-1a33-4d71-88ae-49b813737b6a]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:19:05 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2bb55b5d-ffda-4743-9886-21e80f7ec8ae tempest-VolumesListTestJSON-1772353282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-de477a2b-863e-475e-a468-d573cb43eb43 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:19:05 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d4e9a898-96b0-40e0-8e3d-95a7a76d8958 tempest-VolumesListTestJSON-1772353282 None] Lock "cinder-f6a35572-1fdc-4c57-b0a0-a8cf410c4ddb-delete_volume" released by "delete_volume" :: held 2.209s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:19:05 devstack sudo[96085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-de477a2b-863e-475e-a468-d573cb43eb43 Aug 05 10:19:05 devstack sudo[96085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:19:05 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-937ba53a-98dc-4d4b-b1a0-aecdc3517fc7 tempest-AttachVolumeNegativeTest-1387927917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:19:05 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-937ba53a-98dc-4d4b-b1a0-aecdc3517fc7 tempest-AttachVolumeNegativeTest-1387927917 None] Flow 'volume_create_manager' (6f7a4df9-c189-4afd-ae79-6db4ee1cfea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:19:05 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-937ba53a-98dc-4d4b-b1a0-aecdc3517fc7 tempest-AttachVolumeNegativeTest-1387927917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bc10fd3-92ba-46d0-a6e3-6a19b0e693bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:19:06 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-937ba53a-98dc-4d4b-b1a0-aecdc3517fc7 tempest-AttachVolumeNegativeTest-1387927917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bc10fd3-92ba-46d0-a6e3-6a19b0e693bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:19:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-379306519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebe9ab38-67a4-44ac-b68f-aa45e8fb54a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48672fc3cb8343618f2d2cd36237f130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:19:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:19:06Z,use_quota=True,user_id='47c1b556a85a4368a09d710fff39d27c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:19:06 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-937ba53a-98dc-4d4b-b1a0-aecdc3517fc7 tempest-AttachVolumeNegativeTest-1387927917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce6c35e7-0fad-49c8-91b9-216f9842ddd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:19:06 devstack sudo[96085]: pam_unix(sudo:session): session closed for user root Aug 05 10:19:06 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-937ba53a-98dc-4d4b-b1a0-aecdc3517fc7 tempest-AttachVolumeNegativeTest-1387927917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce6c35e7-0fad-49c8-91b9-216f9842ddd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:19:06 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-937ba53a-98dc-4d4b-b1a0-aecdc3517fc7 tempest-AttachVolumeNegativeTest-1387927917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5c25c07-eeb3-4284-96ec-274420587292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:19:06 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-937ba53a-98dc-4d4b-b1a0-aecdc3517fc7 tempest-AttachVolumeNegativeTest-1387927917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5c25c07-eeb3-4284-96ec-274420587292) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebe9ab38-67a4-44ac-b68f-aa45e8fb54a6', 'volume_name': 'volume-ebe9ab38-67a4-44ac-b68f-aa45e8fb54a6', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:19:06 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-937ba53a-98dc-4d4b-b1a0-aecdc3517fc7 tempest-AttachVolumeNegativeTest-1387927917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d43a4418-74d1-4022-af34-325d7f028a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:19:06 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-937ba53a-98dc-4d4b-b1a0-aecdc3517fc7 tempest-AttachVolumeNegativeTest-1387927917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d43a4418-74d1-4022-af34-325d7f028a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:19:06 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-937ba53a-98dc-4d4b-b1a0-aecdc3517fc7 tempest-AttachVolumeNegativeTest-1387927917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32b1841a-988a-4303-9e05-79e8e4e76889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:19:06 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-937ba53a-98dc-4d4b-b1a0-aecdc3517fc7 tempest-AttachVolumeNegativeTest-1387927917 None] Volume ebe9ab38-67a4-44ac-b68f-aa45e8fb54a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebe9ab38-67a4-44ac-b68f-aa45e8fb54a6', 'volume_size': 1} Aug 05 10:19:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-937ba53a-98dc-4d4b-b1a0-aecdc3517fc7 tempest-AttachVolumeNegativeTest-1387927917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:19:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-937ba53a-98dc-4d4b-b1a0-aecdc3517fc7 tempest-AttachVolumeNegativeTest-1387927917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:19:06 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-937ba53a-98dc-4d4b-b1a0-aecdc3517fc7 tempest-AttachVolumeNegativeTest-1387927917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:19:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-379306519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebe9ab38-67a4-44ac-b68f-aa45e8fb54a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48672fc3cb8343618f2d2cd36237f130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:19:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:19:06Z,use_quota=True,user_id='47c1b556a85a4368a09d710fff39d27c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:19:06 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-937ba53a-98dc-4d4b-b1a0-aecdc3517fc7 tempest-AttachVolumeNegativeTest-1387927917 None] Creating volume ebe9ab38-67a4-44ac-b68f-aa45e8fb54a6 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:19:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-937ba53a-98dc-4d4b-b1a0-aecdc3517fc7 tempest-AttachVolumeNegativeTest-1387927917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:19:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-937ba53a-98dc-4d4b-b1a0-aecdc3517fc7 tempest-AttachVolumeNegativeTest-1387927917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:19:06 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-937ba53a-98dc-4d4b-b1a0-aecdc3517fc7 tempest-AttachVolumeNegativeTest-1387927917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:19:06 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-937ba53a-98dc-4d4b-b1a0-aecdc3517fc7 tempest-AttachVolumeNegativeTest-1387927917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:19:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-937ba53a-98dc-4d4b-b1a0-aecdc3517fc7 tempest-AttachVolumeNegativeTest-1387927917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:19:06 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-937ba53a-98dc-4d4b-b1a0-aecdc3517fc7 tempest-AttachVolumeNegativeTest-1387927917 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:19:06 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-937ba53a-98dc-4d4b-b1a0-aecdc3517fc7 tempest-AttachVolumeNegativeTest-1387927917 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:19:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-937ba53a-98dc-4d4b-b1a0-aecdc3517fc7 tempest-AttachVolumeNegativeTest-1387927917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ebe9ab38-67a4-44ac-b68f-aa45e8fb54a6 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:19:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2bb55b5d-ffda-4743-9886-21e80f7ec8ae tempest-VolumesListTestJSON-1772353282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-de477a2b-863e-475e-a468-d573cb43eb43" returned: 0 in 1.053s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:19:06 devstack sudo[96090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ebe9ab38-67a4-44ac-b68f-aa45e8fb54a6 1073741824 Aug 05 10:19:06 devstack sudo[96090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:19:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2bb55b5d-ffda-4743-9886-21e80f7ec8ae tempest-VolumesListTestJSON-1772353282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-de477a2b-863e-475e-a468-d573cb43eb43 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:19:06 devstack sudo[96092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-de477a2b-863e-475e-a468-d573cb43eb43 Aug 05 10:19:06 devstack sudo[96092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:19:06 devstack sudo[96092]: pam_unix(sudo:session): session closed for user root Aug 05 10:19:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2bb55b5d-ffda-4743-9886-21e80f7ec8ae tempest-VolumesListTestJSON-1772353282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-de477a2b-863e-475e-a468-d573cb43eb43" returned: 0 in 0.571s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:19:06 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-2bb55b5d-ffda-4743-9886-21e80f7ec8ae tempest-VolumesListTestJSON-1772353282 None] Lock "cinder-quobyte-de477a2b-863e-475e-a468-d573cb43eb43" released by "delete_volume" :: held 1.749s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:19:07 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-2bb55b5d-ffda-4743-9886-21e80f7ec8ae tempest-VolumesListTestJSON-1772353282 None] Created reservations ['3cbca753-8e57-41f4-8893-bf13155ab806', 'a7a7d5d1-8078-4722-8196-6fa745b0a052', 'fd37f4cc-4e43-4d48-80c4-c1da71006920', 'f2ae2e5b-fd62-4b9c-ad9c-13daf3fc3f2a'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:19:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2bb55b5d-ffda-4743-9886-21e80f7ec8ae tempest-VolumesListTestJSON-1772353282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:19:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2bb55b5d-ffda-4743-9886-21e80f7ec8ae tempest-VolumesListTestJSON-1772353282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:19:07 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-2bb55b5d-ffda-4743-9886-21e80f7ec8ae tempest-VolumesListTestJSON-1772353282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:19:07 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-2bb55b5d-ffda-4743-9886-21e80f7ec8ae tempest-VolumesListTestJSON-1772353282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:19:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2bb55b5d-ffda-4743-9886-21e80f7ec8ae tempest-VolumesListTestJSON-1772353282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:19:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2bb55b5d-ffda-4743-9886-21e80f7ec8ae tempest-VolumesListTestJSON-1772353282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:19:07 devstack sudo[96104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:19:07 devstack sudo[96104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:19:07 devstack sudo[96090]: pam_unix(sudo:session): session closed for user root Aug 05 10:19:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-937ba53a-98dc-4d4b-b1a0-aecdc3517fc7 tempest-AttachVolumeNegativeTest-1387927917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ebe9ab38-67a4-44ac-b68f-aa45e8fb54a6 1073741824" returned: 0 in 1.438s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:19:07 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-df21ad86-c4f0-4320-9471-fa4e809854e2 tempest-VolumesListTestJSON-1772353282 None] Acquiring lock "cinder-8a0789cf-6a37-49ad-8447-4da10d5794e3-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:19:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-937ba53a-98dc-4d4b-b1a0-aecdc3517fc7 tempest-AttachVolumeNegativeTest-1387927917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ebe9ab38-67a4-44ac-b68f-aa45e8fb54a6 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:19:07 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-df21ad86-c4f0-4320-9471-fa4e809854e2 tempest-VolumesListTestJSON-1772353282 None] Lock "cinder-8a0789cf-6a37-49ad-8447-4da10d5794e3-delete_volume" acquired by "delete_volume" :: waited 0.221s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:19:07 devstack sudo[96106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ebe9ab38-67a4-44ac-b68f-aa45e8fb54a6 Aug 05 10:19:07 devstack sudo[96106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:19:08 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-df21ad86-c4f0-4320-9471-fa4e809854e2 tempest-VolumesListTestJSON-1772353282 None] Acquiring lock "cinder-quobyte-8a0789cf-6a37-49ad-8447-4da10d5794e3" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:19:08 devstack sudo[96104]: pam_unix(sudo:session): session closed for user root Aug 05 10:19:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2bb55b5d-ffda-4743-9886-21e80f7ec8ae tempest-VolumesListTestJSON-1772353282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.878s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:19:08 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-2bb55b5d-ffda-4743-9886-21e80f7ec8ae tempest-VolumesListTestJSON-1772353282 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:19:08 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-df21ad86-c4f0-4320-9471-fa4e809854e2 tempest-VolumesListTestJSON-1772353282 None] Lock "cinder-quobyte-8a0789cf-6a37-49ad-8447-4da10d5794e3" acquired by "delete_volume" :: waited 0.105s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:19:08 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-2bb55b5d-ffda-4743-9886-21e80f7ec8ae tempest-VolumesListTestJSON-1772353282 None] Deleted volume successfully. Aug 05 10:19:08 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c0ba0bb-7bfb-4e59-ae87-7c79f4d75b03]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:19:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-df21ad86-c4f0-4320-9471-fa4e809854e2 tempest-VolumesListTestJSON-1772353282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8a0789cf-6a37-49ad-8447-4da10d5794e3 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:19:08 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-2bb55b5d-ffda-4743-9886-21e80f7ec8ae tempest-VolumesListTestJSON-1772353282 None] Lock "cinder-de477a2b-863e-475e-a468-d573cb43eb43-delete_volume" released by "delete_volume" :: held 3.617s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:19:08 devstack sudo[96106]: pam_unix(sudo:session): session closed for user root Aug 05 10:19:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-937ba53a-98dc-4d4b-b1a0-aecdc3517fc7 tempest-AttachVolumeNegativeTest-1387927917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ebe9ab38-67a4-44ac-b68f-aa45e8fb54a6" returned: 0 in 0.617s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:19:08 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-937ba53a-98dc-4d4b-b1a0-aecdc3517fc7 tempest-AttachVolumeNegativeTest-1387927917 None] <== create_volume: return (2322ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:19:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-937ba53a-98dc-4d4b-b1a0-aecdc3517fc7 tempest-AttachVolumeNegativeTest-1387927917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.328s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:19:08 devstack sudo[96110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8a0789cf-6a37-49ad-8447-4da10d5794e3 Aug 05 10:19:08 devstack sudo[96110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:19:08 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-937ba53a-98dc-4d4b-b1a0-aecdc3517fc7 tempest-AttachVolumeNegativeTest-1387927917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32b1841a-988a-4303-9e05-79e8e4e76889) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebe9ab38-67a4-44ac-b68f-aa45e8fb54a6', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:19:08 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-937ba53a-98dc-4d4b-b1a0-aecdc3517fc7 tempest-AttachVolumeNegativeTest-1387927917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5279939c-9d5c-4db2-8321-70af8cacbf32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:19:08 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-937ba53a-98dc-4d4b-b1a0-aecdc3517fc7 tempest-AttachVolumeNegativeTest-1387927917 None] Volume volume-ebe9ab38-67a4-44ac-b68f-aa45e8fb54a6 (ebe9ab38-67a4-44ac-b68f-aa45e8fb54a6): created successfully Aug 05 10:19:08 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-937ba53a-98dc-4d4b-b1a0-aecdc3517fc7 tempest-AttachVolumeNegativeTest-1387927917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5279939c-9d5c-4db2-8321-70af8cacbf32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:19:08 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-937ba53a-98dc-4d4b-b1a0-aecdc3517fc7 tempest-AttachVolumeNegativeTest-1387927917 None] Flow 'volume_create_manager' (6f7a4df9-c189-4afd-ae79-6db4ee1cfea2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:19:08 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-937ba53a-98dc-4d4b-b1a0-aecdc3517fc7 tempest-AttachVolumeNegativeTest-1387927917 None] Created volume successfully. Aug 05 10:19:08 devstack sudo[96110]: pam_unix(sudo:session): session closed for user root Aug 05 10:19:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-df21ad86-c4f0-4320-9471-fa4e809854e2 tempest-VolumesListTestJSON-1772353282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8a0789cf-6a37-49ad-8447-4da10d5794e3" returned: 0 in 0.619s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:19:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-df21ad86-c4f0-4320-9471-fa4e809854e2 tempest-VolumesListTestJSON-1772353282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8a0789cf-6a37-49ad-8447-4da10d5794e3 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:19:08 devstack sudo[96115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8a0789cf-6a37-49ad-8447-4da10d5794e3 Aug 05 10:19:08 devstack sudo[96115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:19:09 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-13802bdf-945f-48cf-9b1e-1f7bd31c2974 tempest-ServerRescueNegativeTestJSON-1948930867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:19:09 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-13802bdf-945f-48cf-9b1e-1f7bd31c2974 tempest-ServerRescueNegativeTestJSON-1948930867 None] Flow 'volume_create_manager' (9f5668dd-39a0-4c32-bd20-85b606ec12f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:19:09 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-13802bdf-945f-48cf-9b1e-1f7bd31c2974 tempest-ServerRescueNegativeTestJSON-1948930867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1172479-9316-4856-92aa-c0f28432f7f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:19:09 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-13802bdf-945f-48cf-9b1e-1f7bd31c2974 tempest-ServerRescueNegativeTestJSON-1948930867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1172479-9316-4856-92aa-c0f28432f7f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:19:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-715790163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=828696af-10a7-45e3-95bf-d2eb23848c80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40adf603e0b84c358d1f3b81c0a82394',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:19:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:19:09Z,use_quota=True,user_id='f9c944c762824a248d45310c1a2a392a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:19:09 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-13802bdf-945f-48cf-9b1e-1f7bd31c2974 tempest-ServerRescueNegativeTestJSON-1948930867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6891d93e-6f71-46ab-83db-a65ada135c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:19:09 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-13802bdf-945f-48cf-9b1e-1f7bd31c2974 tempest-ServerRescueNegativeTestJSON-1948930867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6891d93e-6f71-46ab-83db-a65ada135c96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:19:09 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-13802bdf-945f-48cf-9b1e-1f7bd31c2974 tempest-ServerRescueNegativeTestJSON-1948930867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (481e5d7e-cebf-4428-955d-eaf2aa85d15e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:19:09 devstack sudo[96115]: pam_unix(sudo:session): session closed for user root Aug 05 10:19:09 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-13802bdf-945f-48cf-9b1e-1f7bd31c2974 tempest-ServerRescueNegativeTestJSON-1948930867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (481e5d7e-cebf-4428-955d-eaf2aa85d15e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '828696af-10a7-45e3-95bf-d2eb23848c80', 'volume_name': 'volume-828696af-10a7-45e3-95bf-d2eb23848c80', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:19:09 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-13802bdf-945f-48cf-9b1e-1f7bd31c2974 tempest-ServerRescueNegativeTestJSON-1948930867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c73c468-250e-4519-8799-cebdfa3cfc97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:19:09 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-13802bdf-945f-48cf-9b1e-1f7bd31c2974 tempest-ServerRescueNegativeTestJSON-1948930867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c73c468-250e-4519-8799-cebdfa3cfc97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:19:09 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-13802bdf-945f-48cf-9b1e-1f7bd31c2974 tempest-ServerRescueNegativeTestJSON-1948930867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e54aa203-6862-4927-9c5e-ab23d6777d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:19:09 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-13802bdf-945f-48cf-9b1e-1f7bd31c2974 tempest-ServerRescueNegativeTestJSON-1948930867 None] Volume 828696af-10a7-45e3-95bf-d2eb23848c80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-828696af-10a7-45e3-95bf-d2eb23848c80', 'volume_size': 1} Aug 05 10:19:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-13802bdf-945f-48cf-9b1e-1f7bd31c2974 tempest-ServerRescueNegativeTestJSON-1948930867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:19:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-13802bdf-945f-48cf-9b1e-1f7bd31c2974 tempest-ServerRescueNegativeTestJSON-1948930867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:19:09 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-13802bdf-945f-48cf-9b1e-1f7bd31c2974 tempest-ServerRescueNegativeTestJSON-1948930867 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:19:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-715790163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=828696af-10a7-45e3-95bf-d2eb23848c80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40adf603e0b84c358d1f3b81c0a82394',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:19:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:19:09Z,use_quota=True,user_id='f9c944c762824a248d45310c1a2a392a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:19:09 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-13802bdf-945f-48cf-9b1e-1f7bd31c2974 tempest-ServerRescueNegativeTestJSON-1948930867 None] Creating volume 828696af-10a7-45e3-95bf-d2eb23848c80 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:19:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-13802bdf-945f-48cf-9b1e-1f7bd31c2974 tempest-ServerRescueNegativeTestJSON-1948930867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:19:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-13802bdf-945f-48cf-9b1e-1f7bd31c2974 tempest-ServerRescueNegativeTestJSON-1948930867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:19:09 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-13802bdf-945f-48cf-9b1e-1f7bd31c2974 tempest-ServerRescueNegativeTestJSON-1948930867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:19:09 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-13802bdf-945f-48cf-9b1e-1f7bd31c2974 tempest-ServerRescueNegativeTestJSON-1948930867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:19:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-13802bdf-945f-48cf-9b1e-1f7bd31c2974 tempest-ServerRescueNegativeTestJSON-1948930867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:19:09 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-13802bdf-945f-48cf-9b1e-1f7bd31c2974 tempest-ServerRescueNegativeTestJSON-1948930867 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:19:09 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-13802bdf-945f-48cf-9b1e-1f7bd31c2974 tempest-ServerRescueNegativeTestJSON-1948930867 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:19:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-13802bdf-945f-48cf-9b1e-1f7bd31c2974 tempest-ServerRescueNegativeTestJSON-1948930867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-828696af-10a7-45e3-95bf-d2eb23848c80 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:19:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-df21ad86-c4f0-4320-9471-fa4e809854e2 tempest-VolumesListTestJSON-1772353282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8a0789cf-6a37-49ad-8447-4da10d5794e3" returned: 0 in 0.495s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:19:09 devstack sudo[96118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-828696af-10a7-45e3-95bf-d2eb23848c80 1073741824 Aug 05 10:19:09 devstack sudo[96118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:19:09 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-df21ad86-c4f0-4320-9471-fa4e809854e2 tempest-VolumesListTestJSON-1772353282 None] Lock "cinder-quobyte-8a0789cf-6a37-49ad-8447-4da10d5794e3" released by "delete_volume" :: held 1.229s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:19:09 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-df21ad86-c4f0-4320-9471-fa4e809854e2 tempest-VolumesListTestJSON-1772353282 None] Created reservations ['39f71e69-0b99-4b92-a882-553e070a985c', '20984641-41f5-4b03-8ebb-e58a5210a094', 'a2dac918-f100-4643-b3e0-4b58486f30a9', 'c002fd49-74f0-4bca-8c52-eb7c4d618678'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:19:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-df21ad86-c4f0-4320-9471-fa4e809854e2 tempest-VolumesListTestJSON-1772353282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:19:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-df21ad86-c4f0-4320-9471-fa4e809854e2 tempest-VolumesListTestJSON-1772353282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:19:09 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-df21ad86-c4f0-4320-9471-fa4e809854e2 tempest-VolumesListTestJSON-1772353282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:19:09 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-df21ad86-c4f0-4320-9471-fa4e809854e2 tempest-VolumesListTestJSON-1772353282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:19:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-df21ad86-c4f0-4320-9471-fa4e809854e2 tempest-VolumesListTestJSON-1772353282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:19:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-df21ad86-c4f0-4320-9471-fa4e809854e2 tempest-VolumesListTestJSON-1772353282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:19:09 devstack sudo[96120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:19:09 devstack sudo[96120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:19:10 devstack sudo[96120]: pam_unix(sudo:session): session closed for user root Aug 05 10:19:10 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-df21ad86-c4f0-4320-9471-fa4e809854e2 tempest-VolumesListTestJSON-1772353282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.587s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:19:10 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-df21ad86-c4f0-4320-9471-fa4e809854e2 tempest-VolumesListTestJSON-1772353282 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:19:10 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-df21ad86-c4f0-4320-9471-fa4e809854e2 tempest-VolumesListTestJSON-1772353282 None] Deleted volume successfully. Aug 05 10:19:10 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-df21ad86-c4f0-4320-9471-fa4e809854e2 tempest-VolumesListTestJSON-1772353282 None] Lock "cinder-8a0789cf-6a37-49ad-8447-4da10d5794e3-delete_volume" released by "delete_volume" :: held 2.524s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:19:10 devstack sudo[96118]: pam_unix(sudo:session): session closed for user root Aug 05 10:19:10 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-13802bdf-945f-48cf-9b1e-1f7bd31c2974 tempest-ServerRescueNegativeTestJSON-1948930867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-828696af-10a7-45e3-95bf-d2eb23848c80 1073741824" returned: 0 in 1.248s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:19:10 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-13802bdf-945f-48cf-9b1e-1f7bd31c2974 tempest-ServerRescueNegativeTestJSON-1948930867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-828696af-10a7-45e3-95bf-d2eb23848c80 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:19:10 devstack sudo[96131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-828696af-10a7-45e3-95bf-d2eb23848c80 Aug 05 10:19:10 devstack sudo[96131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:19:11 devstack sudo[96131]: pam_unix(sudo:session): session closed for user root Aug 05 10:19:11 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-13802bdf-945f-48cf-9b1e-1f7bd31c2974 tempest-ServerRescueNegativeTestJSON-1948930867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-828696af-10a7-45e3-95bf-d2eb23848c80" returned: 0 in 0.554s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:19:11 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-13802bdf-945f-48cf-9b1e-1f7bd31c2974 tempest-ServerRescueNegativeTestJSON-1948930867 None] <== create_volume: return (1910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:19:11 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-13802bdf-945f-48cf-9b1e-1f7bd31c2974 tempest-ServerRescueNegativeTestJSON-1948930867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.915s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:19:11 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-13802bdf-945f-48cf-9b1e-1f7bd31c2974 tempest-ServerRescueNegativeTestJSON-1948930867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e54aa203-6862-4927-9c5e-ab23d6777d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-828696af-10a7-45e3-95bf-d2eb23848c80', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:19:11 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-13802bdf-945f-48cf-9b1e-1f7bd31c2974 tempest-ServerRescueNegativeTestJSON-1948930867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9df08c8c-be84-4d85-811c-ccac6c662159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:19:11 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-13802bdf-945f-48cf-9b1e-1f7bd31c2974 tempest-ServerRescueNegativeTestJSON-1948930867 None] Volume volume-828696af-10a7-45e3-95bf-d2eb23848c80 (828696af-10a7-45e3-95bf-d2eb23848c80): created successfully Aug 05 10:19:11 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-13802bdf-945f-48cf-9b1e-1f7bd31c2974 tempest-ServerRescueNegativeTestJSON-1948930867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9df08c8c-be84-4d85-811c-ccac6c662159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:19:11 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-13802bdf-945f-48cf-9b1e-1f7bd31c2974 tempest-ServerRescueNegativeTestJSON-1948930867 None] Flow 'volume_create_manager' (9f5668dd-39a0-4c32-bd20-85b606ec12f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:19:11 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-13802bdf-945f-48cf-9b1e-1f7bd31c2974 tempest-ServerRescueNegativeTestJSON-1948930867 None] Created volume successfully. Aug 05 10:19:11 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-fbae227b-766a-4505-8e2d-e5ba9bc0b87f req-17502452-3e36-4cf9-87bb-7bb6956bc975 tempest-AttachVolumeNegativeTest-1387927917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:19:11 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-fbae227b-766a-4505-8e2d-e5ba9bc0b87f req-17502452-3e36-4cf9-87bb-7bb6956bc975 tempest-AttachVolumeNegativeTest-1387927917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:19:11 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-fbae227b-766a-4505-8e2d-e5ba9bc0b87f req-17502452-3e36-4cf9-87bb-7bb6956bc975 tempest-AttachVolumeNegativeTest-1387927917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:19:11 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [req-fbae227b-766a-4505-8e2d-e5ba9bc0b87f req-17502452-3e36-4cf9-87bb-7bb6956bc975 tempest-AttachVolumeNegativeTest-1387927917 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1', 'name': 'volume-ebe9ab38-67a4-44ac-b68f-aa45e8fb54a6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '901e0512-821b-48ee-8f59-fd31f0ca8ca3', 'enforce_multipath': True} {{(pid=88613) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 10:19:11 devstack cinder-volume[88613]: INFO cinder.volume.manager [req-fbae227b-766a-4505-8e2d-e5ba9bc0b87f req-17502452-3e36-4cf9-87bb-7bb6956bc975 tempest-AttachVolumeNegativeTest-1387927917 None] attachment_update completed successfully. Aug 05 10:19:16 devstack cinder-volume[88613]: INFO cinder.volume.manager [req-c2ab3ed4-6d44-409a-92b7-03303226b016 req-ae4450af-c17b-4dcc-a200-9ab066c6db27 tempest-AttachVolumeNegativeTest-1387927917 None] Terminate volume connection completed successfully. Aug 05 10:19:16 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [req-c2ab3ed4-6d44-409a-92b7-03303226b016 req-ae4450af-c17b-4dcc-a200-9ab066c6db27 tempest-AttachVolumeNegativeTest-1387927917 None] Deleting attachment 901e0512-821b-48ee-8f59-fd31f0ca8ca3. {{(pid=88613) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 10:19:21 devstack cinder-volume[88613]: DEBUG oslo_service.periodic_task [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88613) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:19:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:19:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:19:21 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:19:21 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:19:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:19:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:19:21 devstack sudo[96678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:19:21 devstack sudo[96678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:19:22 devstack sudo[96678]: pam_unix(sudo:session): session closed for user root Aug 05 10:19:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.520s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:19:22 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:19:22 devstack cinder-volume[88613]: DEBUG oslo_service.periodic_task [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Running periodic task VolumeManager._thread_info {{(pid=88613) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:19:22 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] thread count: 28 {{(pid=88613) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 10:19:22 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] thread info: [<_MainThread(MainThread, started 126173666128000)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88613) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 10:19:24 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-6d7d851d-f094-4be5-bb4a-4fc491b73ad9 tempest-GroupsTest-1679111057 None] Group tempest-Group1-1281088517: creating Aug 05 10:19:24 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-6d7d851d-f094-4be5-bb4a-4fc491b73ad9 tempest-GroupsTest-1679111057 None] Group tempest-Group1-1281088517: created successfully Aug 05 10:19:24 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-6d7d851d-f094-4be5-bb4a-4fc491b73ad9 tempest-GroupsTest-1679111057 None] Create group completed successfully. Aug 05 10:19:25 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-2f04ecfd-3efd-4334-a573-972212eb3724 tempest-AttachVolumeNegativeTest-1387927917 None] Acquiring lock "cinder-ebe9ab38-67a4-44ac-b68f-aa45e8fb54a6-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:19:25 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-2f04ecfd-3efd-4334-a573-972212eb3724 tempest-AttachVolumeNegativeTest-1387927917 None] Lock "cinder-ebe9ab38-67a4-44ac-b68f-aa45e8fb54a6-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:19:25 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-2f04ecfd-3efd-4334-a573-972212eb3724 tempest-AttachVolumeNegativeTest-1387927917 None] Acquiring lock "cinder-quobyte-ebe9ab38-67a4-44ac-b68f-aa45e8fb54a6" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:19:25 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-2f04ecfd-3efd-4334-a573-972212eb3724 tempest-AttachVolumeNegativeTest-1387927917 None] Lock "cinder-quobyte-ebe9ab38-67a4-44ac-b68f-aa45e8fb54a6" acquired by "delete_volume" :: waited 0.035s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:19:25 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-9bb44f42-3995-4986-87b8-930072fee8a4 tempest-GroupsTest-1679111057 None] Group tempest-Group2-202301168: creating Aug 05 10:19:25 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[7432c19f-5dc7-4901-9ed6-eef3041e4999]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:19:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2f04ecfd-3efd-4334-a573-972212eb3724 tempest-AttachVolumeNegativeTest-1387927917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ebe9ab38-67a4-44ac-b68f-aa45e8fb54a6 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:19:25 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-9bb44f42-3995-4986-87b8-930072fee8a4 tempest-GroupsTest-1679111057 None] Group tempest-Group2-202301168: created successfully Aug 05 10:19:25 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-9bb44f42-3995-4986-87b8-930072fee8a4 tempest-GroupsTest-1679111057 None] Create group completed successfully. Aug 05 10:19:25 devstack sudo[96727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ebe9ab38-67a4-44ac-b68f-aa45e8fb54a6 Aug 05 10:19:25 devstack sudo[96727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:19:26 devstack sudo[96727]: pam_unix(sudo:session): session closed for user root Aug 05 10:19:26 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2f04ecfd-3efd-4334-a573-972212eb3724 tempest-AttachVolumeNegativeTest-1387927917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ebe9ab38-67a4-44ac-b68f-aa45e8fb54a6" returned: 0 in 0.602s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:19:26 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2f04ecfd-3efd-4334-a573-972212eb3724 tempest-AttachVolumeNegativeTest-1387927917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ebe9ab38-67a4-44ac-b68f-aa45e8fb54a6 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:19:26 devstack sudo[96734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ebe9ab38-67a4-44ac-b68f-aa45e8fb54a6 Aug 05 10:19:26 devstack sudo[96734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:19:26 devstack sudo[96734]: pam_unix(sudo:session): session closed for user root Aug 05 10:19:26 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2f04ecfd-3efd-4334-a573-972212eb3724 tempest-AttachVolumeNegativeTest-1387927917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ebe9ab38-67a4-44ac-b68f-aa45e8fb54a6" returned: 0 in 0.533s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:19:26 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-2f04ecfd-3efd-4334-a573-972212eb3724 tempest-AttachVolumeNegativeTest-1387927917 None] Lock "cinder-quobyte-ebe9ab38-67a4-44ac-b68f-aa45e8fb54a6" released by "delete_volume" :: held 1.229s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:19:27 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-2f04ecfd-3efd-4334-a573-972212eb3724 tempest-AttachVolumeNegativeTest-1387927917 None] Created reservations ['eead1319-02f3-4f29-b086-62893e68ad93', '066d7794-2765-40a0-9d90-5a30f5ee3912', '340e9d63-06a0-408e-aa5e-c2c98ad71485', 'ad959f13-c68e-4a4b-9a5d-56df65b059d3'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:19:27 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2f04ecfd-3efd-4334-a573-972212eb3724 tempest-AttachVolumeNegativeTest-1387927917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:19:27 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2f04ecfd-3efd-4334-a573-972212eb3724 tempest-AttachVolumeNegativeTest-1387927917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:19:27 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-2f04ecfd-3efd-4334-a573-972212eb3724 tempest-AttachVolumeNegativeTest-1387927917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:19:27 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-2f04ecfd-3efd-4334-a573-972212eb3724 tempest-AttachVolumeNegativeTest-1387927917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:19:27 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2f04ecfd-3efd-4334-a573-972212eb3724 tempest-AttachVolumeNegativeTest-1387927917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:19:27 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2f04ecfd-3efd-4334-a573-972212eb3724 tempest-AttachVolumeNegativeTest-1387927917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:19:27 devstack sudo[96738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:19:27 devstack sudo[96738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:19:28 devstack sudo[96738]: pam_unix(sudo:session): session closed for user root Aug 05 10:19:28 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2f04ecfd-3efd-4334-a573-972212eb3724 tempest-AttachVolumeNegativeTest-1387927917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.803s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:19:28 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-2f04ecfd-3efd-4334-a573-972212eb3724 tempest-AttachVolumeNegativeTest-1387927917 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:19:28 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-2f04ecfd-3efd-4334-a573-972212eb3724 tempest-AttachVolumeNegativeTest-1387927917 None] Deleted volume successfully. Aug 05 10:19:28 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-2f04ecfd-3efd-4334-a573-972212eb3724 tempest-AttachVolumeNegativeTest-1387927917 None] Lock "cinder-ebe9ab38-67a4-44ac-b68f-aa45e8fb54a6-delete_volume" released by "delete_volume" :: held 2.603s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:19:28 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-565d8123-f968-4c7a-9f7f-c29a8e68302c tempest-AttachVolumeNegativeTest-1387927917 None] Acquiring lock "cinder-f1d3a323-e9a3-40ed-b11d-0b315da9d2e8-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:19:28 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-565d8123-f968-4c7a-9f7f-c29a8e68302c tempest-AttachVolumeNegativeTest-1387927917 None] Lock "cinder-f1d3a323-e9a3-40ed-b11d-0b315da9d2e8-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:19:28 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-565d8123-f968-4c7a-9f7f-c29a8e68302c tempest-AttachVolumeNegativeTest-1387927917 None] Acquiring lock "cinder-quobyte-f1d3a323-e9a3-40ed-b11d-0b315da9d2e8" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:19:28 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-565d8123-f968-4c7a-9f7f-c29a8e68302c tempest-AttachVolumeNegativeTest-1387927917 None] Lock "cinder-quobyte-f1d3a323-e9a3-40ed-b11d-0b315da9d2e8" acquired by "delete_volume" :: waited 0.062s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:19:28 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-78aa435f-533a-4a9b-8929-71ed6794bb62 tempest-GroupsTest-1679111057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:19:28 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-78aa435f-533a-4a9b-8929-71ed6794bb62 tempest-GroupsTest-1679111057 None] Flow 'volume_create_manager' (27372125-d8b2-473a-a395-5f01d5508cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:19:28 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-78aa435f-533a-4a9b-8929-71ed6794bb62 tempest-GroupsTest-1679111057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (369394e2-2e3d-4f8e-a2d5-b10962b2d8a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:19:28 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab2e926-c523-48ba-9dd7-a72c0c0959e0]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:19:28 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-565d8123-f968-4c7a-9f7f-c29a8e68302c tempest-AttachVolumeNegativeTest-1387927917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f1d3a323-e9a3-40ed-b11d-0b315da9d2e8 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:19:28 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-78aa435f-533a-4a9b-8929-71ed6794bb62 tempest-GroupsTest-1679111057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (369394e2-2e3d-4f8e-a2d5-b10962b2d8a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:19:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1852012900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3cb69a1c-99f6-4612-9af9-94c1606088c4,host='devstack@QuobyteHD#QuobyteHD',id=7de25b23-9c84-4c4c-be31-3295138d1d0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db9bd17e5aa34152b02ac54f8103e62e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:19:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:19:28Z,use_quota=True,user_id='41c25f7822b747fcb929b5ee0fe73db9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f4d117f-97df-44e9-80d4-8946b1ee9712),volume_type_id=6f4d117f-97df-44e9-80d4-8946b1ee9712)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:19:28 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-78aa435f-533a-4a9b-8929-71ed6794bb62 tempest-GroupsTest-1679111057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98e08ccb-63c7-4c9a-8606-f21b3964d31f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:19:28 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-78aa435f-533a-4a9b-8929-71ed6794bb62 tempest-GroupsTest-1679111057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98e08ccb-63c7-4c9a-8606-f21b3964d31f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:19:28 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-78aa435f-533a-4a9b-8929-71ed6794bb62 tempest-GroupsTest-1679111057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c29526cf-8a25-4db1-8b7f-a872577af1de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:19:29 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-78aa435f-533a-4a9b-8929-71ed6794bb62 tempest-GroupsTest-1679111057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c29526cf-8a25-4db1-8b7f-a872577af1de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7de25b23-9c84-4c4c-be31-3295138d1d0a', 'volume_name': 'volume-7de25b23-9c84-4c4c-be31-3295138d1d0a', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:19:29 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-78aa435f-533a-4a9b-8929-71ed6794bb62 tempest-GroupsTest-1679111057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10d1f64e-91c6-4847-942a-6559c6c4a547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:19:29 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-78aa435f-533a-4a9b-8929-71ed6794bb62 tempest-GroupsTest-1679111057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10d1f64e-91c6-4847-942a-6559c6c4a547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:19:29 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-78aa435f-533a-4a9b-8929-71ed6794bb62 tempest-GroupsTest-1679111057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b43c33a9-eaa1-49d1-875e-7b77f1d22540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:19:29 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-78aa435f-533a-4a9b-8929-71ed6794bb62 tempest-GroupsTest-1679111057 None] Volume 7de25b23-9c84-4c4c-be31-3295138d1d0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7de25b23-9c84-4c4c-be31-3295138d1d0a', 'volume_size': 1} Aug 05 10:19:29 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-78aa435f-533a-4a9b-8929-71ed6794bb62 tempest-GroupsTest-1679111057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:19:29 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-78aa435f-533a-4a9b-8929-71ed6794bb62 tempest-GroupsTest-1679111057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:19:29 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-78aa435f-533a-4a9b-8929-71ed6794bb62 tempest-GroupsTest-1679111057 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3cb69a1c-99f6-4612-9af9-94c1606088c4,created_at=2026-08-05T08:19:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1852012900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3cb69a1c-99f6-4612-9af9-94c1606088c4,host='devstack@QuobyteHD#QuobyteHD',id=7de25b23-9c84-4c4c-be31-3295138d1d0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db9bd17e5aa34152b02ac54f8103e62e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:19:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:19:28Z,use_quota=True,user_id='41c25f7822b747fcb929b5ee0fe73db9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f4d117f-97df-44e9-80d4-8946b1ee9712),volume_type_id=6f4d117f-97df-44e9-80d4-8946b1ee9712)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:19:29 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-78aa435f-533a-4a9b-8929-71ed6794bb62 tempest-GroupsTest-1679111057 None] Creating volume 7de25b23-9c84-4c4c-be31-3295138d1d0a {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:19:29 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-78aa435f-533a-4a9b-8929-71ed6794bb62 tempest-GroupsTest-1679111057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:19:29 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-78aa435f-533a-4a9b-8929-71ed6794bb62 tempest-GroupsTest-1679111057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.017s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:19:29 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-78aa435f-533a-4a9b-8929-71ed6794bb62 tempest-GroupsTest-1679111057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:19:29 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-78aa435f-533a-4a9b-8929-71ed6794bb62 tempest-GroupsTest-1679111057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:19:29 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-78aa435f-533a-4a9b-8929-71ed6794bb62 tempest-GroupsTest-1679111057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:19:29 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-78aa435f-533a-4a9b-8929-71ed6794bb62 tempest-GroupsTest-1679111057 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:19:29 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-78aa435f-533a-4a9b-8929-71ed6794bb62 tempest-GroupsTest-1679111057 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:19:29 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-78aa435f-533a-4a9b-8929-71ed6794bb62 tempest-GroupsTest-1679111057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7de25b23-9c84-4c4c-be31-3295138d1d0a 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:19:29 devstack sudo[96744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f1d3a323-e9a3-40ed-b11d-0b315da9d2e8 Aug 05 10:19:29 devstack sudo[96744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:19:29 devstack sudo[96747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7de25b23-9c84-4c4c-be31-3295138d1d0a 1073741824 Aug 05 10:19:29 devstack sudo[96747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:19:29 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-39da758a-186b-40b2-a8c7-7419367ab5bc tempest-ServerRescueNegativeTestJSON-1948930867 None] Acquiring lock "cinder-828696af-10a7-45e3-95bf-d2eb23848c80-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:19:29 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-39da758a-186b-40b2-a8c7-7419367ab5bc tempest-ServerRescueNegativeTestJSON-1948930867 None] Lock "cinder-828696af-10a7-45e3-95bf-d2eb23848c80-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:19:29 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-39da758a-186b-40b2-a8c7-7419367ab5bc tempest-ServerRescueNegativeTestJSON-1948930867 None] Acquiring lock "cinder-quobyte-828696af-10a7-45e3-95bf-d2eb23848c80" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:19:29 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-39da758a-186b-40b2-a8c7-7419367ab5bc tempest-ServerRescueNegativeTestJSON-1948930867 None] Lock "cinder-quobyte-828696af-10a7-45e3-95bf-d2eb23848c80" acquired by "delete_volume" :: waited 0.063s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:19:29 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c4aa1e-5754-49b6-a67e-46762eb2f68f]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:19:29 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-39da758a-186b-40b2-a8c7-7419367ab5bc tempest-ServerRescueNegativeTestJSON-1948930867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-828696af-10a7-45e3-95bf-d2eb23848c80 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:19:29 devstack sudo[96751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-828696af-10a7-45e3-95bf-d2eb23848c80 Aug 05 10:19:29 devstack sudo[96751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:19:30 devstack sudo[96744]: pam_unix(sudo:session): session closed for user root Aug 05 10:19:30 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-565d8123-f968-4c7a-9f7f-c29a8e68302c tempest-AttachVolumeNegativeTest-1387927917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f1d3a323-e9a3-40ed-b11d-0b315da9d2e8" returned: 0 in 1.522s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:19:30 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-565d8123-f968-4c7a-9f7f-c29a8e68302c tempest-AttachVolumeNegativeTest-1387927917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f1d3a323-e9a3-40ed-b11d-0b315da9d2e8 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:19:30 devstack sudo[96765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f1d3a323-e9a3-40ed-b11d-0b315da9d2e8 Aug 05 10:19:30 devstack sudo[96765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:19:30 devstack sudo[96751]: pam_unix(sudo:session): session closed for user root Aug 05 10:19:30 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-39da758a-186b-40b2-a8c7-7419367ab5bc tempest-ServerRescueNegativeTestJSON-1948930867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-828696af-10a7-45e3-95bf-d2eb23848c80" returned: 0 in 1.145s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:19:30 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-39da758a-186b-40b2-a8c7-7419367ab5bc tempest-ServerRescueNegativeTestJSON-1948930867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-828696af-10a7-45e3-95bf-d2eb23848c80 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:19:30 devstack sudo[96747]: pam_unix(sudo:session): session closed for user root Aug 05 10:19:30 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-78aa435f-533a-4a9b-8929-71ed6794bb62 tempest-GroupsTest-1679111057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7de25b23-9c84-4c4c-be31-3295138d1d0a 1073741824" returned: 0 in 1.712s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:19:30 devstack sudo[96773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-828696af-10a7-45e3-95bf-d2eb23848c80 Aug 05 10:19:30 devstack sudo[96773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:19:31 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-78aa435f-533a-4a9b-8929-71ed6794bb62 tempest-GroupsTest-1679111057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7de25b23-9c84-4c4c-be31-3295138d1d0a {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:19:31 devstack sudo[96776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7de25b23-9c84-4c4c-be31-3295138d1d0a Aug 05 10:19:31 devstack sudo[96776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:19:31 devstack sudo[96765]: pam_unix(sudo:session): session closed for user root Aug 05 10:19:31 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-565d8123-f968-4c7a-9f7f-c29a8e68302c tempest-AttachVolumeNegativeTest-1387927917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f1d3a323-e9a3-40ed-b11d-0b315da9d2e8" returned: 0 in 0.781s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:19:31 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-565d8123-f968-4c7a-9f7f-c29a8e68302c tempest-AttachVolumeNegativeTest-1387927917 None] Lock "cinder-quobyte-f1d3a323-e9a3-40ed-b11d-0b315da9d2e8" released by "delete_volume" :: held 2.600s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:19:31 devstack sudo[96773]: pam_unix(sudo:session): session closed for user root Aug 05 10:19:31 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-39da758a-186b-40b2-a8c7-7419367ab5bc tempest-ServerRescueNegativeTestJSON-1948930867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-828696af-10a7-45e3-95bf-d2eb23848c80" returned: 0 in 0.545s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:19:31 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-39da758a-186b-40b2-a8c7-7419367ab5bc tempest-ServerRescueNegativeTestJSON-1948930867 None] Lock "cinder-quobyte-828696af-10a7-45e3-95bf-d2eb23848c80" released by "delete_volume" :: held 1.866s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:19:31 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-565d8123-f968-4c7a-9f7f-c29a8e68302c tempest-AttachVolumeNegativeTest-1387927917 None] Created reservations ['adfe062c-fe1c-4d18-aa2e-4dc70c1212e8', '3bff8b35-f0b7-45e3-9cc0-432fe8ba2f9f', 'a3f16d5e-e199-4a05-9232-509b884cc1ac', '7e68db49-78eb-4ff6-a803-2d4125690dad'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:19:31 devstack sudo[96776]: pam_unix(sudo:session): session closed for user root Aug 05 10:19:31 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-39da758a-186b-40b2-a8c7-7419367ab5bc tempest-ServerRescueNegativeTestJSON-1948930867 None] Created reservations ['fcb1084a-d57a-41a8-933b-c4e64a889f62', '8d89d11f-6691-4b9b-a7c2-908bb4c538a3', '232ff26d-5edb-4839-8b83-8bdf85e06016', '4f2c472f-1740-483e-9c63-e4ac86a1c62e'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:19:31 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-78aa435f-533a-4a9b-8929-71ed6794bb62 tempest-GroupsTest-1679111057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7de25b23-9c84-4c4c-be31-3295138d1d0a" returned: 0 in 0.631s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:19:31 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-78aa435f-533a-4a9b-8929-71ed6794bb62 tempest-GroupsTest-1679111057 None] <== create_volume: return (2574ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:19:31 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-78aa435f-533a-4a9b-8929-71ed6794bb62 tempest-GroupsTest-1679111057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.579s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:19:31 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-565d8123-f968-4c7a-9f7f-c29a8e68302c tempest-AttachVolumeNegativeTest-1387927917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:19:31 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-565d8123-f968-4c7a-9f7f-c29a8e68302c tempest-AttachVolumeNegativeTest-1387927917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:19:31 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-565d8123-f968-4c7a-9f7f-c29a8e68302c tempest-AttachVolumeNegativeTest-1387927917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:19:31 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-565d8123-f968-4c7a-9f7f-c29a8e68302c tempest-AttachVolumeNegativeTest-1387927917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:19:31 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-565d8123-f968-4c7a-9f7f-c29a8e68302c tempest-AttachVolumeNegativeTest-1387927917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:19:31 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-565d8123-f968-4c7a-9f7f-c29a8e68302c tempest-AttachVolumeNegativeTest-1387927917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:19:31 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-78aa435f-533a-4a9b-8929-71ed6794bb62 tempest-GroupsTest-1679111057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b43c33a9-eaa1-49d1-875e-7b77f1d22540) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7de25b23-9c84-4c4c-be31-3295138d1d0a', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:19:32 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-78aa435f-533a-4a9b-8929-71ed6794bb62 tempest-GroupsTest-1679111057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c840a49-cf7d-4f30-96fb-82ede19fe729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:19:32 devstack sudo[96787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:19:32 devstack sudo[96787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:19:32 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-78aa435f-533a-4a9b-8929-71ed6794bb62 tempest-GroupsTest-1679111057 None] Volume volume-7de25b23-9c84-4c4c-be31-3295138d1d0a (7de25b23-9c84-4c4c-be31-3295138d1d0a): created successfully Aug 05 10:19:32 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-78aa435f-533a-4a9b-8929-71ed6794bb62 tempest-GroupsTest-1679111057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c840a49-cf7d-4f30-96fb-82ede19fe729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:19:32 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-78aa435f-533a-4a9b-8929-71ed6794bb62 tempest-GroupsTest-1679111057 None] Flow 'volume_create_manager' (27372125-d8b2-473a-a395-5f01d5508cff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:19:32 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-78aa435f-533a-4a9b-8929-71ed6794bb62 tempest-GroupsTest-1679111057 None] Created volume successfully. Aug 05 10:19:32 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-39da758a-186b-40b2-a8c7-7419367ab5bc tempest-ServerRescueNegativeTestJSON-1948930867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:19:32 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-39da758a-186b-40b2-a8c7-7419367ab5bc tempest-ServerRescueNegativeTestJSON-1948930867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:19:32 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-39da758a-186b-40b2-a8c7-7419367ab5bc tempest-ServerRescueNegativeTestJSON-1948930867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:19:32 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-39da758a-186b-40b2-a8c7-7419367ab5bc tempest-ServerRescueNegativeTestJSON-1948930867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:19:32 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-39da758a-186b-40b2-a8c7-7419367ab5bc tempest-ServerRescueNegativeTestJSON-1948930867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:19:32 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-39da758a-186b-40b2-a8c7-7419367ab5bc tempest-ServerRescueNegativeTestJSON-1948930867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:19:32 devstack sudo[96789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:19:32 devstack sudo[96789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:19:32 devstack sudo[96787]: pam_unix(sudo:session): session closed for user root Aug 05 10:19:32 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-565d8123-f968-4c7a-9f7f-c29a8e68302c tempest-AttachVolumeNegativeTest-1387927917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.502s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:19:32 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-565d8123-f968-4c7a-9f7f-c29a8e68302c tempest-AttachVolumeNegativeTest-1387927917 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:19:32 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-565d8123-f968-4c7a-9f7f-c29a8e68302c tempest-AttachVolumeNegativeTest-1387927917 None] Deleted volume successfully. Aug 05 10:19:32 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-565d8123-f968-4c7a-9f7f-c29a8e68302c tempest-AttachVolumeNegativeTest-1387927917 None] Lock "cinder-f1d3a323-e9a3-40ed-b11d-0b315da9d2e8-delete_volume" released by "delete_volume" :: held 4.126s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:19:32 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-0708d822-4796-40b0-adda-ef5f6706b9fc tempest-AttachVolumeNegativeTest-1387927917 None] Acquiring lock "cinder-91449632-e7bc-4795-856d-70b239798999-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:19:32 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-0708d822-4796-40b0-adda-ef5f6706b9fc tempest-AttachVolumeNegativeTest-1387927917 None] Lock "cinder-91449632-e7bc-4795-856d-70b239798999-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:19:32 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-0708d822-4796-40b0-adda-ef5f6706b9fc tempest-AttachVolumeNegativeTest-1387927917 None] Acquiring lock "cinder-quobyte-91449632-e7bc-4795-856d-70b239798999" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:19:32 devstack sudo[96789]: pam_unix(sudo:session): session closed for user root Aug 05 10:19:32 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-39da758a-186b-40b2-a8c7-7419367ab5bc tempest-ServerRescueNegativeTestJSON-1948930867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.540s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:19:32 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-39da758a-186b-40b2-a8c7-7419367ab5bc tempest-ServerRescueNegativeTestJSON-1948930867 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:19:32 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-39da758a-186b-40b2-a8c7-7419367ab5bc tempest-ServerRescueNegativeTestJSON-1948930867 None] Deleted volume successfully. Aug 05 10:19:32 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-0708d822-4796-40b0-adda-ef5f6706b9fc tempest-AttachVolumeNegativeTest-1387927917 None] Lock "cinder-quobyte-91449632-e7bc-4795-856d-70b239798999" acquired by "delete_volume" :: waited 0.044s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:19:32 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-39da758a-186b-40b2-a8c7-7419367ab5bc tempest-ServerRescueNegativeTestJSON-1948930867 None] Lock "cinder-828696af-10a7-45e3-95bf-d2eb23848c80-delete_volume" released by "delete_volume" :: held 3.483s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:19:32 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb86317-5d30-4bd4-8725-f92428824690]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:19:32 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-0708d822-4796-40b0-adda-ef5f6706b9fc tempest-AttachVolumeNegativeTest-1387927917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-91449632-e7bc-4795-856d-70b239798999 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:19:33 devstack sudo[96793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-91449632-e7bc-4795-856d-70b239798999 Aug 05 10:19:33 devstack sudo[96793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:19:33 devstack sudo[96793]: pam_unix(sudo:session): session closed for user root Aug 05 10:19:33 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-0708d822-4796-40b0-adda-ef5f6706b9fc tempest-AttachVolumeNegativeTest-1387927917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-91449632-e7bc-4795-856d-70b239798999" returned: 0 in 0.603s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:19:33 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-0708d822-4796-40b0-adda-ef5f6706b9fc tempest-AttachVolumeNegativeTest-1387927917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-91449632-e7bc-4795-856d-70b239798999 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:19:33 devstack sudo[96798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-91449632-e7bc-4795-856d-70b239798999 Aug 05 10:19:33 devstack sudo[96798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:19:34 devstack sudo[96798]: pam_unix(sudo:session): session closed for user root Aug 05 10:19:34 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-0708d822-4796-40b0-adda-ef5f6706b9fc tempest-AttachVolumeNegativeTest-1387927917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-91449632-e7bc-4795-856d-70b239798999" returned: 0 in 0.693s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:19:34 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-0708d822-4796-40b0-adda-ef5f6706b9fc tempest-AttachVolumeNegativeTest-1387927917 None] Lock "cinder-quobyte-91449632-e7bc-4795-856d-70b239798999" released by "delete_volume" :: held 1.381s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:19:34 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-0708d822-4796-40b0-adda-ef5f6706b9fc tempest-AttachVolumeNegativeTest-1387927917 None] Created reservations ['086d4de7-0310-4403-9fb6-9e7a76586f80', '4460ff76-18e4-45c4-b59d-14ff5e2f27d7', 'f035431e-a9b6-4981-ba24-81679e36faa8', '5e60efe5-48f3-4933-b563-36b9d3f7d917'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:19:34 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-08efc5bf-32e7-4093-b4f6-0d039fab7ecc tempest-GroupsTest-1679111057 None] Acquiring lock "cinder-quobyte-7de25b23-9c84-4c4c-be31-3295138d1d0a" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:19:34 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-08efc5bf-32e7-4093-b4f6-0d039fab7ecc tempest-GroupsTest-1679111057 None] Lock "cinder-quobyte-7de25b23-9c84-4c4c-be31-3295138d1d0a" acquired by "delete_volume" :: waited 0.044s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:19:34 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[36eedb08-2014-4da7-b6bf-f3591e6eabe6]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:19:34 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-08efc5bf-32e7-4093-b4f6-0d039fab7ecc tempest-GroupsTest-1679111057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7de25b23-9c84-4c4c-be31-3295138d1d0a {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:19:34 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-0708d822-4796-40b0-adda-ef5f6706b9fc tempest-AttachVolumeNegativeTest-1387927917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:19:34 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-0708d822-4796-40b0-adda-ef5f6706b9fc tempest-AttachVolumeNegativeTest-1387927917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:19:34 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-0708d822-4796-40b0-adda-ef5f6706b9fc tempest-AttachVolumeNegativeTest-1387927917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:19:34 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-0708d822-4796-40b0-adda-ef5f6706b9fc tempest-AttachVolumeNegativeTest-1387927917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:19:34 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-0708d822-4796-40b0-adda-ef5f6706b9fc tempest-AttachVolumeNegativeTest-1387927917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:19:34 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-0708d822-4796-40b0-adda-ef5f6706b9fc tempest-AttachVolumeNegativeTest-1387927917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:19:34 devstack sudo[96826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:19:34 devstack sudo[96826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:19:34 devstack sudo[96823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7de25b23-9c84-4c4c-be31-3295138d1d0a Aug 05 10:19:34 devstack sudo[96823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:19:35 devstack sudo[96826]: pam_unix(sudo:session): session closed for user root Aug 05 10:19:35 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-0708d822-4796-40b0-adda-ef5f6706b9fc tempest-AttachVolumeNegativeTest-1387927917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.690s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:19:35 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-0708d822-4796-40b0-adda-ef5f6706b9fc tempest-AttachVolumeNegativeTest-1387927917 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:19:35 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-0708d822-4796-40b0-adda-ef5f6706b9fc tempest-AttachVolumeNegativeTest-1387927917 None] Deleted volume successfully. Aug 05 10:19:35 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-0708d822-4796-40b0-adda-ef5f6706b9fc tempest-AttachVolumeNegativeTest-1387927917 None] Lock "cinder-91449632-e7bc-4795-856d-70b239798999-delete_volume" released by "delete_volume" :: held 2.910s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:19:35 devstack sudo[96823]: pam_unix(sudo:session): session closed for user root Aug 05 10:19:35 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-08efc5bf-32e7-4093-b4f6-0d039fab7ecc tempest-GroupsTest-1679111057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7de25b23-9c84-4c4c-be31-3295138d1d0a" returned: 0 in 0.968s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:19:35 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-08efc5bf-32e7-4093-b4f6-0d039fab7ecc tempest-GroupsTest-1679111057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7de25b23-9c84-4c4c-be31-3295138d1d0a {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:19:35 devstack sudo[96838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7de25b23-9c84-4c4c-be31-3295138d1d0a Aug 05 10:19:35 devstack sudo[96838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:19:36 devstack sudo[96838]: pam_unix(sudo:session): session closed for user root Aug 05 10:19:36 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-08efc5bf-32e7-4093-b4f6-0d039fab7ecc tempest-GroupsTest-1679111057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7de25b23-9c84-4c4c-be31-3295138d1d0a" returned: 0 in 0.561s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:19:36 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-08efc5bf-32e7-4093-b4f6-0d039fab7ecc tempest-GroupsTest-1679111057 None] Lock "cinder-quobyte-7de25b23-9c84-4c4c-be31-3295138d1d0a" released by "delete_volume" :: held 1.685s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:19:36 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-08efc5bf-32e7-4093-b4f6-0d039fab7ecc tempest-GroupsTest-1679111057 None] Created reservations ['ddfabea4-d73a-4655-b971-0bad06ca3586'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:19:36 devstack cinder-volume[88613]: WARNING cinder.quota [None req-08efc5bf-32e7-4093-b4f6-0d039fab7ecc tempest-GroupsTest-1679111057 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1134252566 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1134252566, it is now deprecated. Please use the default quota class for default quota. Aug 05 10:19:36 devstack cinder-volume[88613]: WARNING cinder.quota [None req-08efc5bf-32e7-4093-b4f6-0d039fab7ecc tempest-GroupsTest-1679111057 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1134252566 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1134252566, it is now deprecated. Please use the default quota class for default quota. Aug 05 10:19:36 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-08efc5bf-32e7-4093-b4f6-0d039fab7ecc tempest-GroupsTest-1679111057 None] Created reservations ['5cebaee1-3dd4-485c-91cb-1ba30fbf0780', '283a3c11-5c57-457b-b197-a861894832e3', '84d219ab-4025-492e-b64c-7f855b4fea03', 'a60c32e2-4317-41a0-8d4e-659b1c583427'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:19:36 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-08efc5bf-32e7-4093-b4f6-0d039fab7ecc tempest-GroupsTest-1679111057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:19:36 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-08efc5bf-32e7-4093-b4f6-0d039fab7ecc tempest-GroupsTest-1679111057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:19:36 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-08efc5bf-32e7-4093-b4f6-0d039fab7ecc tempest-GroupsTest-1679111057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:19:36 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-08efc5bf-32e7-4093-b4f6-0d039fab7ecc tempest-GroupsTest-1679111057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:19:36 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-08efc5bf-32e7-4093-b4f6-0d039fab7ecc tempest-GroupsTest-1679111057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:19:36 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-08efc5bf-32e7-4093-b4f6-0d039fab7ecc tempest-GroupsTest-1679111057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:19:36 devstack sudo[96842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:19:36 devstack sudo[96842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:19:37 devstack sudo[96842]: pam_unix(sudo:session): session closed for user root Aug 05 10:19:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-08efc5bf-32e7-4093-b4f6-0d039fab7ecc tempest-GroupsTest-1679111057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.370s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:19:37 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-08efc5bf-32e7-4093-b4f6-0d039fab7ecc tempest-GroupsTest-1679111057 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:19:37 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-08efc5bf-32e7-4093-b4f6-0d039fab7ecc tempest-GroupsTest-1679111057 None] Delete group completed successfully. Aug 05 10:19:37 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-7351dc2c-af34-4380-a847-0e8958ba2797 tempest-GroupsTest-1679111057 None] Created reservations ['f1683e4b-2dcf-4c8f-861e-a8857a92a144'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:19:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-7351dc2c-af34-4380-a847-0e8958ba2797 tempest-GroupsTest-1679111057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:19:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-7351dc2c-af34-4380-a847-0e8958ba2797 tempest-GroupsTest-1679111057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:19:37 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-7351dc2c-af34-4380-a847-0e8958ba2797 tempest-GroupsTest-1679111057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:19:37 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-7351dc2c-af34-4380-a847-0e8958ba2797 tempest-GroupsTest-1679111057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:19:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-7351dc2c-af34-4380-a847-0e8958ba2797 tempest-GroupsTest-1679111057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:19:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7351dc2c-af34-4380-a847-0e8958ba2797 tempest-GroupsTest-1679111057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:19:37 devstack sudo[96845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:19:37 devstack sudo[96845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:19:38 devstack sudo[96845]: pam_unix(sudo:session): session closed for user root Aug 05 10:19:38 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7351dc2c-af34-4380-a847-0e8958ba2797 tempest-GroupsTest-1679111057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.349s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:19:38 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-7351dc2c-af34-4380-a847-0e8958ba2797 tempest-GroupsTest-1679111057 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:19:38 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-7351dc2c-af34-4380-a847-0e8958ba2797 tempest-GroupsTest-1679111057 None] Delete group completed successfully. Aug 05 10:19:39 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-5ec7532d-533f-4d65-902d-549e9f157915 tempest-GroupsTest-1679111057 None] Group tempest-GroupsTest-Group-617316582: creating Aug 05 10:19:39 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-5ec7532d-533f-4d65-902d-549e9f157915 tempest-GroupsTest-1679111057 None] Group tempest-GroupsTest-Group-617316582: created successfully Aug 05 10:19:39 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-5ec7532d-533f-4d65-902d-549e9f157915 tempest-GroupsTest-1679111057 None] Create group completed successfully. Aug 05 10:19:41 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6e7bb16-46aa-4466-b74d-72492056d373 tempest-GroupsTest-1679111057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:19:41 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c6e7bb16-46aa-4466-b74d-72492056d373 tempest-GroupsTest-1679111057 None] Flow 'volume_create_manager' (cf161e78-c4cd-4371-954e-d22fe479c957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:19:41 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c6e7bb16-46aa-4466-b74d-72492056d373 tempest-GroupsTest-1679111057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbafd573-68e8-40f4-a835-15d4e27f052e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:19:41 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c6e7bb16-46aa-4466-b74d-72492056d373 tempest-GroupsTest-1679111057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbafd573-68e8-40f4-a835-15d4e27f052e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:19:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1492578717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=388e4f3a-4292-44e1-a65b-7ca898d06a92,host='devstack@QuobyteHD#QuobyteHD',id=25b679ab-1ebb-4315-9eb7-1b53cb94bf86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db9bd17e5aa34152b02ac54f8103e62e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:19:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:19:41Z,use_quota=True,user_id='41c25f7822b747fcb929b5ee0fe73db9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c42a84f-ab46-410e-8b9c-9323cc06a158),volume_type_id=6c42a84f-ab46-410e-8b9c-9323cc06a158)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:19:41 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c6e7bb16-46aa-4466-b74d-72492056d373 tempest-GroupsTest-1679111057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (798bf49a-b75b-46b2-9d88-79412f5784ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:19:41 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c6e7bb16-46aa-4466-b74d-72492056d373 tempest-GroupsTest-1679111057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (798bf49a-b75b-46b2-9d88-79412f5784ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:19:41 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c6e7bb16-46aa-4466-b74d-72492056d373 tempest-GroupsTest-1679111057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ef6acfe-03aa-4951-8be5-d5cf16f3e8b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:19:41 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c6e7bb16-46aa-4466-b74d-72492056d373 tempest-GroupsTest-1679111057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ef6acfe-03aa-4951-8be5-d5cf16f3e8b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25b679ab-1ebb-4315-9eb7-1b53cb94bf86', 'volume_name': 'volume-25b679ab-1ebb-4315-9eb7-1b53cb94bf86', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:19:41 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c6e7bb16-46aa-4466-b74d-72492056d373 tempest-GroupsTest-1679111057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b96bceb7-00ab-4751-832c-62fd6707c449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:19:41 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c6e7bb16-46aa-4466-b74d-72492056d373 tempest-GroupsTest-1679111057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b96bceb7-00ab-4751-832c-62fd6707c449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:19:41 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c6e7bb16-46aa-4466-b74d-72492056d373 tempest-GroupsTest-1679111057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd3b5c4e-01a4-424e-8488-4b785b905be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:19:41 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-c6e7bb16-46aa-4466-b74d-72492056d373 tempest-GroupsTest-1679111057 None] Volume 25b679ab-1ebb-4315-9eb7-1b53cb94bf86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25b679ab-1ebb-4315-9eb7-1b53cb94bf86', 'volume_size': 1} Aug 05 10:19:41 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c6e7bb16-46aa-4466-b74d-72492056d373 tempest-GroupsTest-1679111057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:19:41 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c6e7bb16-46aa-4466-b74d-72492056d373 tempest-GroupsTest-1679111057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:19:41 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-c6e7bb16-46aa-4466-b74d-72492056d373 tempest-GroupsTest-1679111057 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=388e4f3a-4292-44e1-a65b-7ca898d06a92,created_at=2026-08-05T08:19:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1492578717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=388e4f3a-4292-44e1-a65b-7ca898d06a92,host='devstack@QuobyteHD#QuobyteHD',id=25b679ab-1ebb-4315-9eb7-1b53cb94bf86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db9bd17e5aa34152b02ac54f8103e62e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:19:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:19:41Z,use_quota=True,user_id='41c25f7822b747fcb929b5ee0fe73db9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c42a84f-ab46-410e-8b9c-9323cc06a158),volume_type_id=6c42a84f-ab46-410e-8b9c-9323cc06a158)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:19:41 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-c6e7bb16-46aa-4466-b74d-72492056d373 tempest-GroupsTest-1679111057 None] Creating volume 25b679ab-1ebb-4315-9eb7-1b53cb94bf86 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:19:41 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c6e7bb16-46aa-4466-b74d-72492056d373 tempest-GroupsTest-1679111057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:19:41 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c6e7bb16-46aa-4466-b74d-72492056d373 tempest-GroupsTest-1679111057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:19:41 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-c6e7bb16-46aa-4466-b74d-72492056d373 tempest-GroupsTest-1679111057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:19:41 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-c6e7bb16-46aa-4466-b74d-72492056d373 tempest-GroupsTest-1679111057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:19:41 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c6e7bb16-46aa-4466-b74d-72492056d373 tempest-GroupsTest-1679111057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:19:41 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-c6e7bb16-46aa-4466-b74d-72492056d373 tempest-GroupsTest-1679111057 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:19:41 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-c6e7bb16-46aa-4466-b74d-72492056d373 tempest-GroupsTest-1679111057 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:19:41 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c6e7bb16-46aa-4466-b74d-72492056d373 tempest-GroupsTest-1679111057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-25b679ab-1ebb-4315-9eb7-1b53cb94bf86 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:19:41 devstack sudo[96874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-25b679ab-1ebb-4315-9eb7-1b53cb94bf86 1073741824 Aug 05 10:19:41 devstack sudo[96874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:19:41 devstack sudo[96874]: pam_unix(sudo:session): session closed for user root Aug 05 10:19:41 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c6e7bb16-46aa-4466-b74d-72492056d373 tempest-GroupsTest-1679111057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-25b679ab-1ebb-4315-9eb7-1b53cb94bf86 1073741824" returned: 0 in 0.522s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:19:41 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c6e7bb16-46aa-4466-b74d-72492056d373 tempest-GroupsTest-1679111057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-25b679ab-1ebb-4315-9eb7-1b53cb94bf86 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:19:42 devstack sudo[96881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-25b679ab-1ebb-4315-9eb7-1b53cb94bf86 Aug 05 10:19:42 devstack sudo[96881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:19:42 devstack sudo[96881]: pam_unix(sudo:session): session closed for user root Aug 05 10:19:42 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c6e7bb16-46aa-4466-b74d-72492056d373 tempest-GroupsTest-1679111057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-25b679ab-1ebb-4315-9eb7-1b53cb94bf86" returned: 0 in 0.328s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:19:42 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-c6e7bb16-46aa-4466-b74d-72492056d373 tempest-GroupsTest-1679111057 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:19:42 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c6e7bb16-46aa-4466-b74d-72492056d373 tempest-GroupsTest-1679111057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:19:42 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c6e7bb16-46aa-4466-b74d-72492056d373 tempest-GroupsTest-1679111057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd3b5c4e-01a4-424e-8488-4b785b905be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25b679ab-1ebb-4315-9eb7-1b53cb94bf86', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:19:42 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c6e7bb16-46aa-4466-b74d-72492056d373 tempest-GroupsTest-1679111057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aea7171d-fbaf-40f0-8ca4-4e26c9fa64ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:19:42 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-c6e7bb16-46aa-4466-b74d-72492056d373 tempest-GroupsTest-1679111057 None] Volume volume-25b679ab-1ebb-4315-9eb7-1b53cb94bf86 (25b679ab-1ebb-4315-9eb7-1b53cb94bf86): created successfully Aug 05 10:19:42 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c6e7bb16-46aa-4466-b74d-72492056d373 tempest-GroupsTest-1679111057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aea7171d-fbaf-40f0-8ca4-4e26c9fa64ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:19:42 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c6e7bb16-46aa-4466-b74d-72492056d373 tempest-GroupsTest-1679111057 None] Flow 'volume_create_manager' (cf161e78-c4cd-4371-954e-d22fe479c957) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:19:42 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-c6e7bb16-46aa-4466-b74d-72492056d373 tempest-GroupsTest-1679111057 None] Created volume successfully. Aug 05 10:19:44 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-7be14a36-7cb4-47e7-a687-6cdaaa75451f tempest-GroupsTest-1679111057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:19:44 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-7be14a36-7cb4-47e7-a687-6cdaaa75451f tempest-GroupsTest-1679111057 None] Flow 'volume_create_manager' (e8f120d7-6354-49fc-9dd5-50663b400827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:19:44 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-7be14a36-7cb4-47e7-a687-6cdaaa75451f tempest-GroupsTest-1679111057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e4a2425-0241-4434-b5cb-9bfd70a4d84a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:19:44 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-7be14a36-7cb4-47e7-a687-6cdaaa75451f tempest-GroupsTest-1679111057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e4a2425-0241-4434-b5cb-9bfd70a4d84a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:19:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-568073840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=388e4f3a-4292-44e1-a65b-7ca898d06a92,host='devstack@QuobyteHD#QuobyteHD',id=927dcba5-b1fd-40ec-9e17-f6b40a2ebb81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db9bd17e5aa34152b02ac54f8103e62e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:19:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:19:44Z,use_quota=True,user_id='41c25f7822b747fcb929b5ee0fe73db9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c42a84f-ab46-410e-8b9c-9323cc06a158),volume_type_id=6c42a84f-ab46-410e-8b9c-9323cc06a158)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:19:44 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-7be14a36-7cb4-47e7-a687-6cdaaa75451f tempest-GroupsTest-1679111057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f272b954-ee6e-4304-82a9-cfc3854c5705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:19:44 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-7be14a36-7cb4-47e7-a687-6cdaaa75451f tempest-GroupsTest-1679111057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f272b954-ee6e-4304-82a9-cfc3854c5705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:19:44 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-7be14a36-7cb4-47e7-a687-6cdaaa75451f tempest-GroupsTest-1679111057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f68c0c23-5d7c-4221-83d1-b8d95a3ee758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:19:44 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-7be14a36-7cb4-47e7-a687-6cdaaa75451f tempest-GroupsTest-1679111057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f68c0c23-5d7c-4221-83d1-b8d95a3ee758) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '927dcba5-b1fd-40ec-9e17-f6b40a2ebb81', 'volume_name': 'volume-927dcba5-b1fd-40ec-9e17-f6b40a2ebb81', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:19:44 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-7be14a36-7cb4-47e7-a687-6cdaaa75451f tempest-GroupsTest-1679111057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29fde588-de55-4ca4-bf3e-c5d11470d2bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:19:44 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-7be14a36-7cb4-47e7-a687-6cdaaa75451f tempest-GroupsTest-1679111057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29fde588-de55-4ca4-bf3e-c5d11470d2bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:19:44 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-7be14a36-7cb4-47e7-a687-6cdaaa75451f tempest-GroupsTest-1679111057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (806b8d8b-9691-4550-b674-5111337b887d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:19:44 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-7be14a36-7cb4-47e7-a687-6cdaaa75451f tempest-GroupsTest-1679111057 None] Volume 927dcba5-b1fd-40ec-9e17-f6b40a2ebb81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-927dcba5-b1fd-40ec-9e17-f6b40a2ebb81', 'volume_size': 1} Aug 05 10:19:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-7be14a36-7cb4-47e7-a687-6cdaaa75451f tempest-GroupsTest-1679111057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:19:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-7be14a36-7cb4-47e7-a687-6cdaaa75451f tempest-GroupsTest-1679111057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:19:44 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-7be14a36-7cb4-47e7-a687-6cdaaa75451f tempest-GroupsTest-1679111057 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=388e4f3a-4292-44e1-a65b-7ca898d06a92,created_at=2026-08-05T08:19:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-568073840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=388e4f3a-4292-44e1-a65b-7ca898d06a92,host='devstack@QuobyteHD#QuobyteHD',id=927dcba5-b1fd-40ec-9e17-f6b40a2ebb81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db9bd17e5aa34152b02ac54f8103e62e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:19:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:19:44Z,use_quota=True,user_id='41c25f7822b747fcb929b5ee0fe73db9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c42a84f-ab46-410e-8b9c-9323cc06a158),volume_type_id=6c42a84f-ab46-410e-8b9c-9323cc06a158)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:19:44 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-7be14a36-7cb4-47e7-a687-6cdaaa75451f tempest-GroupsTest-1679111057 None] Creating volume 927dcba5-b1fd-40ec-9e17-f6b40a2ebb81 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:19:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-7be14a36-7cb4-47e7-a687-6cdaaa75451f tempest-GroupsTest-1679111057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:19:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-7be14a36-7cb4-47e7-a687-6cdaaa75451f tempest-GroupsTest-1679111057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:19:44 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-7be14a36-7cb4-47e7-a687-6cdaaa75451f tempest-GroupsTest-1679111057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:19:44 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-7be14a36-7cb4-47e7-a687-6cdaaa75451f tempest-GroupsTest-1679111057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:19:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-7be14a36-7cb4-47e7-a687-6cdaaa75451f tempest-GroupsTest-1679111057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:19:44 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-7be14a36-7cb4-47e7-a687-6cdaaa75451f tempest-GroupsTest-1679111057 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:19:44 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-7be14a36-7cb4-47e7-a687-6cdaaa75451f tempest-GroupsTest-1679111057 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:19:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7be14a36-7cb4-47e7-a687-6cdaaa75451f tempest-GroupsTest-1679111057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-927dcba5-b1fd-40ec-9e17-f6b40a2ebb81 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:19:44 devstack sudo[96886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-927dcba5-b1fd-40ec-9e17-f6b40a2ebb81 1073741824 Aug 05 10:19:44 devstack sudo[96886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:19:45 devstack sudo[96886]: pam_unix(sudo:session): session closed for user root Aug 05 10:19:45 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7be14a36-7cb4-47e7-a687-6cdaaa75451f tempest-GroupsTest-1679111057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-927dcba5-b1fd-40ec-9e17-f6b40a2ebb81 1073741824" returned: 0 in 0.514s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:19:45 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7be14a36-7cb4-47e7-a687-6cdaaa75451f tempest-GroupsTest-1679111057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-927dcba5-b1fd-40ec-9e17-f6b40a2ebb81 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:19:45 devstack sudo[96891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-927dcba5-b1fd-40ec-9e17-f6b40a2ebb81 Aug 05 10:19:45 devstack sudo[96891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:19:45 devstack sudo[96891]: pam_unix(sudo:session): session closed for user root Aug 05 10:19:45 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7be14a36-7cb4-47e7-a687-6cdaaa75451f tempest-GroupsTest-1679111057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-927dcba5-b1fd-40ec-9e17-f6b40a2ebb81" returned: 0 in 0.300s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:19:45 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-7be14a36-7cb4-47e7-a687-6cdaaa75451f tempest-GroupsTest-1679111057 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:19:45 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-7be14a36-7cb4-47e7-a687-6cdaaa75451f tempest-GroupsTest-1679111057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:19:45 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-7be14a36-7cb4-47e7-a687-6cdaaa75451f tempest-GroupsTest-1679111057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (806b8d8b-9691-4550-b674-5111337b887d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-927dcba5-b1fd-40ec-9e17-f6b40a2ebb81', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:19:45 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-7be14a36-7cb4-47e7-a687-6cdaaa75451f tempest-GroupsTest-1679111057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fc1eaaa-c994-4c2e-917f-c508548835bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:19:45 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-7be14a36-7cb4-47e7-a687-6cdaaa75451f tempest-GroupsTest-1679111057 None] Volume volume-927dcba5-b1fd-40ec-9e17-f6b40a2ebb81 (927dcba5-b1fd-40ec-9e17-f6b40a2ebb81): created successfully Aug 05 10:19:45 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-7be14a36-7cb4-47e7-a687-6cdaaa75451f tempest-GroupsTest-1679111057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fc1eaaa-c994-4c2e-917f-c508548835bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:19:45 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-7be14a36-7cb4-47e7-a687-6cdaaa75451f tempest-GroupsTest-1679111057 None] Flow 'volume_create_manager' (e8f120d7-6354-49fc-9dd5-50663b400827) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:19:45 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-7be14a36-7cb4-47e7-a687-6cdaaa75451f tempest-GroupsTest-1679111057 None] Created volume successfully. Aug 05 10:19:45 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-dfb6017a-fe12-49d7-90f8-5d590d64ed6c tempest-GroupsTest-1679111057 None] Update group completed successfully. Aug 05 10:19:47 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-5c9c434a-2026-4943-bf70-6d617b97a715 tempest-GroupsTest-1679111057 None] Update group completed successfully. Aug 05 10:19:49 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-5ac990ba-d8c6-4ae9-b212-47c7b2384d19 tempest-GroupsTest-1679111057 None] Acquiring lock "cinder-quobyte-25b679ab-1ebb-4315-9eb7-1b53cb94bf86" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:19:49 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-5ac990ba-d8c6-4ae9-b212-47c7b2384d19 tempest-GroupsTest-1679111057 None] Lock "cinder-quobyte-25b679ab-1ebb-4315-9eb7-1b53cb94bf86" acquired by "delete_volume" :: waited 0.040s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:19:49 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fae9524-7154-4cc7-9bfc-67e22aae8ec6]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:19:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5ac990ba-d8c6-4ae9-b212-47c7b2384d19 tempest-GroupsTest-1679111057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-25b679ab-1ebb-4315-9eb7-1b53cb94bf86 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:19:49 devstack sudo[96930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-25b679ab-1ebb-4315-9eb7-1b53cb94bf86 Aug 05 10:19:49 devstack sudo[96930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:19:50 devstack sudo[96930]: pam_unix(sudo:session): session closed for user root Aug 05 10:19:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5ac990ba-d8c6-4ae9-b212-47c7b2384d19 tempest-GroupsTest-1679111057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-25b679ab-1ebb-4315-9eb7-1b53cb94bf86" returned: 0 in 0.659s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:19:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5ac990ba-d8c6-4ae9-b212-47c7b2384d19 tempest-GroupsTest-1679111057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-25b679ab-1ebb-4315-9eb7-1b53cb94bf86 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:19:50 devstack sudo[96938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-25b679ab-1ebb-4315-9eb7-1b53cb94bf86 Aug 05 10:19:50 devstack sudo[96938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:19:50 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-f95bc1b2-1d61-4c9c-9292-9ac9bd43d7cd tempest-GroupSnapshotsTest-980016808 None] Group tempest-GroupSnapshotsTest-Group-1555331715: creating Aug 05 10:19:50 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-f95bc1b2-1d61-4c9c-9292-9ac9bd43d7cd tempest-GroupSnapshotsTest-980016808 None] Group tempest-GroupSnapshotsTest-Group-1555331715: created successfully Aug 05 10:19:50 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-f95bc1b2-1d61-4c9c-9292-9ac9bd43d7cd tempest-GroupSnapshotsTest-980016808 None] Create group completed successfully. Aug 05 10:19:50 devstack sudo[96938]: pam_unix(sudo:session): session closed for user root Aug 05 10:19:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5ac990ba-d8c6-4ae9-b212-47c7b2384d19 tempest-GroupsTest-1679111057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-25b679ab-1ebb-4315-9eb7-1b53cb94bf86" returned: 0 in 0.274s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:19:50 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-5ac990ba-d8c6-4ae9-b212-47c7b2384d19 tempest-GroupsTest-1679111057 None] Lock "cinder-quobyte-25b679ab-1ebb-4315-9eb7-1b53cb94bf86" released by "delete_volume" :: held 0.994s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:19:50 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-5ac990ba-d8c6-4ae9-b212-47c7b2384d19 tempest-GroupsTest-1679111057 None] Acquiring lock "cinder-quobyte-927dcba5-b1fd-40ec-9e17-f6b40a2ebb81" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:19:50 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-5ac990ba-d8c6-4ae9-b212-47c7b2384d19 tempest-GroupsTest-1679111057 None] Lock "cinder-quobyte-927dcba5-b1fd-40ec-9e17-f6b40a2ebb81" acquired by "delete_volume" :: waited 0.012s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:19:50 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[c07f054a-dbd2-47c1-b505-b602852ecbf1]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:19:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5ac990ba-d8c6-4ae9-b212-47c7b2384d19 tempest-GroupsTest-1679111057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-927dcba5-b1fd-40ec-9e17-f6b40a2ebb81 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:19:50 devstack sudo[96941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-927dcba5-b1fd-40ec-9e17-f6b40a2ebb81 Aug 05 10:19:50 devstack sudo[96941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:19:51 devstack sudo[96941]: pam_unix(sudo:session): session closed for user root Aug 05 10:19:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5ac990ba-d8c6-4ae9-b212-47c7b2384d19 tempest-GroupsTest-1679111057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-927dcba5-b1fd-40ec-9e17-f6b40a2ebb81" returned: 0 in 0.476s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:19:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5ac990ba-d8c6-4ae9-b212-47c7b2384d19 tempest-GroupsTest-1679111057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-927dcba5-b1fd-40ec-9e17-f6b40a2ebb81 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:19:51 devstack sudo[96947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-927dcba5-b1fd-40ec-9e17-f6b40a2ebb81 Aug 05 10:19:51 devstack sudo[96947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:19:51 devstack sudo[96947]: pam_unix(sudo:session): session closed for user root Aug 05 10:19:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5ac990ba-d8c6-4ae9-b212-47c7b2384d19 tempest-GroupsTest-1679111057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-927dcba5-b1fd-40ec-9e17-f6b40a2ebb81" returned: 0 in 0.322s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:19:51 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-5ac990ba-d8c6-4ae9-b212-47c7b2384d19 tempest-GroupsTest-1679111057 None] Lock "cinder-quobyte-927dcba5-b1fd-40ec-9e17-f6b40a2ebb81" released by "delete_volume" :: held 0.847s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:19:51 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-5ac990ba-d8c6-4ae9-b212-47c7b2384d19 tempest-GroupsTest-1679111057 None] Created reservations ['4da3d2cf-5917-435c-a7ea-828f20c2bb0d'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:19:51 devstack cinder-volume[88613]: WARNING cinder.quota [None req-5ac990ba-d8c6-4ae9-b212-47c7b2384d19 tempest-GroupsTest-1679111057 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-35183315 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-35183315, it is now deprecated. Please use the default quota class for default quota. Aug 05 10:19:51 devstack cinder-volume[88613]: WARNING cinder.quota [None req-5ac990ba-d8c6-4ae9-b212-47c7b2384d19 tempest-GroupsTest-1679111057 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-35183315 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-35183315, it is now deprecated. Please use the default quota class for default quota. Aug 05 10:19:51 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-5ac990ba-d8c6-4ae9-b212-47c7b2384d19 tempest-GroupsTest-1679111057 None] Created reservations ['c3dd9cdc-852b-4e71-ae58-dfd877b664b7', '5451b6db-8395-40d2-94bd-af1999b034d9', 'ca3d33ad-6783-41f5-8e3e-d6038156c91a', 'd3a6c862-650f-43ba-a4a7-1ef6e0d81a13'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:19:51 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-5ac990ba-d8c6-4ae9-b212-47c7b2384d19 tempest-GroupsTest-1679111057 None] Created reservations ['b633e396-5bcb-4692-8f66-08d20550e54e', 'e1bf2747-3fa9-4ac2-bef8-d27f1c1ff42b', 'b3dfd62f-b9cc-4510-8797-faeec5ba997b', 'e8c40276-c075-4b89-83ab-4460c95a4698'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:19:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5ac990ba-d8c6-4ae9-b212-47c7b2384d19 tempest-GroupsTest-1679111057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:19:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5ac990ba-d8c6-4ae9-b212-47c7b2384d19 tempest-GroupsTest-1679111057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:19:51 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-5ac990ba-d8c6-4ae9-b212-47c7b2384d19 tempest-GroupsTest-1679111057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:19:51 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-5ac990ba-d8c6-4ae9-b212-47c7b2384d19 tempest-GroupsTest-1679111057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:19:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5ac990ba-d8c6-4ae9-b212-47c7b2384d19 tempest-GroupsTest-1679111057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:19:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5ac990ba-d8c6-4ae9-b212-47c7b2384d19 tempest-GroupsTest-1679111057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:19:51 devstack sudo[96950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:19:51 devstack sudo[96950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:19:52 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fbfaecd-6b69-4ed9-945f-306a067d3677 tempest-GroupSnapshotsTest-980016808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:19:52 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9fbfaecd-6b69-4ed9-945f-306a067d3677 tempest-GroupSnapshotsTest-980016808 None] Flow 'volume_create_manager' (7435c5b9-7fe6-4261-9128-f37aaf75a84d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:19:52 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9fbfaecd-6b69-4ed9-945f-306a067d3677 tempest-GroupSnapshotsTest-980016808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f83de7e-6c51-48e1-b9f7-77a6fd2f82f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:19:52 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9fbfaecd-6b69-4ed9-945f-306a067d3677 tempest-GroupSnapshotsTest-980016808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f83de7e-6c51-48e1-b9f7-77a6fd2f82f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:19:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-536300914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=16851bd6-ef51-4760-a6c3-d523b408818c,host='devstack@QuobyteHD#QuobyteHD',id=9d719700-f095-4fbf-bd53-805dfdd8eb48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf6ca537cd4147f6a8e5a1bf0fd4de76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:19:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:19:52Z,use_quota=True,user_id='4e1afba1e682464c9783bea1384a3847',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7eb6056-82e8-4c3d-96cd-3233fcc35fd7),volume_type_id=c7eb6056-82e8-4c3d-96cd-3233fcc35fd7)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:19:52 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9fbfaecd-6b69-4ed9-945f-306a067d3677 tempest-GroupSnapshotsTest-980016808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f58ad93-a540-4a22-973a-181b641f8a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:19:52 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9fbfaecd-6b69-4ed9-945f-306a067d3677 tempest-GroupSnapshotsTest-980016808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f58ad93-a540-4a22-973a-181b641f8a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:19:52 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9fbfaecd-6b69-4ed9-945f-306a067d3677 tempest-GroupSnapshotsTest-980016808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9eb5ca72-7556-4385-a3ec-4acdc2098e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:19:52 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9fbfaecd-6b69-4ed9-945f-306a067d3677 tempest-GroupSnapshotsTest-980016808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9eb5ca72-7556-4385-a3ec-4acdc2098e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d719700-f095-4fbf-bd53-805dfdd8eb48', 'volume_name': 'volume-9d719700-f095-4fbf-bd53-805dfdd8eb48', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:19:52 devstack sudo[96950]: pam_unix(sudo:session): session closed for user root Aug 05 10:19:52 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9fbfaecd-6b69-4ed9-945f-306a067d3677 tempest-GroupSnapshotsTest-980016808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23a12b70-d5e0-4a84-a58a-0e4e6991860a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:19:52 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9fbfaecd-6b69-4ed9-945f-306a067d3677 tempest-GroupSnapshotsTest-980016808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23a12b70-d5e0-4a84-a58a-0e4e6991860a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:19:52 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9fbfaecd-6b69-4ed9-945f-306a067d3677 tempest-GroupSnapshotsTest-980016808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6033d264-361d-4442-ad51-d8eb1d39c750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:19:52 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-9fbfaecd-6b69-4ed9-945f-306a067d3677 tempest-GroupSnapshotsTest-980016808 None] Volume 9d719700-f095-4fbf-bd53-805dfdd8eb48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d719700-f095-4fbf-bd53-805dfdd8eb48', 'volume_size': 1} Aug 05 10:19:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-9fbfaecd-6b69-4ed9-945f-306a067d3677 tempest-GroupSnapshotsTest-980016808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:19:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-9fbfaecd-6b69-4ed9-945f-306a067d3677 tempest-GroupSnapshotsTest-980016808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:19:52 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-9fbfaecd-6b69-4ed9-945f-306a067d3677 tempest-GroupSnapshotsTest-980016808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=16851bd6-ef51-4760-a6c3-d523b408818c,created_at=2026-08-05T08:19:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-536300914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=16851bd6-ef51-4760-a6c3-d523b408818c,host='devstack@QuobyteHD#QuobyteHD',id=9d719700-f095-4fbf-bd53-805dfdd8eb48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf6ca537cd4147f6a8e5a1bf0fd4de76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:19:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:19:52Z,use_quota=True,user_id='4e1afba1e682464c9783bea1384a3847',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7eb6056-82e8-4c3d-96cd-3233fcc35fd7),volume_type_id=c7eb6056-82e8-4c3d-96cd-3233fcc35fd7)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:19:52 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-9fbfaecd-6b69-4ed9-945f-306a067d3677 tempest-GroupSnapshotsTest-980016808 None] Creating volume 9d719700-f095-4fbf-bd53-805dfdd8eb48 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:19:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-9fbfaecd-6b69-4ed9-945f-306a067d3677 tempest-GroupSnapshotsTest-980016808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:19:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-9fbfaecd-6b69-4ed9-945f-306a067d3677 tempest-GroupSnapshotsTest-980016808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:19:52 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-9fbfaecd-6b69-4ed9-945f-306a067d3677 tempest-GroupSnapshotsTest-980016808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:19:52 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-9fbfaecd-6b69-4ed9-945f-306a067d3677 tempest-GroupSnapshotsTest-980016808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:19:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-9fbfaecd-6b69-4ed9-945f-306a067d3677 tempest-GroupSnapshotsTest-980016808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:19:52 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-9fbfaecd-6b69-4ed9-945f-306a067d3677 tempest-GroupSnapshotsTest-980016808 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:19:52 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-9fbfaecd-6b69-4ed9-945f-306a067d3677 tempest-GroupSnapshotsTest-980016808 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:19:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9fbfaecd-6b69-4ed9-945f-306a067d3677 tempest-GroupSnapshotsTest-980016808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9d719700-f095-4fbf-bd53-805dfdd8eb48 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:19:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5ac990ba-d8c6-4ae9-b212-47c7b2384d19 tempest-GroupsTest-1679111057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.443s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:19:52 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-5ac990ba-d8c6-4ae9-b212-47c7b2384d19 tempest-GroupsTest-1679111057 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:19:52 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-5ac990ba-d8c6-4ae9-b212-47c7b2384d19 tempest-GroupsTest-1679111057 None] Delete group completed successfully. Aug 05 10:19:52 devstack sudo[96953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9d719700-f095-4fbf-bd53-805dfdd8eb48 1073741824 Aug 05 10:19:52 devstack sudo[96953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:19:52 devstack sudo[96953]: pam_unix(sudo:session): session closed for user root Aug 05 10:19:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9fbfaecd-6b69-4ed9-945f-306a067d3677 tempest-GroupSnapshotsTest-980016808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9d719700-f095-4fbf-bd53-805dfdd8eb48 1073741824" returned: 0 in 0.596s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:19:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9fbfaecd-6b69-4ed9-945f-306a067d3677 tempest-GroupSnapshotsTest-980016808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9d719700-f095-4fbf-bd53-805dfdd8eb48 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:19:52 devstack sudo[96959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9d719700-f095-4fbf-bd53-805dfdd8eb48 Aug 05 10:19:52 devstack sudo[96959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:19:53 devstack sudo[96959]: pam_unix(sudo:session): session closed for user root Aug 05 10:19:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9fbfaecd-6b69-4ed9-945f-306a067d3677 tempest-GroupSnapshotsTest-980016808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9d719700-f095-4fbf-bd53-805dfdd8eb48" returned: 0 in 0.282s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:19:53 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-9fbfaecd-6b69-4ed9-945f-306a067d3677 tempest-GroupSnapshotsTest-980016808 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:19:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-9fbfaecd-6b69-4ed9-945f-306a067d3677 tempest-GroupSnapshotsTest-980016808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:19:53 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9fbfaecd-6b69-4ed9-945f-306a067d3677 tempest-GroupSnapshotsTest-980016808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6033d264-361d-4442-ad51-d8eb1d39c750) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d719700-f095-4fbf-bd53-805dfdd8eb48', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:19:53 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9fbfaecd-6b69-4ed9-945f-306a067d3677 tempest-GroupSnapshotsTest-980016808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eaedb09-30ad-44b3-933a-862f436b1c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:19:53 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-9fbfaecd-6b69-4ed9-945f-306a067d3677 tempest-GroupSnapshotsTest-980016808 None] Volume volume-9d719700-f095-4fbf-bd53-805dfdd8eb48 (9d719700-f095-4fbf-bd53-805dfdd8eb48): created successfully Aug 05 10:19:53 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9fbfaecd-6b69-4ed9-945f-306a067d3677 tempest-GroupSnapshotsTest-980016808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eaedb09-30ad-44b3-933a-862f436b1c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:19:53 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9fbfaecd-6b69-4ed9-945f-306a067d3677 tempest-GroupSnapshotsTest-980016808 None] Flow 'volume_create_manager' (7435c5b9-7fe6-4261-9128-f37aaf75a84d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:19:53 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-9fbfaecd-6b69-4ed9-945f-306a067d3677 tempest-GroupSnapshotsTest-980016808 None] Created volume successfully. Aug 05 10:19:53 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-90256644-29d1-4bb8-920e-5f8ae896fe63 tempest-GroupSnapshotsTest-980016808 None] GroupSnapshot 888c205c-ef64-4579-b890-4077395e30e3: creating. Aug 05 10:19:53 devstack cinder-volume[88613]: DEBUG dbcounter [-] [88613] Writing DB stats cinder:SELECT=103,cinder:INSERT=28,cinder:UPDATE=127,cinder:DELETE=8 {{(pid=88613) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:19:53 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-90256644-29d1-4bb8-920e-5f8ae896fe63 tempest-GroupSnapshotsTest-980016808 None] Group snapshot 888c205c-ef64-4579-b890-4077395e30e3: creating. {{(pid=88613) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 05 10:19:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-90256644-29d1-4bb8-920e-5f8ae896fe63 tempest-GroupSnapshotsTest-980016808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:19:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-90256644-29d1-4bb8-920e-5f8ae896fe63 tempest-GroupSnapshotsTest-980016808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:19:53 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-90256644-29d1-4bb8-920e-5f8ae896fe63 tempest-GroupSnapshotsTest-980016808 None] Creating offline snapshot 8c0ff78d-a059-4916-9b7d-75da92e1ec06 of volume 9d719700-f095-4fbf-bd53-805dfdd8eb48 {{(pid=88613) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:19:53 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[44dcd856-7d1c-477d-94b2-3e2ed675ab35]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:19:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-90256644-29d1-4bb8-920e-5f8ae896fe63 tempest-GroupSnapshotsTest-980016808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9d719700-f095-4fbf-bd53-805dfdd8eb48 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:19:54 devstack sudo[96962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9d719700-f095-4fbf-bd53-805dfdd8eb48 Aug 05 10:19:54 devstack sudo[96962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:19:54 devstack sudo[96962]: pam_unix(sudo:session): session closed for user root Aug 05 10:19:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-90256644-29d1-4bb8-920e-5f8ae896fe63 tempest-GroupSnapshotsTest-980016808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9d719700-f095-4fbf-bd53-805dfdd8eb48" returned: 0 in 0.560s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:19:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-90256644-29d1-4bb8-920e-5f8ae896fe63 tempest-GroupSnapshotsTest-980016808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9d719700-f095-4fbf-bd53-805dfdd8eb48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9d719700-f095-4fbf-bd53-805dfdd8eb48.8c0ff78d-a059-4916-9b7d-75da92e1ec06 1G {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:19:54 devstack sudo[96969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9d719700-f095-4fbf-bd53-805dfdd8eb48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9d719700-f095-4fbf-bd53-805dfdd8eb48.8c0ff78d-a059-4916-9b7d-75da92e1ec06 1G Aug 05 10:19:54 devstack sudo[96969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:19:55 devstack sudo[96969]: pam_unix(sudo:session): session closed for user root Aug 05 10:19:55 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-90256644-29d1-4bb8-920e-5f8ae896fe63 tempest-GroupSnapshotsTest-980016808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9d719700-f095-4fbf-bd53-805dfdd8eb48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9d719700-f095-4fbf-bd53-805dfdd8eb48.8c0ff78d-a059-4916-9b7d-75da92e1ec06 1G" returned: 0 in 0.689s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:19:55 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-90256644-29d1-4bb8-920e-5f8ae896fe63 tempest-GroupSnapshotsTest-980016808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d719700-f095-4fbf-bd53-805dfdd8eb48 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9d719700-f095-4fbf-bd53-805dfdd8eb48.8c0ff78d-a059-4916-9b7d-75da92e1ec06 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:19:55 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-613fc353-0423-42f9-afd9-5767613cdb5a tempest-TestInstancesWithCinderVolumes-1602349945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:19:55 devstack sudo[96975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d719700-f095-4fbf-bd53-805dfdd8eb48 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9d719700-f095-4fbf-bd53-805dfdd8eb48.8c0ff78d-a059-4916-9b7d-75da92e1ec06 Aug 05 10:19:55 devstack sudo[96975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:19:55 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-613fc353-0423-42f9-afd9-5767613cdb5a tempest-TestInstancesWithCinderVolumes-1602349945 None] Flow 'volume_create_manager' (8f4d03a7-0cb7-4b72-9890-ff385859dd22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:19:55 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-613fc353-0423-42f9-afd9-5767613cdb5a tempest-TestInstancesWithCinderVolumes-1602349945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6a8c809-1ffc-48fd-bd65-9fc41ffe4ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:19:55 devstack cinder-volume[88613]: DEBUG dbcounter [-] [88613] Writing DB stats cinder:UPDATE=131,cinder:DELETE=9,cinder:SELECT=104,cinder:INSERT=28 {{(pid=88613) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:19:55 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-613fc353-0423-42f9-afd9-5767613cdb5a tempest-TestInstancesWithCinderVolumes-1602349945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6a8c809-1ffc-48fd-bd65-9fc41ffe4ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:19:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-724723659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79d6f427-4b59-4387-914c-78fb879ddb34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7f3edbcb76d4d5cae5675c123f7c992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:19:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:19:55Z,use_quota=True,user_id='f742f0c2d08a4865899804ee7f4dcdf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cf73bc-7495-4763-b413-aacffd1a0ee8),volume_type_id=a1cf73bc-7495-4763-b413-aacffd1a0ee8)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:19:55 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-613fc353-0423-42f9-afd9-5767613cdb5a tempest-TestInstancesWithCinderVolumes-1602349945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (455197ed-cd5d-43b4-9291-e983d626e795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:19:55 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-613fc353-0423-42f9-afd9-5767613cdb5a tempest-TestInstancesWithCinderVolumes-1602349945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (455197ed-cd5d-43b4-9291-e983d626e795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:19:55 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-613fc353-0423-42f9-afd9-5767613cdb5a tempest-TestInstancesWithCinderVolumes-1602349945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (330c3dcd-ef38-4fcb-bb52-f54c90daf4a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:19:55 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-613fc353-0423-42f9-afd9-5767613cdb5a tempest-TestInstancesWithCinderVolumes-1602349945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (330c3dcd-ef38-4fcb-bb52-f54c90daf4a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79d6f427-4b59-4387-914c-78fb879ddb34', 'volume_name': 'volume-79d6f427-4b59-4387-914c-78fb879ddb34', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:19:55 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-613fc353-0423-42f9-afd9-5767613cdb5a tempest-TestInstancesWithCinderVolumes-1602349945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2c6d294-ab1d-44ac-9b16-3e8b1f0fab8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:19:55 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-613fc353-0423-42f9-afd9-5767613cdb5a tempest-TestInstancesWithCinderVolumes-1602349945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2c6d294-ab1d-44ac-9b16-3e8b1f0fab8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:19:55 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-613fc353-0423-42f9-afd9-5767613cdb5a tempest-TestInstancesWithCinderVolumes-1602349945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bde97e4-9934-49f3-a7eb-59d9623a6336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:19:55 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-613fc353-0423-42f9-afd9-5767613cdb5a tempest-TestInstancesWithCinderVolumes-1602349945 None] Volume 79d6f427-4b59-4387-914c-78fb879ddb34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79d6f427-4b59-4387-914c-78fb879ddb34', 'volume_size': 1} Aug 05 10:19:55 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-613fc353-0423-42f9-afd9-5767613cdb5a tempest-TestInstancesWithCinderVolumes-1602349945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:19:55 devstack sudo[96975]: pam_unix(sudo:session): session closed for user root Aug 05 10:19:55 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-90256644-29d1-4bb8-920e-5f8ae896fe63 tempest-GroupSnapshotsTest-980016808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d719700-f095-4fbf-bd53-805dfdd8eb48 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9d719700-f095-4fbf-bd53-805dfdd8eb48.8c0ff78d-a059-4916-9b7d-75da92e1ec06" returned: 0 in 0.530s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:19:55 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-90256644-29d1-4bb8-920e-5f8ae896fe63 tempest-GroupSnapshotsTest-980016808 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9d719700-f095-4fbf-bd53-805dfdd8eb48.8c0ff78d-a059-4916-9b7d-75da92e1ec06 is being set with open permissions: ugo+rw: NotImplementedError Aug 05 10:19:55 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-90256644-29d1-4bb8-920e-5f8ae896fe63 tempest-GroupSnapshotsTest-980016808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9d719700-f095-4fbf-bd53-805dfdd8eb48.8c0ff78d-a059-4916-9b7d-75da92e1ec06 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:19:55 devstack sudo[96980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9d719700-f095-4fbf-bd53-805dfdd8eb48.8c0ff78d-a059-4916-9b7d-75da92e1ec06 Aug 05 10:19:55 devstack sudo[96980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:19:55 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1c44fc0-b18b-42c9-9843-4a596c6024ee tempest-TestInstancesWithCinderVolumes-1602349945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:19:55 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a1c44fc0-b18b-42c9-9843-4a596c6024ee tempest-TestInstancesWithCinderVolumes-1602349945 None] Flow 'volume_create_manager' (a971a1f7-1cf4-49b4-a20c-056c75d396a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:19:55 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a1c44fc0-b18b-42c9-9843-4a596c6024ee tempest-TestInstancesWithCinderVolumes-1602349945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (957f6f53-a37b-481a-aa40-bfaaab4e070f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:19:55 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a1c44fc0-b18b-42c9-9843-4a596c6024ee tempest-TestInstancesWithCinderVolumes-1602349945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (957f6f53-a37b-481a-aa40-bfaaab4e070f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:19:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-818629285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50576984-0bf7-4b5e-9c5c-2f95caef2616,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7f3edbcb76d4d5cae5675c123f7c992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:19:56Z,use_quota=True,user_id='f742f0c2d08a4865899804ee7f4dcdf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b5dc499-bade-4f5d-8fe8-0f4c0cf29bf1),volume_type_id=8b5dc499-bade-4f5d-8fe8-0f4c0cf29bf1)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:19:55 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a1c44fc0-b18b-42c9-9843-4a596c6024ee tempest-TestInstancesWithCinderVolumes-1602349945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e9b5496-f64f-4a60-9a48-76e68a487050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:19:55 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a1c44fc0-b18b-42c9-9843-4a596c6024ee tempest-TestInstancesWithCinderVolumes-1602349945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e9b5496-f64f-4a60-9a48-76e68a487050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:19:55 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a1c44fc0-b18b-42c9-9843-4a596c6024ee tempest-TestInstancesWithCinderVolumes-1602349945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (723284c9-2ba2-46d8-8127-801dfa3b1f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:19:55 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a1c44fc0-b18b-42c9-9843-4a596c6024ee tempest-TestInstancesWithCinderVolumes-1602349945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (723284c9-2ba2-46d8-8127-801dfa3b1f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50576984-0bf7-4b5e-9c5c-2f95caef2616', 'volume_name': 'volume-50576984-0bf7-4b5e-9c5c-2f95caef2616', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:19:55 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a1c44fc0-b18b-42c9-9843-4a596c6024ee tempest-TestInstancesWithCinderVolumes-1602349945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3ef60c3-bf88-4021-86ad-c68aab26c2a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:19:55 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a1c44fc0-b18b-42c9-9843-4a596c6024ee tempest-TestInstancesWithCinderVolumes-1602349945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3ef60c3-bf88-4021-86ad-c68aab26c2a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:19:55 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a1c44fc0-b18b-42c9-9843-4a596c6024ee tempest-TestInstancesWithCinderVolumes-1602349945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cd049f7-56b7-4fc4-afa3-b1a7e2021cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:19:55 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-a1c44fc0-b18b-42c9-9843-4a596c6024ee tempest-TestInstancesWithCinderVolumes-1602349945 None] Volume 50576984-0bf7-4b5e-9c5c-2f95caef2616: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50576984-0bf7-4b5e-9c5c-2f95caef2616', 'volume_size': 1} Aug 05 10:19:55 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a1c44fc0-b18b-42c9-9843-4a596c6024ee tempest-TestInstancesWithCinderVolumes-1602349945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:19:56 devstack sudo[96980]: pam_unix(sudo:session): session closed for user root Aug 05 10:19:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-90256644-29d1-4bb8-920e-5f8ae896fe63 tempest-GroupSnapshotsTest-980016808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9d719700-f095-4fbf-bd53-805dfdd8eb48.8c0ff78d-a059-4916-9b7d-75da92e1ec06" returned: 0 in 0.357s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:19:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-90256644-29d1-4bb8-920e-5f8ae896fe63 tempest-GroupSnapshotsTest-980016808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9d719700-f095-4fbf-bd53-805dfdd8eb48.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:19:56 devstack sudo[96983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9d719700-f095-4fbf-bd53-805dfdd8eb48.info Aug 05 10:19:56 devstack sudo[96983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:19:56 devstack sudo[96983]: pam_unix(sudo:session): session closed for user root Aug 05 10:19:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-90256644-29d1-4bb8-920e-5f8ae896fe63 tempest-GroupSnapshotsTest-980016808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9d719700-f095-4fbf-bd53-805dfdd8eb48.info" returned: 0 in 0.339s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:19:56 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-90256644-29d1-4bb8-920e-5f8ae896fe63 tempest-GroupSnapshotsTest-980016808 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9d719700-f095-4fbf-bd53-805dfdd8eb48.info is being set with open permissions: ugo+rw: NotImplementedError Aug 05 10:19:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-90256644-29d1-4bb8-920e-5f8ae896fe63 tempest-GroupSnapshotsTest-980016808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9d719700-f095-4fbf-bd53-805dfdd8eb48.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:19:56 devstack sudo[96986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9d719700-f095-4fbf-bd53-805dfdd8eb48.info Aug 05 10:19:56 devstack sudo[96986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:19:56 devstack sudo[96986]: pam_unix(sudo:session): session closed for user root Aug 05 10:19:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-90256644-29d1-4bb8-920e-5f8ae896fe63 tempest-GroupSnapshotsTest-980016808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9d719700-f095-4fbf-bd53-805dfdd8eb48.info" returned: 0 in 0.308s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:19:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-90256644-29d1-4bb8-920e-5f8ae896fe63 tempest-GroupSnapshotsTest-980016808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.942s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:19:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-613fc353-0423-42f9-afd9-5767613cdb5a tempest-TestInstancesWithCinderVolumes-1602349945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.448s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:19:56 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-613fc353-0423-42f9-afd9-5767613cdb5a tempest-TestInstancesWithCinderVolumes-1602349945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:19:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-724723659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79d6f427-4b59-4387-914c-78fb879ddb34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7f3edbcb76d4d5cae5675c123f7c992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:19:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:19:55Z,use_quota=True,user_id='f742f0c2d08a4865899804ee7f4dcdf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cf73bc-7495-4763-b413-aacffd1a0ee8),volume_type_id=a1cf73bc-7495-4763-b413-aacffd1a0ee8)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:19:56 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-613fc353-0423-42f9-afd9-5767613cdb5a tempest-TestInstancesWithCinderVolumes-1602349945 None] Creating volume 79d6f427-4b59-4387-914c-78fb879ddb34 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:19:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-613fc353-0423-42f9-afd9-5767613cdb5a tempest-TestInstancesWithCinderVolumes-1602349945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:19:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-613fc353-0423-42f9-afd9-5767613cdb5a tempest-TestInstancesWithCinderVolumes-1602349945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:19:56 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-613fc353-0423-42f9-afd9-5767613cdb5a tempest-TestInstancesWithCinderVolumes-1602349945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:19:56 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-613fc353-0423-42f9-afd9-5767613cdb5a tempest-TestInstancesWithCinderVolumes-1602349945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:19:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-613fc353-0423-42f9-afd9-5767613cdb5a tempest-TestInstancesWithCinderVolumes-1602349945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:19:56 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-613fc353-0423-42f9-afd9-5767613cdb5a tempest-TestInstancesWithCinderVolumes-1602349945 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:19:56 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-613fc353-0423-42f9-afd9-5767613cdb5a tempest-TestInstancesWithCinderVolumes-1602349945 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:19:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-613fc353-0423-42f9-afd9-5767613cdb5a tempest-TestInstancesWithCinderVolumes-1602349945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-79d6f427-4b59-4387-914c-78fb879ddb34 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:19:56 devstack sudo[96989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-79d6f427-4b59-4387-914c-78fb879ddb34 1073741824 Aug 05 10:19:56 devstack sudo[96989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:19:57 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-90256644-29d1-4bb8-920e-5f8ae896fe63 tempest-GroupSnapshotsTest-980016808 None] group_snapshot 888c205c-ef64-4579-b890-4077395e30e3: created successfully Aug 05 10:19:57 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-91c546be-270c-474e-8de2-1988b66c50de tempest-TestInstancesWithCinderVolumes-1602349945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:19:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-91c546be-270c-474e-8de2-1988b66c50de tempest-TestInstancesWithCinderVolumes-1602349945 None] Flow 'volume_create_manager' (ab806418-f873-4a0e-a0fc-111d5af8d2a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:19:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-91c546be-270c-474e-8de2-1988b66c50de tempest-TestInstancesWithCinderVolumes-1602349945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c600b4b-6530-4dc0-9abf-4863e2ba73f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:19:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-91c546be-270c-474e-8de2-1988b66c50de tempest-TestInstancesWithCinderVolumes-1602349945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c600b4b-6530-4dc0-9abf-4863e2ba73f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-72094062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba3e0006-8d42-4334-a04d-74e5aa13cde8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7f3edbcb76d4d5cae5675c123f7c992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:19:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:19:57Z,use_quota=True,user_id='f742f0c2d08a4865899804ee7f4dcdf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a98211b2-b916-4736-9703-40b3f866ae13),volume_type_id=a98211b2-b916-4736-9703-40b3f866ae13)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:19:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-91c546be-270c-474e-8de2-1988b66c50de tempest-TestInstancesWithCinderVolumes-1602349945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec69dab7-446a-4434-ab94-ab8023420505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:19:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-91c546be-270c-474e-8de2-1988b66c50de tempest-TestInstancesWithCinderVolumes-1602349945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec69dab7-446a-4434-ab94-ab8023420505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:19:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-91c546be-270c-474e-8de2-1988b66c50de tempest-TestInstancesWithCinderVolumes-1602349945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4868f66-5600-4bbb-8a15-e998be89b59a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:19:57 devstack cinder-volume[88613]: DEBUG cinder.image.glance [None req-91c546be-270c-474e-8de2-1988b66c50de tempest-TestInstancesWithCinderVolumes-1602349945 None] Creating Keystone auth plugin from conf {{(pid=88613) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 05 10:19:57 devstack sudo[96989]: pam_unix(sudo:session): session closed for user root Aug 05 10:19:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-613fc353-0423-42f9-afd9-5767613cdb5a tempest-TestInstancesWithCinderVolumes-1602349945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-79d6f427-4b59-4387-914c-78fb879ddb34 1073741824" returned: 0 in 0.763s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:19:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-613fc353-0423-42f9-afd9-5767613cdb5a tempest-TestInstancesWithCinderVolumes-1602349945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-79d6f427-4b59-4387-914c-78fb879ddb34 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:19:57 devstack sudo[96994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-79d6f427-4b59-4387-914c-78fb879ddb34 Aug 05 10:19:57 devstack sudo[96994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:19:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-91c546be-270c-474e-8de2-1988b66c50de tempest-TestInstancesWithCinderVolumes-1602349945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4868f66-5600-4bbb-8a15-e998be89b59a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ba3e0006-8d42-4334-a04d-74e5aa13cde8', 'volume_name': 'volume-ba3e0006-8d42-4334-a04d-74e5aa13cde8', 'volume_size': 1, 'image_id': '63ccfc8e-ff1c-4f08-a3dc-b5773316f7ce', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/63ccfc8e-ff1c-4f08-a3dc-b5773316f7ce', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--673838955', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c7f3edbcb76d4d5cae5675c123f7c992', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '63ccfc8e-ff1c-4f08-a3dc-b5773316f7ce', 'created_at': datetime.datetime(2026, 8, 5, 8, 19, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 8, 19, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/63ccfc8e-ff1c-4f08-a3dc-b5773316f7ce/file', 'properties': {}}, 'image_service': }' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:19:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-91c546be-270c-474e-8de2-1988b66c50de tempest-TestInstancesWithCinderVolumes-1602349945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fdd8172-264d-4cab-a6b2-90ef28df1106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:19:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-91c546be-270c-474e-8de2-1988b66c50de tempest-TestInstancesWithCinderVolumes-1602349945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fdd8172-264d-4cab-a6b2-90ef28df1106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:19:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-91c546be-270c-474e-8de2-1988b66c50de tempest-TestInstancesWithCinderVolumes-1602349945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c6f878c-180a-4c9f-94d0-bcd442f8ed29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:19:57 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-91c546be-270c-474e-8de2-1988b66c50de tempest-TestInstancesWithCinderVolumes-1602349945 None] Volume ba3e0006-8d42-4334-a04d-74e5aa13cde8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ba3e0006-8d42-4334-a04d-74e5aa13cde8', 'volume_size': 1, 'image_id': '63ccfc8e-ff1c-4f08-a3dc-b5773316f7ce', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/63ccfc8e-ff1c-4f08-a3dc-b5773316f7ce', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--673838955', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c7f3edbcb76d4d5cae5675c123f7c992', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '63ccfc8e-ff1c-4f08-a3dc-b5773316f7ce', 'created_at': datetime.datetime(2026, 8, 5, 8, 19, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 8, 19, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/63ccfc8e-ff1c-4f08-a3dc-b5773316f7ce/file', 'properties': {}}, 'image_service': } Aug 05 10:19:57 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-91c546be-270c-474e-8de2-1988b66c50de tempest-TestInstancesWithCinderVolumes-1602349945 None] Trying to clone ba3e0006-8d42-4334-a04d-74e5aa13cde8 from image 63ccfc8e-ff1c-4f08-a3dc-b5773316f7ce at location (None, [{'url': 'file:///opt/stack/data/glance/images/63ccfc8e-ff1c-4f08-a3dc-b5773316f7ce', 'metadata': {}}]). {{(pid=88613) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 05 10:19:58 devstack sudo[96994]: pam_unix(sudo:session): session closed for user root Aug 05 10:19:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-613fc353-0423-42f9-afd9-5767613cdb5a tempest-TestInstancesWithCinderVolumes-1602349945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-79d6f427-4b59-4387-914c-78fb879ddb34" returned: 0 in 0.476s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:19:58 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-613fc353-0423-42f9-afd9-5767613cdb5a tempest-TestInstancesWithCinderVolumes-1602349945 None] <== create_volume: return (1306ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:19:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-613fc353-0423-42f9-afd9-5767613cdb5a tempest-TestInstancesWithCinderVolumes-1602349945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.311s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:19:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a1c44fc0-b18b-42c9-9843-4a596c6024ee tempest-TestInstancesWithCinderVolumes-1602349945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.263s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:19:58 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-a1c44fc0-b18b-42c9-9843-4a596c6024ee tempest-TestInstancesWithCinderVolumes-1602349945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:19:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-818629285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50576984-0bf7-4b5e-9c5c-2f95caef2616,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7f3edbcb76d4d5cae5675c123f7c992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:19:56Z,use_quota=True,user_id='f742f0c2d08a4865899804ee7f4dcdf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b5dc499-bade-4f5d-8fe8-0f4c0cf29bf1),volume_type_id=8b5dc499-bade-4f5d-8fe8-0f4c0cf29bf1)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:19:58 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-a1c44fc0-b18b-42c9-9843-4a596c6024ee tempest-TestInstancesWithCinderVolumes-1602349945 None] Creating volume 50576984-0bf7-4b5e-9c5c-2f95caef2616 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:19:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a1c44fc0-b18b-42c9-9843-4a596c6024ee tempest-TestInstancesWithCinderVolumes-1602349945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:19:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a1c44fc0-b18b-42c9-9843-4a596c6024ee tempest-TestInstancesWithCinderVolumes-1602349945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:19:58 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-a1c44fc0-b18b-42c9-9843-4a596c6024ee tempest-TestInstancesWithCinderVolumes-1602349945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:19:58 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-a1c44fc0-b18b-42c9-9843-4a596c6024ee tempest-TestInstancesWithCinderVolumes-1602349945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:19:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a1c44fc0-b18b-42c9-9843-4a596c6024ee tempest-TestInstancesWithCinderVolumes-1602349945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:19:58 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-a1c44fc0-b18b-42c9-9843-4a596c6024ee tempest-TestInstancesWithCinderVolumes-1602349945 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:19:58 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-a1c44fc0-b18b-42c9-9843-4a596c6024ee tempest-TestInstancesWithCinderVolumes-1602349945 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:19:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a1c44fc0-b18b-42c9-9843-4a596c6024ee tempest-TestInstancesWithCinderVolumes-1602349945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50576984-0bf7-4b5e-9c5c-2f95caef2616 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:19:58 devstack sudo[96997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50576984-0bf7-4b5e-9c5c-2f95caef2616 1073741824 Aug 05 10:19:58 devstack sudo[96997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:19:58 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-613fc353-0423-42f9-afd9-5767613cdb5a tempest-TestInstancesWithCinderVolumes-1602349945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bde97e4-9934-49f3-a7eb-59d9623a6336) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79d6f427-4b59-4387-914c-78fb879ddb34', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:19:58 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-613fc353-0423-42f9-afd9-5767613cdb5a tempest-TestInstancesWithCinderVolumes-1602349945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8baf459-9828-4bc0-a770-a7124e01dfa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:19:58 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-613fc353-0423-42f9-afd9-5767613cdb5a tempest-TestInstancesWithCinderVolumes-1602349945 None] Volume volume-79d6f427-4b59-4387-914c-78fb879ddb34 (79d6f427-4b59-4387-914c-78fb879ddb34): created successfully Aug 05 10:19:58 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-613fc353-0423-42f9-afd9-5767613cdb5a tempest-TestInstancesWithCinderVolumes-1602349945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8baf459-9828-4bc0-a770-a7124e01dfa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:19:58 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-613fc353-0423-42f9-afd9-5767613cdb5a tempest-TestInstancesWithCinderVolumes-1602349945 None] Flow 'volume_create_manager' (8f4d03a7-0cb7-4b72-9890-ff385859dd22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:19:58 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-613fc353-0423-42f9-afd9-5767613cdb5a tempest-TestInstancesWithCinderVolumes-1602349945 None] Created volume successfully. Aug 05 10:19:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-1f683112-c86c-467d-961d-e7c4a66d6896 tempest-GroupSnapshotsTest-980016808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:19:58 devstack sudo[96997]: pam_unix(sudo:session): session closed for user root Aug 05 10:19:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a1c44fc0-b18b-42c9-9843-4a596c6024ee tempest-TestInstancesWithCinderVolumes-1602349945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50576984-0bf7-4b5e-9c5c-2f95caef2616 1073741824" returned: 0 in 0.680s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:19:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a1c44fc0-b18b-42c9-9843-4a596c6024ee tempest-TestInstancesWithCinderVolumes-1602349945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50576984-0bf7-4b5e-9c5c-2f95caef2616 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:19:58 devstack sudo[97004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50576984-0bf7-4b5e-9c5c-2f95caef2616 Aug 05 10:19:58 devstack sudo[97004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:19:59 devstack sudo[97004]: pam_unix(sudo:session): session closed for user root Aug 05 10:19:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a1c44fc0-b18b-42c9-9843-4a596c6024ee tempest-TestInstancesWithCinderVolumes-1602349945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50576984-0bf7-4b5e-9c5c-2f95caef2616" returned: 0 in 0.309s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:19:59 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-a1c44fc0-b18b-42c9-9843-4a596c6024ee tempest-TestInstancesWithCinderVolumes-1602349945 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:19:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a1c44fc0-b18b-42c9-9843-4a596c6024ee tempest-TestInstancesWithCinderVolumes-1602349945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:19:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-1f683112-c86c-467d-961d-e7c4a66d6896 tempest-GroupSnapshotsTest-980016808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.861s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:19:59 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-1f683112-c86c-467d-961d-e7c4a66d6896 tempest-GroupSnapshotsTest-980016808 None] Acquiring lock "cinder-quobyte-8c0ff78d-a059-4916-9b7d-75da92e1ec06-52567d45-4f30-4a4e-bf25-7f521eac6e69" by "_create_volume_from_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:19:59 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a1c44fc0-b18b-42c9-9843-4a596c6024ee tempest-TestInstancesWithCinderVolumes-1602349945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cd049f7-56b7-4fc4-afa3-b1a7e2021cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50576984-0bf7-4b5e-9c5c-2f95caef2616', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:19:59 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a1c44fc0-b18b-42c9-9843-4a596c6024ee tempest-TestInstancesWithCinderVolumes-1602349945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7228496-ae14-42dd-8fee-841dff7f5df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:19:59 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-1f683112-c86c-467d-961d-e7c4a66d6896 tempest-GroupSnapshotsTest-980016808 None] Lock "cinder-quobyte-8c0ff78d-a059-4916-9b7d-75da92e1ec06-52567d45-4f30-4a4e-bf25-7f521eac6e69" acquired by "_create_volume_from_snapshot" :: waited 0.064s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:19:59 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-1f683112-c86c-467d-961d-e7c4a66d6896 tempest-GroupSnapshotsTest-980016808 None] Creating volume 52567d45-4f30-4a4e-bf25-7f521eac6e69 from snapshot 8c0ff78d-a059-4916-9b7d-75da92e1ec06 {{(pid=88613) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 05 10:19:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-1f683112-c86c-467d-961d-e7c4a66d6896 tempest-GroupSnapshotsTest-980016808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:19:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-1f683112-c86c-467d-961d-e7c4a66d6896 tempest-GroupSnapshotsTest-980016808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:19:59 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-1f683112-c86c-467d-961d-e7c4a66d6896 tempest-GroupSnapshotsTest-980016808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:19:59 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-1f683112-c86c-467d-961d-e7c4a66d6896 tempest-GroupSnapshotsTest-980016808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:19:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-1f683112-c86c-467d-961d-e7c4a66d6896 tempest-GroupSnapshotsTest-980016808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:19:59 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-1f683112-c86c-467d-961d-e7c4a66d6896 tempest-GroupSnapshotsTest-980016808 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:19:59 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-1f683112-c86c-467d-961d-e7c4a66d6896 tempest-GroupSnapshotsTest-980016808 None] Acquiring lock "cinder-quobyte-52567d45-4f30-4a4e-bf25-7f521eac6e69" by "_copy_volume_from_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:19:59 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-a1c44fc0-b18b-42c9-9843-4a596c6024ee tempest-TestInstancesWithCinderVolumes-1602349945 None] Volume volume-50576984-0bf7-4b5e-9c5c-2f95caef2616 (50576984-0bf7-4b5e-9c5c-2f95caef2616): created successfully Aug 05 10:19:59 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a1c44fc0-b18b-42c9-9843-4a596c6024ee tempest-TestInstancesWithCinderVolumes-1602349945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7228496-ae14-42dd-8fee-841dff7f5df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:19:59 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a1c44fc0-b18b-42c9-9843-4a596c6024ee tempest-TestInstancesWithCinderVolumes-1602349945 None] Flow 'volume_create_manager' (a971a1f7-1cf4-49b4-a20c-056c75d396a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:19:59 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-1f683112-c86c-467d-961d-e7c4a66d6896 tempest-GroupSnapshotsTest-980016808 None] Lock "cinder-quobyte-52567d45-4f30-4a4e-bf25-7f521eac6e69" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:19:59 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-1f683112-c86c-467d-961d-e7c4a66d6896 tempest-GroupSnapshotsTest-980016808 None] snapshot: 8c0ff78d-a059-4916-9b7d-75da92e1ec06, volume: 52567d45-4f30-4a4e-bf25-7f521eac6e69, {{(pid=88613) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 05 10:19:59 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-a1c44fc0-b18b-42c9-9843-4a596c6024ee tempest-TestInstancesWithCinderVolumes-1602349945 None] Created volume successfully. Aug 05 10:19:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-1f683112-c86c-467d-961d-e7c4a66d6896 tempest-GroupSnapshotsTest-980016808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:19:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-1f683112-c86c-467d-961d-e7c4a66d6896 tempest-GroupSnapshotsTest-980016808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:19:59 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-1f683112-c86c-467d-961d-e7c4a66d6896 tempest-GroupSnapshotsTest-980016808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:19:59 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-1f683112-c86c-467d-961d-e7c4a66d6896 tempest-GroupSnapshotsTest-980016808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:19:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-1f683112-c86c-467d-961d-e7c4a66d6896 tempest-GroupSnapshotsTest-980016808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:19:59 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[70dcec3c-22f6-4795-a665-b94560f861ce]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:19:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1f683112-c86c-467d-961d-e7c4a66d6896 tempest-GroupSnapshotsTest-980016808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9d719700-f095-4fbf-bd53-805dfdd8eb48.8c0ff78d-a059-4916-9b7d-75da92e1ec06 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:19:59 devstack sudo[97007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9d719700-f095-4fbf-bd53-805dfdd8eb48.8c0ff78d-a059-4916-9b7d-75da92e1ec06 Aug 05 10:19:59 devstack sudo[97007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:19:59 devstack sudo[97007]: pam_unix(sudo:session): session closed for user root Aug 05 10:19:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1f683112-c86c-467d-961d-e7c4a66d6896 tempest-GroupSnapshotsTest-980016808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9d719700-f095-4fbf-bd53-805dfdd8eb48.8c0ff78d-a059-4916-9b7d-75da92e1ec06" returned: 0 in 0.544s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:19:59 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-1f683112-c86c-467d-961d-e7c4a66d6896 tempest-GroupSnapshotsTest-980016808 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d719700-f095-4fbf-bd53-805dfdd8eb48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88613) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:19:59 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4597828-b62d-4bdd-a0f2-bbc95d846556]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:19:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1f683112-c86c-467d-961d-e7c4a66d6896 tempest-GroupSnapshotsTest-980016808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9d719700-f095-4fbf-bd53-805dfdd8eb48 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:00 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-84b26953-92da-479e-911d-1766def7cfaf tempest-GroupsV314Test-264440590 None] Group tempest-GroupsV314Test-Group-1672036429: creating Aug 05 10:20:00 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-84b26953-92da-479e-911d-1766def7cfaf tempest-GroupsV314Test-264440590 None] Group tempest-GroupsV314Test-Group-1672036429: created successfully Aug 05 10:20:00 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-84b26953-92da-479e-911d-1766def7cfaf tempest-GroupsV314Test-264440590 None] Create group completed successfully. Aug 05 10:20:00 devstack sudo[97013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9d719700-f095-4fbf-bd53-805dfdd8eb48 Aug 05 10:20:00 devstack sudo[97013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:00 devstack sudo[97013]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:00 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1f683112-c86c-467d-961d-e7c4a66d6896 tempest-GroupSnapshotsTest-980016808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9d719700-f095-4fbf-bd53-805dfdd8eb48" returned: 0 in 0.472s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:00 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-1f683112-c86c-467d-961d-e7c4a66d6896 tempest-GroupSnapshotsTest-980016808 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9d719700-f095-4fbf-bd53-805dfdd8eb48 {{(pid=88613) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 05 10:20:00 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-1f683112-c86c-467d-961d-e7c4a66d6896 tempest-GroupSnapshotsTest-980016808 None] Creating direct copy from snapshot {{(pid=88613) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 05 10:20:00 devstack cinder-volume[88613]: DEBUG cinder.utils [None req-1f683112-c86c-467d-961d-e7c4a66d6896 tempest-GroupSnapshotsTest-980016808 None] Path /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-52567d45-4f30-4a4e-bf25-7f521eac6e69 not found in is_blk_device check {{(pid=88613) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 05 10:20:00 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1f683112-c86c-467d-961d-e7c4a66d6896 tempest-GroupSnapshotsTest-980016808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9d719700-f095-4fbf-bd53-805dfdd8eb48 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-52567d45-4f30-4a4e-bf25-7f521eac6e69 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:00 devstack sudo[97018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9d719700-f095-4fbf-bd53-805dfdd8eb48 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-52567d45-4f30-4a4e-bf25-7f521eac6e69 Aug 05 10:20:00 devstack sudo[97018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:02 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-c75d6b6c-ae0d-4dd5-a762-e78f007baf26 tempest-GroupsV314Test-264440590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:20:02 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c75d6b6c-ae0d-4dd5-a762-e78f007baf26 tempest-GroupsV314Test-264440590 None] Flow 'volume_create_manager' (75fd0f2c-072c-4328-90ea-2ca84c7b5944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:20:02 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c75d6b6c-ae0d-4dd5-a762-e78f007baf26 tempest-GroupsV314Test-264440590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d70598ad-5936-417c-a015-c46012479c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:20:03 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c75d6b6c-ae0d-4dd5-a762-e78f007baf26 tempest-GroupsV314Test-264440590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d70598ad-5936-417c-a015-c46012479c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:20:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1358479336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0aef0657-2dd6-401a-9fc2-b18b70256b45,host='devstack@QuobyteHD#QuobyteHD',id=8133d4d7-e4aa-42f4-85e8-08a97cc7ddb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de8630a0954941a3b74c24a7be2c711d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:20:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:20:03Z,use_quota=True,user_id='d419f33a10894cadbb4a84d53d5ce487',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c12b976-47ef-4e3a-8ee5-b18f09dbe184),volume_type_id=5c12b976-47ef-4e3a-8ee5-b18f09dbe184)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:20:03 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c75d6b6c-ae0d-4dd5-a762-e78f007baf26 tempest-GroupsV314Test-264440590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac290b91-b35c-4ade-818f-7efa4e0e3b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:20:03 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c75d6b6c-ae0d-4dd5-a762-e78f007baf26 tempest-GroupsV314Test-264440590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac290b91-b35c-4ade-818f-7efa4e0e3b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:20:03 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c75d6b6c-ae0d-4dd5-a762-e78f007baf26 tempest-GroupsV314Test-264440590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (141ba5fc-0fc7-4537-b18c-4ad3eedb5222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:20:03 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c75d6b6c-ae0d-4dd5-a762-e78f007baf26 tempest-GroupsV314Test-264440590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (141ba5fc-0fc7-4537-b18c-4ad3eedb5222) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8133d4d7-e4aa-42f4-85e8-08a97cc7ddb4', 'volume_name': 'volume-8133d4d7-e4aa-42f4-85e8-08a97cc7ddb4', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:20:03 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c75d6b6c-ae0d-4dd5-a762-e78f007baf26 tempest-GroupsV314Test-264440590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9acbada1-f85b-4f62-beec-0f1dfc9df42e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:20:03 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c75d6b6c-ae0d-4dd5-a762-e78f007baf26 tempest-GroupsV314Test-264440590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9acbada1-f85b-4f62-beec-0f1dfc9df42e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:20:03 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c75d6b6c-ae0d-4dd5-a762-e78f007baf26 tempest-GroupsV314Test-264440590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (340ba590-452c-42c9-92ab-cc396f95c8bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:20:03 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-c75d6b6c-ae0d-4dd5-a762-e78f007baf26 tempest-GroupsV314Test-264440590 None] Volume 8133d4d7-e4aa-42f4-85e8-08a97cc7ddb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8133d4d7-e4aa-42f4-85e8-08a97cc7ddb4', 'volume_size': 1} Aug 05 10:20:03 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c75d6b6c-ae0d-4dd5-a762-e78f007baf26 tempest-GroupsV314Test-264440590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:20:05 devstack cinder-volume[88613]: DEBUG cinder.image.image_utils [None req-91c546be-270c-474e-8de2-1988b66c50de tempest-TestInstancesWithCinderVolumes-1602349945 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_63ccfc8e-ff1c-4f08-a3dc-b5773316f7ce_0c14vltmdevstack@QuobyteHD, size 20.69 MB, duration 7.69 sec {{(pid=88613) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 05 10:20:05 devstack cinder-volume[88613]: INFO cinder.image.image_utils [None req-91c546be-270c-474e-8de2-1988b66c50de tempest-TestInstancesWithCinderVolumes-1602349945 None] Image download 20.69 MB at 2.69 MB/s Aug 05 10:20:05 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80b9ca6-ecfa-4bf6-bc8d-a4b46c02bd9f]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:20:05 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-91c546be-270c-474e-8de2-1988b66c50de tempest-TestInstancesWithCinderVolumes-1602349945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_63ccfc8e-ff1c-4f08-a3dc-b5773316f7ce_0c14vltmdevstack@QuobyteHD {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:06 devstack sudo[97032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_63ccfc8e-ff1c-4f08-a3dc-b5773316f7ce_0c14vltmdevstack@QuobyteHD Aug 05 10:20:06 devstack sudo[97032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:06 devstack sudo[97032]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-91c546be-270c-474e-8de2-1988b66c50de tempest-TestInstancesWithCinderVolumes-1602349945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_63ccfc8e-ff1c-4f08-a3dc-b5773316f7ce_0c14vltmdevstack@QuobyteHD" returned: 0 in 0.950s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:06 devstack cinder-volume[88613]: DEBUG cinder.image.image_utils [None req-91c546be-270c-474e-8de2-1988b66c50de tempest-TestInstancesWithCinderVolumes-1602349945 None] Temporary image 63ccfc8e-ff1c-4f08-a3dc-b5773316f7ce is fetched for user f742f0c2d08a4865899804ee7f4dcdf1. {{(pid=88613) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 05 10:20:06 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdccb145-9af4-4c25-aaad-bbfe350e424d]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:20:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-91c546be-270c-474e-8de2-1988b66c50de tempest-TestInstancesWithCinderVolumes-1602349945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_63ccfc8e-ff1c-4f08-a3dc-b5773316f7ce_0c14vltmdevstack@QuobyteHD {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:06 devstack sudo[97018]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1f683112-c86c-467d-961d-e7c4a66d6896 tempest-GroupSnapshotsTest-980016808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9d719700-f095-4fbf-bd53-805dfdd8eb48 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-52567d45-4f30-4a4e-bf25-7f521eac6e69" returned: 0 in 6.475s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:06 devstack cinder-volume[88613]: DEBUG cinder.image.image_utils [None req-1f683112-c86c-467d-961d-e7c4a66d6896 tempest-GroupSnapshotsTest-980016808 None] Image conversion details: src /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9d719700-f095-4fbf-bd53-805dfdd8eb48, size 1024.00 MB, duration 6.48 sec, destination /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-52567d45-4f30-4a4e-bf25-7f521eac6e69 {{(pid=88613) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 10:20:06 devstack cinder-volume[88613]: INFO cinder.image.image_utils [None req-1f683112-c86c-467d-961d-e7c4a66d6896 tempest-GroupSnapshotsTest-980016808 None] Converted 1024.00 MB image at 158.10 MB/s Aug 05 10:20:06 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-1f683112-c86c-467d-961d-e7c4a66d6896 tempest-GroupSnapshotsTest-980016808 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-52567d45-4f30-4a4e-bf25-7f521eac6e69 is being set with open permissions: ugo+rw: NotImplementedError Aug 05 10:20:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1f683112-c86c-467d-961d-e7c4a66d6896 tempest-GroupSnapshotsTest-980016808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-52567d45-4f30-4a4e-bf25-7f521eac6e69 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:07 devstack sudo[97039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-52567d45-4f30-4a4e-bf25-7f521eac6e69 Aug 05 10:20:07 devstack sudo[97039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:07 devstack sudo[97038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_63ccfc8e-ff1c-4f08-a3dc-b5773316f7ce_0c14vltmdevstack@QuobyteHD Aug 05 10:20:07 devstack sudo[97038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:07 devstack sudo[97039]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1f683112-c86c-467d-961d-e7c4a66d6896 tempest-GroupSnapshotsTest-980016808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-52567d45-4f30-4a4e-bf25-7f521eac6e69" returned: 0 in 0.322s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:07 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-1f683112-c86c-467d-961d-e7c4a66d6896 tempest-GroupSnapshotsTest-980016808 None] Lock "cinder-quobyte-52567d45-4f30-4a4e-bf25-7f521eac6e69" released by "_copy_volume_from_snapshot" :: held 7.939s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:20:07 devstack sudo[97038]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-91c546be-270c-474e-8de2-1988b66c50de tempest-TestInstancesWithCinderVolumes-1602349945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_63ccfc8e-ff1c-4f08-a3dc-b5773316f7ce_0c14vltmdevstack@QuobyteHD" returned: 0 in 0.413s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-91c546be-270c-474e-8de2-1988b66c50de tempest-TestInstancesWithCinderVolumes-1602349945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:20:07 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-1f683112-c86c-467d-961d-e7c4a66d6896 tempest-GroupSnapshotsTest-980016808 None] Lock "cinder-quobyte-8c0ff78d-a059-4916-9b7d-75da92e1ec06-52567d45-4f30-4a4e-bf25-7f521eac6e69" released by "_create_volume_from_snapshot" :: held 8.052s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:20:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-1f683112-c86c-467d-961d-e7c4a66d6896 tempest-GroupSnapshotsTest-980016808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.119s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:20:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c75d6b6c-ae0d-4dd5-a762-e78f007baf26 tempest-GroupsV314Test-264440590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.244s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:20:07 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-c75d6b6c-ae0d-4dd5-a762-e78f007baf26 tempest-GroupsV314Test-264440590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0aef0657-2dd6-401a-9fc2-b18b70256b45,created_at=2026-08-05T08:20:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1358479336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0aef0657-2dd6-401a-9fc2-b18b70256b45,host='devstack@QuobyteHD#QuobyteHD',id=8133d4d7-e4aa-42f4-85e8-08a97cc7ddb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de8630a0954941a3b74c24a7be2c711d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:20:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:20:03Z,use_quota=True,user_id='d419f33a10894cadbb4a84d53d5ce487',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c12b976-47ef-4e3a-8ee5-b18f09dbe184),volume_type_id=5c12b976-47ef-4e3a-8ee5-b18f09dbe184)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:20:07 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-c75d6b6c-ae0d-4dd5-a762-e78f007baf26 tempest-GroupsV314Test-264440590 None] Creating volume 8133d4d7-e4aa-42f4-85e8-08a97cc7ddb4 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:20:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c75d6b6c-ae0d-4dd5-a762-e78f007baf26 tempest-GroupsV314Test-264440590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:20:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c75d6b6c-ae0d-4dd5-a762-e78f007baf26 tempest-GroupsV314Test-264440590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:20:07 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-c75d6b6c-ae0d-4dd5-a762-e78f007baf26 tempest-GroupsV314Test-264440590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:20:07 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-c75d6b6c-ae0d-4dd5-a762-e78f007baf26 tempest-GroupsV314Test-264440590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:20:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c75d6b6c-ae0d-4dd5-a762-e78f007baf26 tempest-GroupsV314Test-264440590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:20:07 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-c75d6b6c-ae0d-4dd5-a762-e78f007baf26 tempest-GroupsV314Test-264440590 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:20:07 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-c75d6b6c-ae0d-4dd5-a762-e78f007baf26 tempest-GroupsV314Test-264440590 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:20:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c75d6b6c-ae0d-4dd5-a762-e78f007baf26 tempest-GroupsV314Test-264440590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8133d4d7-e4aa-42f4-85e8-08a97cc7ddb4 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:07 devstack sudo[97053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8133d4d7-e4aa-42f4-85e8-08a97cc7ddb4 1073741824 Aug 05 10:20:07 devstack sudo[97053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:07 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-1f683112-c86c-467d-961d-e7c4a66d6896 tempest-GroupSnapshotsTest-980016808 None] Create group from source-snapshot-888c205c-ef64-4579-b890-4077395e30e3 completed successfully. Aug 05 10:20:07 devstack sudo[97053]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c75d6b6c-ae0d-4dd5-a762-e78f007baf26 tempest-GroupsV314Test-264440590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8133d4d7-e4aa-42f4-85e8-08a97cc7ddb4 1073741824" returned: 0 in 0.533s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c75d6b6c-ae0d-4dd5-a762-e78f007baf26 tempest-GroupsV314Test-264440590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8133d4d7-e4aa-42f4-85e8-08a97cc7ddb4 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:07 devstack sudo[97058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8133d4d7-e4aa-42f4-85e8-08a97cc7ddb4 Aug 05 10:20:07 devstack sudo[97058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:08 devstack sudo[97058]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c75d6b6c-ae0d-4dd5-a762-e78f007baf26 tempest-GroupsV314Test-264440590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8133d4d7-e4aa-42f4-85e8-08a97cc7ddb4" returned: 0 in 0.265s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:08 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-c75d6b6c-ae0d-4dd5-a762-e78f007baf26 tempest-GroupsV314Test-264440590 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:20:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c75d6b6c-ae0d-4dd5-a762-e78f007baf26 tempest-GroupsV314Test-264440590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:20:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-91c546be-270c-474e-8de2-1988b66c50de tempest-TestInstancesWithCinderVolumes-1602349945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.890s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:20:08 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-91c546be-270c-474e-8de2-1988b66c50de tempest-TestInstancesWithCinderVolumes-1602349945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-72094062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba3e0006-8d42-4334-a04d-74e5aa13cde8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7f3edbcb76d4d5cae5675c123f7c992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:19:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:19:57Z,use_quota=True,user_id='f742f0c2d08a4865899804ee7f4dcdf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a98211b2-b916-4736-9703-40b3f866ae13),volume_type_id=a98211b2-b916-4736-9703-40b3f866ae13)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:20:08 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-91c546be-270c-474e-8de2-1988b66c50de tempest-TestInstancesWithCinderVolumes-1602349945 None] Creating volume ba3e0006-8d42-4334-a04d-74e5aa13cde8 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:20:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-91c546be-270c-474e-8de2-1988b66c50de tempest-TestInstancesWithCinderVolumes-1602349945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:20:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-91c546be-270c-474e-8de2-1988b66c50de tempest-TestInstancesWithCinderVolumes-1602349945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:20:08 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-91c546be-270c-474e-8de2-1988b66c50de tempest-TestInstancesWithCinderVolumes-1602349945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:20:08 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-91c546be-270c-474e-8de2-1988b66c50de tempest-TestInstancesWithCinderVolumes-1602349945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:20:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-91c546be-270c-474e-8de2-1988b66c50de tempest-TestInstancesWithCinderVolumes-1602349945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:20:08 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-91c546be-270c-474e-8de2-1988b66c50de tempest-TestInstancesWithCinderVolumes-1602349945 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:20:08 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-91c546be-270c-474e-8de2-1988b66c50de tempest-TestInstancesWithCinderVolumes-1602349945 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:20:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-91c546be-270c-474e-8de2-1988b66c50de tempest-TestInstancesWithCinderVolumes-1602349945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ba3e0006-8d42-4334-a04d-74e5aa13cde8 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:08 devstack sudo[97061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ba3e0006-8d42-4334-a04d-74e5aa13cde8 1073741824 Aug 05 10:20:08 devstack sudo[97061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:08 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c75d6b6c-ae0d-4dd5-a762-e78f007baf26 tempest-GroupsV314Test-264440590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (340ba590-452c-42c9-92ab-cc396f95c8bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8133d4d7-e4aa-42f4-85e8-08a97cc7ddb4', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:20:08 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c75d6b6c-ae0d-4dd5-a762-e78f007baf26 tempest-GroupsV314Test-264440590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (918b8ff4-fdfb-45ba-9d73-2a5f2ada612f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:20:08 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-c75d6b6c-ae0d-4dd5-a762-e78f007baf26 tempest-GroupsV314Test-264440590 None] Volume volume-8133d4d7-e4aa-42f4-85e8-08a97cc7ddb4 (8133d4d7-e4aa-42f4-85e8-08a97cc7ddb4): created successfully Aug 05 10:20:08 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c75d6b6c-ae0d-4dd5-a762-e78f007baf26 tempest-GroupsV314Test-264440590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (918b8ff4-fdfb-45ba-9d73-2a5f2ada612f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:20:08 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c75d6b6c-ae0d-4dd5-a762-e78f007baf26 tempest-GroupsV314Test-264440590 None] Flow 'volume_create_manager' (75fd0f2c-072c-4328-90ea-2ca84c7b5944) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:20:08 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-c75d6b6c-ae0d-4dd5-a762-e78f007baf26 tempest-GroupsV314Test-264440590 None] Created volume successfully. Aug 05 10:20:08 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-18130f8a-e255-4fc8-b8a1-293aa25967e9 tempest-GroupSnapshotsTest-980016808 None] Acquiring lock "cinder-quobyte-52567d45-4f30-4a4e-bf25-7f521eac6e69" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:20:08 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-18130f8a-e255-4fc8-b8a1-293aa25967e9 tempest-GroupSnapshotsTest-980016808 None] Lock "cinder-quobyte-52567d45-4f30-4a4e-bf25-7f521eac6e69" acquired by "delete_volume" :: waited 0.022s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:20:08 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cbe4dca-5a6a-46f0-b84e-65f7b0dffa6a]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:20:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-18130f8a-e255-4fc8-b8a1-293aa25967e9 tempest-GroupSnapshotsTest-980016808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-52567d45-4f30-4a4e-bf25-7f521eac6e69 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:08 devstack sudo[97061]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-91c546be-270c-474e-8de2-1988b66c50de tempest-TestInstancesWithCinderVolumes-1602349945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ba3e0006-8d42-4334-a04d-74e5aa13cde8 1073741824" returned: 0 in 0.562s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:08 devstack sudo[97066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-52567d45-4f30-4a4e-bf25-7f521eac6e69 Aug 05 10:20:08 devstack sudo[97066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-91c546be-270c-474e-8de2-1988b66c50de tempest-TestInstancesWithCinderVolumes-1602349945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ba3e0006-8d42-4334-a04d-74e5aa13cde8 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:08 devstack sudo[97069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ba3e0006-8d42-4334-a04d-74e5aa13cde8 Aug 05 10:20:08 devstack sudo[97069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:09 devstack sudo[97066]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-18130f8a-e255-4fc8-b8a1-293aa25967e9 tempest-GroupSnapshotsTest-980016808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-52567d45-4f30-4a4e-bf25-7f521eac6e69" returned: 0 in 0.482s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-18130f8a-e255-4fc8-b8a1-293aa25967e9 tempest-GroupSnapshotsTest-980016808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-52567d45-4f30-4a4e-bf25-7f521eac6e69 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:09 devstack sudo[97076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-52567d45-4f30-4a4e-bf25-7f521eac6e69 Aug 05 10:20:09 devstack sudo[97076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:09 devstack sudo[97069]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-91c546be-270c-474e-8de2-1988b66c50de tempest-TestInstancesWithCinderVolumes-1602349945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ba3e0006-8d42-4334-a04d-74e5aa13cde8" returned: 0 in 0.337s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:09 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-91c546be-270c-474e-8de2-1988b66c50de tempest-TestInstancesWithCinderVolumes-1602349945 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:20:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-91c546be-270c-474e-8de2-1988b66c50de tempest-TestInstancesWithCinderVolumes-1602349945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:20:09 devstack cinder-volume[88613]: DEBUG cinder.volume.volume_utils [None req-91c546be-270c-474e-8de2-1988b66c50de tempest-TestInstancesWithCinderVolumes-1602349945 None] Attempting download of 63ccfc8e-ff1c-4f08-a3dc-b5773316f7ce ((None, [{'url': 'file:///opt/stack/data/glance/images/63ccfc8e-ff1c-4f08-a3dc-b5773316f7ce', 'metadata': {}}])) to volume ba3e0006-8d42-4334-a04d-74e5aa13cde8. {{(pid=88613) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 05 10:20:09 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[95cd7f02-4407-4d80-a680-c2ac860ee9fe]: (4, 'raw') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:20:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-91c546be-270c-474e-8de2-1988b66c50de tempest-TestInstancesWithCinderVolumes-1602349945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_63ccfc8e-ff1c-4f08-a3dc-b5773316f7ce_lvxd4yxk {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:09 devstack sudo[97076]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-18130f8a-e255-4fc8-b8a1-293aa25967e9 tempest-GroupSnapshotsTest-980016808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-52567d45-4f30-4a4e-bf25-7f521eac6e69" returned: 0 in 0.403s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:09 devstack sudo[97078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_63ccfc8e-ff1c-4f08-a3dc-b5773316f7ce_lvxd4yxk Aug 05 10:20:09 devstack sudo[97078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:09 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-18130f8a-e255-4fc8-b8a1-293aa25967e9 tempest-GroupSnapshotsTest-980016808 None] Lock "cinder-quobyte-52567d45-4f30-4a4e-bf25-7f521eac6e69" released by "delete_volume" :: held 0.944s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:20:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a0e2443d-a4fb-4c85-bda7-e475e1253fee tempest-GroupsV314Test-264440590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:20:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a0e2443d-a4fb-4c85-bda7-e475e1253fee tempest-GroupsV314Test-264440590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:20:09 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-a0e2443d-a4fb-4c85-bda7-e475e1253fee tempest-GroupsV314Test-264440590 None] Cloning volume 8133d4d7-e4aa-42f4-85e8-08a97cc7ddb4 to volume 0ff5a4f9-8160-435f-b213-855cf9f9be7b Aug 05 10:20:09 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-a0e2443d-a4fb-4c85-bda7-e475e1253fee tempest-GroupsV314Test-264440590 None] Creating offline snapshot e9f6a18e-c068-48f9-80db-f1769f702951 of volume 8133d4d7-e4aa-42f4-85e8-08a97cc7ddb4 {{(pid=88613) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:20:09 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a94978e-01e2-402d-909b-0d9e0fdc1c3d]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:20:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a0e2443d-a4fb-4c85-bda7-e475e1253fee tempest-GroupsV314Test-264440590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8133d4d7-e4aa-42f4-85e8-08a97cc7ddb4 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:09 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-18130f8a-e255-4fc8-b8a1-293aa25967e9 tempest-GroupSnapshotsTest-980016808 None] Created reservations ['894461c8-5fea-4abd-af7c-54744ae7e362'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:20:09 devstack cinder-volume[88613]: WARNING cinder.quota [None req-18130f8a-e255-4fc8-b8a1-293aa25967e9 tempest-GroupSnapshotsTest-980016808 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1897168244 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1897168244, it is now deprecated. Please use the default quota class for default quota. Aug 05 10:20:09 devstack cinder-volume[88613]: WARNING cinder.quota [None req-18130f8a-e255-4fc8-b8a1-293aa25967e9 tempest-GroupSnapshotsTest-980016808 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1897168244 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1897168244, it is now deprecated. Please use the default quota class for default quota. Aug 05 10:20:09 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-18130f8a-e255-4fc8-b8a1-293aa25967e9 tempest-GroupSnapshotsTest-980016808 None] Created reservations ['5441eb4d-8d6e-4968-b43a-d406c910bd6d', 'e75836a6-4b2c-42bf-8b74-b06697f7fc97', '4dea20b1-a698-47d4-81ab-93b31850e397', '2803a404-d83d-4138-9266-a08fb6a81839'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:20:09 devstack sudo[97081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8133d4d7-e4aa-42f4-85e8-08a97cc7ddb4 Aug 05 10:20:09 devstack sudo[97081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-18130f8a-e255-4fc8-b8a1-293aa25967e9 tempest-GroupSnapshotsTest-980016808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:20:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-18130f8a-e255-4fc8-b8a1-293aa25967e9 tempest-GroupSnapshotsTest-980016808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:20:09 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-18130f8a-e255-4fc8-b8a1-293aa25967e9 tempest-GroupSnapshotsTest-980016808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:20:09 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-18130f8a-e255-4fc8-b8a1-293aa25967e9 tempest-GroupSnapshotsTest-980016808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:20:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-18130f8a-e255-4fc8-b8a1-293aa25967e9 tempest-GroupSnapshotsTest-980016808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:20:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-18130f8a-e255-4fc8-b8a1-293aa25967e9 tempest-GroupSnapshotsTest-980016808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:09 devstack sudo[97083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:20:10 devstack sudo[97083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:10 devstack sudo[97078]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:10 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-91c546be-270c-474e-8de2-1988b66c50de tempest-TestInstancesWithCinderVolumes-1602349945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_63ccfc8e-ff1c-4f08-a3dc-b5773316f7ce_lvxd4yxk" returned: 0 in 0.678s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:10 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-91c546be-270c-474e-8de2-1988b66c50de tempest-TestInstancesWithCinderVolumes-1602349945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_63ccfc8e-ff1c-4f08-a3dc-b5773316f7ce_lvxd4yxk {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:10 devstack sudo[97087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_63ccfc8e-ff1c-4f08-a3dc-b5773316f7ce_lvxd4yxk Aug 05 10:20:10 devstack sudo[97087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:10 devstack sudo[97081]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:10 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a0e2443d-a4fb-4c85-bda7-e475e1253fee tempest-GroupsV314Test-264440590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8133d4d7-e4aa-42f4-85e8-08a97cc7ddb4" returned: 0 in 0.644s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:10 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a0e2443d-a4fb-4c85-bda7-e475e1253fee tempest-GroupsV314Test-264440590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8133d4d7-e4aa-42f4-85e8-08a97cc7ddb4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8133d4d7-e4aa-42f4-85e8-08a97cc7ddb4.e9f6a18e-c068-48f9-80db-f1769f702951 1G {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:10 devstack sudo[97083]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:10 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-18130f8a-e255-4fc8-b8a1-293aa25967e9 tempest-GroupSnapshotsTest-980016808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.399s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:10 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-18130f8a-e255-4fc8-b8a1-293aa25967e9 tempest-GroupSnapshotsTest-980016808 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:20:10 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-18130f8a-e255-4fc8-b8a1-293aa25967e9 tempest-GroupSnapshotsTest-980016808 None] Delete group completed successfully. Aug 05 10:20:10 devstack sudo[97093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8133d4d7-e4aa-42f4-85e8-08a97cc7ddb4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8133d4d7-e4aa-42f4-85e8-08a97cc7ddb4.e9f6a18e-c068-48f9-80db-f1769f702951 1G Aug 05 10:20:10 devstack sudo[97093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:10 devstack sudo[97087]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:10 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-91c546be-270c-474e-8de2-1988b66c50de tempest-TestInstancesWithCinderVolumes-1602349945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_63ccfc8e-ff1c-4f08-a3dc-b5773316f7ce_lvxd4yxk" returned: 1 in 0.484s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:10 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-91c546be-270c-474e-8de2-1988b66c50de tempest-TestInstancesWithCinderVolumes-1602349945 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_63ccfc8e-ff1c-4f08-a3dc-b5773316f7ce_lvxd4yxk' failed. Not Retrying. {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 10:20:10 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[603bf64f-a3b3-466a-a198-9fd4a2d3099f]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:20:10 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-91c546be-270c-474e-8de2-1988b66c50de tempest-TestInstancesWithCinderVolumes-1602349945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_63ccfc8e-ff1c-4f08-a3dc-b5773316f7ce_0c14vltmdevstack@QuobyteHD {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:10 devstack sudo[97097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_63ccfc8e-ff1c-4f08-a3dc-b5773316f7ce_0c14vltmdevstack@QuobyteHD Aug 05 10:20:10 devstack sudo[97097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:10 devstack sudo[97093]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:10 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a0e2443d-a4fb-4c85-bda7-e475e1253fee tempest-GroupsV314Test-264440590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8133d4d7-e4aa-42f4-85e8-08a97cc7ddb4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8133d4d7-e4aa-42f4-85e8-08a97cc7ddb4.e9f6a18e-c068-48f9-80db-f1769f702951 1G" returned: 0 in 0.496s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:10 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a0e2443d-a4fb-4c85-bda7-e475e1253fee tempest-GroupsV314Test-264440590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8133d4d7-e4aa-42f4-85e8-08a97cc7ddb4 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8133d4d7-e4aa-42f4-85e8-08a97cc7ddb4.e9f6a18e-c068-48f9-80db-f1769f702951 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:10 devstack sudo[97103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8133d4d7-e4aa-42f4-85e8-08a97cc7ddb4 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8133d4d7-e4aa-42f4-85e8-08a97cc7ddb4.e9f6a18e-c068-48f9-80db-f1769f702951 Aug 05 10:20:10 devstack sudo[97103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:10 devstack sudo[97097]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:10 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-91c546be-270c-474e-8de2-1988b66c50de tempest-TestInstancesWithCinderVolumes-1602349945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_63ccfc8e-ff1c-4f08-a3dc-b5773316f7ce_0c14vltmdevstack@QuobyteHD" returned: 0 in 0.361s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:10 devstack cinder-volume[88613]: DEBUG cinder.image.image_utils [None req-91c546be-270c-474e-8de2-1988b66c50de tempest-TestInstancesWithCinderVolumes-1602349945 None] 63ccfc8e-ff1c-4f08-a3dc-b5773316f7ce was qcow2, converting to qcow2 {{(pid=88613) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 05 10:20:10 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-91c546be-270c-474e-8de2-1988b66c50de tempest-TestInstancesWithCinderVolumes-1602349945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_63ccfc8e-ff1c-4f08-a3dc-b5773316f7ce_0c14vltmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ba3e0006-8d42-4334-a04d-74e5aa13cde8 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:10 devstack sudo[97108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_63ccfc8e-ff1c-4f08-a3dc-b5773316f7ce_0c14vltmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ba3e0006-8d42-4334-a04d-74e5aa13cde8 Aug 05 10:20:10 devstack sudo[97108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:11 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-928040ee-b55f-48f2-8f87-03f7745a848c tempest-GroupSnapshotsTest-980016808 None] group_snapshot 888c205c-ef64-4579-b890-4077395e30e3: deleting Aug 05 10:20:11 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-928040ee-b55f-48f2-8f87-03f7745a848c tempest-GroupSnapshotsTest-980016808 None] group_snapshot 888c205c-ef64-4579-b890-4077395e30e3: deleting {{(pid=88613) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 05 10:20:11 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-928040ee-b55f-48f2-8f87-03f7745a848c tempest-GroupSnapshotsTest-980016808 None] Acquiring lock "cinder-quobyte-9d719700-f095-4fbf-bd53-805dfdd8eb48" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:20:11 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-928040ee-b55f-48f2-8f87-03f7745a848c tempest-GroupSnapshotsTest-980016808 None] Lock "cinder-quobyte-9d719700-f095-4fbf-bd53-805dfdd8eb48" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:20:11 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-928040ee-b55f-48f2-8f87-03f7745a848c tempest-GroupSnapshotsTest-980016808 None] Acquiring lock "cinder-quobyte-8c0ff78d-a059-4916-9b7d-75da92e1ec06" by "_delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:20:11 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-928040ee-b55f-48f2-8f87-03f7745a848c tempest-GroupSnapshotsTest-980016808 None] Lock "cinder-quobyte-8c0ff78d-a059-4916-9b7d-75da92e1ec06" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:20:11 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-928040ee-b55f-48f2-8f87-03f7745a848c tempest-GroupSnapshotsTest-980016808 None] Deleting offline snapshot 8c0ff78d-a059-4916-9b7d-75da92e1ec06 of volume 9d719700-f095-4fbf-bd53-805dfdd8eb48 {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:20:11 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-928040ee-b55f-48f2-8f87-03f7745a848c tempest-GroupSnapshotsTest-980016808 None] snapshot_file for this snap is: volume-9d719700-f095-4fbf-bd53-805dfdd8eb48.8c0ff78d-a059-4916-9b7d-75da92e1ec06 {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:20:11 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f95519c-fdac-4c5d-a816-06a9f227ccc5]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:20:11 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-928040ee-b55f-48f2-8f87-03f7745a848c tempest-GroupSnapshotsTest-980016808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9d719700-f095-4fbf-bd53-805dfdd8eb48.8c0ff78d-a059-4916-9b7d-75da92e1ec06 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:11 devstack sudo[97103]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:11 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a0e2443d-a4fb-4c85-bda7-e475e1253fee tempest-GroupsV314Test-264440590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8133d4d7-e4aa-42f4-85e8-08a97cc7ddb4 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8133d4d7-e4aa-42f4-85e8-08a97cc7ddb4.e9f6a18e-c068-48f9-80db-f1769f702951" returned: 0 in 0.419s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:11 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-a0e2443d-a4fb-4c85-bda7-e475e1253fee tempest-GroupsV314Test-264440590 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8133d4d7-e4aa-42f4-85e8-08a97cc7ddb4.e9f6a18e-c068-48f9-80db-f1769f702951 is being set with open permissions: ugo+rw: NotImplementedError Aug 05 10:20:11 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a0e2443d-a4fb-4c85-bda7-e475e1253fee tempest-GroupsV314Test-264440590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8133d4d7-e4aa-42f4-85e8-08a97cc7ddb4.e9f6a18e-c068-48f9-80db-f1769f702951 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:11 devstack sudo[97118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8133d4d7-e4aa-42f4-85e8-08a97cc7ddb4.e9f6a18e-c068-48f9-80db-f1769f702951 Aug 05 10:20:11 devstack sudo[97118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:11 devstack sudo[97115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9d719700-f095-4fbf-bd53-805dfdd8eb48.8c0ff78d-a059-4916-9b7d-75da92e1ec06 Aug 05 10:20:11 devstack sudo[97115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:11 devstack sudo[97118]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:11 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a0e2443d-a4fb-4c85-bda7-e475e1253fee tempest-GroupsV314Test-264440590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8133d4d7-e4aa-42f4-85e8-08a97cc7ddb4.e9f6a18e-c068-48f9-80db-f1769f702951" returned: 0 in 0.293s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:11 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a0e2443d-a4fb-4c85-bda7-e475e1253fee tempest-GroupsV314Test-264440590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8133d4d7-e4aa-42f4-85e8-08a97cc7ddb4.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:11 devstack sudo[97124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8133d4d7-e4aa-42f4-85e8-08a97cc7ddb4.info Aug 05 10:20:11 devstack sudo[97124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:11 devstack sudo[97115]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:11 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-928040ee-b55f-48f2-8f87-03f7745a848c tempest-GroupSnapshotsTest-980016808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9d719700-f095-4fbf-bd53-805dfdd8eb48.8c0ff78d-a059-4916-9b7d-75da92e1ec06" returned: 0 in 0.523s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:11 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-928040ee-b55f-48f2-8f87-03f7745a848c tempest-GroupSnapshotsTest-980016808 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d719700-f095-4fbf-bd53-805dfdd8eb48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88613) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:20:11 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb05e2be-c2f5-41d6-8a8d-3db3b6af8f70]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:20:11 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-928040ee-b55f-48f2-8f87-03f7745a848c tempest-GroupSnapshotsTest-980016808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9d719700-f095-4fbf-bd53-805dfdd8eb48 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:11 devstack sudo[97124]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:11 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a0e2443d-a4fb-4c85-bda7-e475e1253fee tempest-GroupsV314Test-264440590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8133d4d7-e4aa-42f4-85e8-08a97cc7ddb4.info" returned: 0 in 0.267s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:11 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-a0e2443d-a4fb-4c85-bda7-e475e1253fee tempest-GroupsV314Test-264440590 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8133d4d7-e4aa-42f4-85e8-08a97cc7ddb4.info is being set with open permissions: ugo+rw: NotImplementedError Aug 05 10:20:11 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a0e2443d-a4fb-4c85-bda7-e475e1253fee tempest-GroupsV314Test-264440590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8133d4d7-e4aa-42f4-85e8-08a97cc7ddb4.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:11 devstack sudo[97131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8133d4d7-e4aa-42f4-85e8-08a97cc7ddb4.info Aug 05 10:20:11 devstack sudo[97131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:11 devstack sudo[97129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9d719700-f095-4fbf-bd53-805dfdd8eb48 Aug 05 10:20:11 devstack sudo[97129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:12 devstack sudo[97131]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:12 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a0e2443d-a4fb-4c85-bda7-e475e1253fee tempest-GroupsV314Test-264440590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8133d4d7-e4aa-42f4-85e8-08a97cc7ddb4.info" returned: 0 in 0.275s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:12 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-a0e2443d-a4fb-4c85-bda7-e475e1253fee tempest-GroupsV314Test-264440590 None] Acquiring lock "cinder-quobyte-0ff5a4f9-8160-435f-b213-855cf9f9be7b" by "_copy_volume_from_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:20:12 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-a0e2443d-a4fb-4c85-bda7-e475e1253fee tempest-GroupsV314Test-264440590 None] Lock "cinder-quobyte-0ff5a4f9-8160-435f-b213-855cf9f9be7b" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:20:12 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-a0e2443d-a4fb-4c85-bda7-e475e1253fee tempest-GroupsV314Test-264440590 None] snapshot: e9f6a18e-c068-48f9-80db-f1769f702951, volume: 0ff5a4f9-8160-435f-b213-855cf9f9be7b, {{(pid=88613) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 05 10:20:12 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a0e2443d-a4fb-4c85-bda7-e475e1253fee tempest-GroupsV314Test-264440590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:20:12 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a0e2443d-a4fb-4c85-bda7-e475e1253fee tempest-GroupsV314Test-264440590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:20:12 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-a0e2443d-a4fb-4c85-bda7-e475e1253fee tempest-GroupsV314Test-264440590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:20:12 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-a0e2443d-a4fb-4c85-bda7-e475e1253fee tempest-GroupsV314Test-264440590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:20:12 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a0e2443d-a4fb-4c85-bda7-e475e1253fee tempest-GroupsV314Test-264440590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:20:12 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[96828417-4fed-44d6-9057-b6581bc50ed3]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:20:12 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a0e2443d-a4fb-4c85-bda7-e475e1253fee tempest-GroupsV314Test-264440590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8133d4d7-e4aa-42f4-85e8-08a97cc7ddb4.e9f6a18e-c068-48f9-80db-f1769f702951 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:12 devstack sudo[97137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8133d4d7-e4aa-42f4-85e8-08a97cc7ddb4.e9f6a18e-c068-48f9-80db-f1769f702951 Aug 05 10:20:12 devstack sudo[97137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:12 devstack sudo[97129]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:12 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-928040ee-b55f-48f2-8f87-03f7745a848c tempest-GroupSnapshotsTest-980016808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9d719700-f095-4fbf-bd53-805dfdd8eb48" returned: 0 in 0.660s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:12 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-928040ee-b55f-48f2-8f87-03f7745a848c tempest-GroupSnapshotsTest-980016808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9d719700-f095-4fbf-bd53-805dfdd8eb48.8c0ff78d-a059-4916-9b7d-75da92e1ec06 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:12 devstack sudo[97141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9d719700-f095-4fbf-bd53-805dfdd8eb48.8c0ff78d-a059-4916-9b7d-75da92e1ec06 Aug 05 10:20:12 devstack sudo[97141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:12 devstack sudo[97137]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:12 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a0e2443d-a4fb-4c85-bda7-e475e1253fee tempest-GroupsV314Test-264440590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8133d4d7-e4aa-42f4-85e8-08a97cc7ddb4.e9f6a18e-c068-48f9-80db-f1769f702951" returned: 0 in 0.463s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:12 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-a0e2443d-a4fb-4c85-bda7-e475e1253fee tempest-GroupsV314Test-264440590 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8133d4d7-e4aa-42f4-85e8-08a97cc7ddb4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88613) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:20:12 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[315cf4aa-e830-4eaa-8b25-f9131256f54e]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:20:12 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a0e2443d-a4fb-4c85-bda7-e475e1253fee tempest-GroupsV314Test-264440590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8133d4d7-e4aa-42f4-85e8-08a97cc7ddb4 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:12 devstack sudo[97148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8133d4d7-e4aa-42f4-85e8-08a97cc7ddb4 Aug 05 10:20:12 devstack sudo[97148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:12 devstack sudo[97141]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:12 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-928040ee-b55f-48f2-8f87-03f7745a848c tempest-GroupSnapshotsTest-980016808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9d719700-f095-4fbf-bd53-805dfdd8eb48.8c0ff78d-a059-4916-9b7d-75da92e1ec06" returned: 0 in 0.498s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:12 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-928040ee-b55f-48f2-8f87-03f7745a848c tempest-GroupSnapshotsTest-980016808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9d719700-f095-4fbf-bd53-805dfdd8eb48.8c0ff78d-a059-4916-9b7d-75da92e1ec06 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:12 devstack sudo[97154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9d719700-f095-4fbf-bd53-805dfdd8eb48.8c0ff78d-a059-4916-9b7d-75da92e1ec06 Aug 05 10:20:12 devstack sudo[97154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:13 devstack sudo[97148]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:13 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a0e2443d-a4fb-4c85-bda7-e475e1253fee tempest-GroupsV314Test-264440590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8133d4d7-e4aa-42f4-85e8-08a97cc7ddb4" returned: 0 in 0.416s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:13 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-a0e2443d-a4fb-4c85-bda7-e475e1253fee tempest-GroupsV314Test-264440590 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8133d4d7-e4aa-42f4-85e8-08a97cc7ddb4 {{(pid=88613) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 05 10:20:13 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-a0e2443d-a4fb-4c85-bda7-e475e1253fee tempest-GroupsV314Test-264440590 None] Creating direct copy from snapshot {{(pid=88613) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 05 10:20:13 devstack cinder-volume[88613]: DEBUG cinder.utils [None req-a0e2443d-a4fb-4c85-bda7-e475e1253fee tempest-GroupsV314Test-264440590 None] Path /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0ff5a4f9-8160-435f-b213-855cf9f9be7b not found in is_blk_device check {{(pid=88613) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 05 10:20:13 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a0e2443d-a4fb-4c85-bda7-e475e1253fee tempest-GroupsV314Test-264440590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8133d4d7-e4aa-42f4-85e8-08a97cc7ddb4 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0ff5a4f9-8160-435f-b213-855cf9f9be7b {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:13 devstack sudo[97108]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:13 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-91c546be-270c-474e-8de2-1988b66c50de tempest-TestInstancesWithCinderVolumes-1602349945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_63ccfc8e-ff1c-4f08-a3dc-b5773316f7ce_0c14vltmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ba3e0006-8d42-4334-a04d-74e5aa13cde8" returned: 0 in 2.265s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:13 devstack cinder-volume[88613]: DEBUG cinder.image.image_utils [None req-91c546be-270c-474e-8de2-1988b66c50de tempest-TestInstancesWithCinderVolumes-1602349945 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_63ccfc8e-ff1c-4f08-a3dc-b5773316f7ce_0c14vltmdevstack@QuobyteHD, size 112.00 MB, duration 2.27 sec, destination /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ba3e0006-8d42-4334-a04d-74e5aa13cde8 {{(pid=88613) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 10:20:13 devstack cinder-volume[88613]: INFO cinder.image.image_utils [None req-91c546be-270c-474e-8de2-1988b66c50de tempest-TestInstancesWithCinderVolumes-1602349945 None] Converted 112.00 MB image at 49.41 MB/s Aug 05 10:20:13 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-91c546be-270c-474e-8de2-1988b66c50de tempest-TestInstancesWithCinderVolumes-1602349945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ba3e0006-8d42-4334-a04d-74e5aa13cde8 1G {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:13 devstack sudo[97159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8133d4d7-e4aa-42f4-85e8-08a97cc7ddb4 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0ff5a4f9-8160-435f-b213-855cf9f9be7b Aug 05 10:20:13 devstack sudo[97159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:13 devstack sudo[97160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ba3e0006-8d42-4334-a04d-74e5aa13cde8 1G Aug 05 10:20:13 devstack sudo[97160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:13 devstack sudo[97154]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:13 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-928040ee-b55f-48f2-8f87-03f7745a848c tempest-GroupSnapshotsTest-980016808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9d719700-f095-4fbf-bd53-805dfdd8eb48.8c0ff78d-a059-4916-9b7d-75da92e1ec06" returned: 0 in 0.321s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:13 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-928040ee-b55f-48f2-8f87-03f7745a848c tempest-GroupSnapshotsTest-980016808 None] Lock "cinder-quobyte-8c0ff78d-a059-4916-9b7d-75da92e1ec06" released by "_delete_snapshot" :: held 2.144s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:20:13 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-928040ee-b55f-48f2-8f87-03f7745a848c tempest-GroupSnapshotsTest-980016808 None] Lock "cinder-quobyte-9d719700-f095-4fbf-bd53-805dfdd8eb48" released by "delete_snapshot" :: held 2.185s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:20:13 devstack cinder-volume[88613]: WARNING cinder.quota [None req-928040ee-b55f-48f2-8f87-03f7745a848c tempest-GroupSnapshotsTest-980016808 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1897168244 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1897168244, it is now deprecated. Please use the default quota class for default quota. Aug 05 10:20:13 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-928040ee-b55f-48f2-8f87-03f7745a848c tempest-GroupSnapshotsTest-980016808 None] Created reservations ['40f5bfc5-bf84-4ba4-8d39-6ce7ec3090d3', 'c56a55b4-5c55-4efd-8e3c-6a1e8a40ac2d', '617ba44d-2773-4014-9a5b-ffc85ea4d371', 'fe1ff615-cfe3-4d3d-bb36-1a5229cf308c'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:20:13 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-928040ee-b55f-48f2-8f87-03f7745a848c tempest-GroupSnapshotsTest-980016808 None] group_snapshot 888c205c-ef64-4579-b890-4077395e30e3: deleted successfully Aug 05 10:20:13 devstack sudo[97160]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:13 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-91c546be-270c-474e-8de2-1988b66c50de tempest-TestInstancesWithCinderVolumes-1602349945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ba3e0006-8d42-4334-a04d-74e5aa13cde8 1G" returned: 0 in 0.396s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:13 devstack cinder-volume[88613]: DEBUG cinder.volume.volume_utils [None req-91c546be-270c-474e-8de2-1988b66c50de tempest-TestInstancesWithCinderVolumes-1602349945 None] Downloaded image 63ccfc8e-ff1c-4f08-a3dc-b5773316f7ce ((None, [{'url': 'file:///opt/stack/data/glance/images/63ccfc8e-ff1c-4f08-a3dc-b5773316f7ce', 'metadata': {}}])) to volume ba3e0006-8d42-4334-a04d-74e5aa13cde8 successfully. {{(pid=88613) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 05 10:20:13 devstack cinder-volume[88613]: DEBUG cinder.image.image_utils [None req-91c546be-270c-474e-8de2-1988b66c50de tempest-TestInstancesWithCinderVolumes-1602349945 None] Temporary image 63ccfc8e-ff1c-4f08-a3dc-b5773316f7ce for user f742f0c2d08a4865899804ee7f4dcdf1 is deleted. {{(pid=88613) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 05 10:20:13 devstack cinder-volume[88613]: DEBUG cinder.volume.volume_utils [None req-91c546be-270c-474e-8de2-1988b66c50de tempest-TestInstancesWithCinderVolumes-1602349945 None] Marking volume ba3e0006-8d42-4334-a04d-74e5aa13cde8 as bootable. {{(pid=88613) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 05 10:20:13 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-91c546be-270c-474e-8de2-1988b66c50de tempest-TestInstancesWithCinderVolumes-1602349945 None] Copying metadata from image 63ccfc8e-ff1c-4f08-a3dc-b5773316f7ce to ba3e0006-8d42-4334-a04d-74e5aa13cde8. {{(pid=88613) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 05 10:20:13 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-91c546be-270c-474e-8de2-1988b66c50de tempest-TestInstancesWithCinderVolumes-1602349945 None] Creating volume glance metadata for volume ba3e0006-8d42-4334-a04d-74e5aa13cde8 backed by image 63ccfc8e-ff1c-4f08-a3dc-b5773316f7ce with: {'image_id': '63ccfc8e-ff1c-4f08-a3dc-b5773316f7ce', 'image_name': 'tempest-scenario-img--673838955', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88613) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 05 10:20:13 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-91c546be-270c-474e-8de2-1988b66c50de tempest-TestInstancesWithCinderVolumes-1602349945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c6f878c-180a-4c9f-94d0-bcd442f8ed29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba3e0006-8d42-4334-a04d-74e5aa13cde8', 'volume_size': 1, 'image_id': '63ccfc8e-ff1c-4f08-a3dc-b5773316f7ce', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/63ccfc8e-ff1c-4f08-a3dc-b5773316f7ce', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--673838955', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c7f3edbcb76d4d5cae5675c123f7c992', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '63ccfc8e-ff1c-4f08-a3dc-b5773316f7ce', 'created_at': datetime.datetime(2026, 8, 5, 8, 19, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 8, 19, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/63ccfc8e-ff1c-4f08-a3dc-b5773316f7ce/file', 'properties': {}}, 'image_service': }' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:20:13 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-91c546be-270c-474e-8de2-1988b66c50de tempest-TestInstancesWithCinderVolumes-1602349945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aedf421-ce26-4430-a2f7-62735dc40230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:20:13 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-91c546be-270c-474e-8de2-1988b66c50de tempest-TestInstancesWithCinderVolumes-1602349945 None] Volume volume-ba3e0006-8d42-4334-a04d-74e5aa13cde8 (ba3e0006-8d42-4334-a04d-74e5aa13cde8): created successfully Aug 05 10:20:13 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-91c546be-270c-474e-8de2-1988b66c50de tempest-TestInstancesWithCinderVolumes-1602349945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aedf421-ce26-4430-a2f7-62735dc40230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:20:13 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-91c546be-270c-474e-8de2-1988b66c50de tempest-TestInstancesWithCinderVolumes-1602349945 None] Flow 'volume_create_manager' (ab806418-f873-4a0e-a0fc-111d5af8d2a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:20:13 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-91c546be-270c-474e-8de2-1988b66c50de tempest-TestInstancesWithCinderVolumes-1602349945 None] Created volume successfully. Aug 05 10:20:15 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-7f064881-73ff-46fa-9a29-d965d4f39010 tempest-GroupSnapshotsTest-980016808 None] Acquiring lock "cinder-quobyte-9d719700-f095-4fbf-bd53-805dfdd8eb48" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:20:15 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-7f064881-73ff-46fa-9a29-d965d4f39010 tempest-GroupSnapshotsTest-980016808 None] Lock "cinder-quobyte-9d719700-f095-4fbf-bd53-805dfdd8eb48" acquired by "delete_volume" :: waited 0.050s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:20:15 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[55fd0ddd-c8e6-4af8-a942-c9f5889a77b8]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:20:15 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7f064881-73ff-46fa-9a29-d965d4f39010 tempest-GroupSnapshotsTest-980016808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9d719700-f095-4fbf-bd53-805dfdd8eb48 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:15 devstack sudo[97180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9d719700-f095-4fbf-bd53-805dfdd8eb48 Aug 05 10:20:15 devstack sudo[97180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:16 devstack sudo[97180]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:16 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7f064881-73ff-46fa-9a29-d965d4f39010 tempest-GroupSnapshotsTest-980016808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9d719700-f095-4fbf-bd53-805dfdd8eb48" returned: 0 in 1.201s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:16 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7f064881-73ff-46fa-9a29-d965d4f39010 tempest-GroupSnapshotsTest-980016808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9d719700-f095-4fbf-bd53-805dfdd8eb48 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:16 devstack sudo[97194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9d719700-f095-4fbf-bd53-805dfdd8eb48 Aug 05 10:20:16 devstack sudo[97194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:17 devstack sudo[97194]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7f064881-73ff-46fa-9a29-d965d4f39010 tempest-GroupSnapshotsTest-980016808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9d719700-f095-4fbf-bd53-805dfdd8eb48" returned: 0 in 0.501s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:17 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-7f064881-73ff-46fa-9a29-d965d4f39010 tempest-GroupSnapshotsTest-980016808 None] Lock "cinder-quobyte-9d719700-f095-4fbf-bd53-805dfdd8eb48" released by "delete_volume" :: held 1.902s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:20:17 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-7f064881-73ff-46fa-9a29-d965d4f39010 tempest-GroupSnapshotsTest-980016808 None] Created reservations ['aa5dcfef-33ad-4c83-9a41-bf7cd91f3d4c'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:20:17 devstack cinder-volume[88613]: WARNING cinder.db.api [None req-7f064881-73ff-46fa-9a29-d965d4f39010 tempest-GroupSnapshotsTest-980016808 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1897168244'] Aug 05 10:20:17 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-7f064881-73ff-46fa-9a29-d965d4f39010 tempest-GroupSnapshotsTest-980016808 None] Created reservations ['1a75e7c5-e2a5-4dd0-916b-b957b3d9f20b', 'fdfb0ede-2fb7-4d5f-9942-616272728451', '31094f0a-1d9c-4569-8f34-89bc81eabc16', '80810a34-6522-47f6-afd6-c31d0edb1ed3'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:20:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-7f064881-73ff-46fa-9a29-d965d4f39010 tempest-GroupSnapshotsTest-980016808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:20:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-7f064881-73ff-46fa-9a29-d965d4f39010 tempest-GroupSnapshotsTest-980016808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:20:17 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-7f064881-73ff-46fa-9a29-d965d4f39010 tempest-GroupSnapshotsTest-980016808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:20:17 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-7f064881-73ff-46fa-9a29-d965d4f39010 tempest-GroupSnapshotsTest-980016808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:20:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-7f064881-73ff-46fa-9a29-d965d4f39010 tempest-GroupSnapshotsTest-980016808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:20:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7f064881-73ff-46fa-9a29-d965d4f39010 tempest-GroupSnapshotsTest-980016808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:17 devstack sudo[97198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:20:17 devstack sudo[97198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:18 devstack sudo[97198]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7f064881-73ff-46fa-9a29-d965d4f39010 tempest-GroupSnapshotsTest-980016808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.712s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:18 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-7f064881-73ff-46fa-9a29-d965d4f39010 tempest-GroupSnapshotsTest-980016808 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:20:18 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-7f064881-73ff-46fa-9a29-d965d4f39010 tempest-GroupSnapshotsTest-980016808 None] Delete group completed successfully. Aug 05 10:20:19 devstack sudo[97159]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a0e2443d-a4fb-4c85-bda7-e475e1253fee tempest-GroupsV314Test-264440590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8133d4d7-e4aa-42f4-85e8-08a97cc7ddb4 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0ff5a4f9-8160-435f-b213-855cf9f9be7b" returned: 0 in 6.346s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:19 devstack cinder-volume[88613]: DEBUG cinder.image.image_utils [None req-a0e2443d-a4fb-4c85-bda7-e475e1253fee tempest-GroupsV314Test-264440590 None] Image conversion details: src /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8133d4d7-e4aa-42f4-85e8-08a97cc7ddb4, size 1024.00 MB, duration 6.35 sec, destination /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0ff5a4f9-8160-435f-b213-855cf9f9be7b {{(pid=88613) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 10:20:19 devstack cinder-volume[88613]: INFO cinder.image.image_utils [None req-a0e2443d-a4fb-4c85-bda7-e475e1253fee tempest-GroupsV314Test-264440590 None] Converted 1024.00 MB image at 161.34 MB/s Aug 05 10:20:19 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-a0e2443d-a4fb-4c85-bda7-e475e1253fee tempest-GroupsV314Test-264440590 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0ff5a4f9-8160-435f-b213-855cf9f9be7b is being set with open permissions: ugo+rw: NotImplementedError Aug 05 10:20:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a0e2443d-a4fb-4c85-bda7-e475e1253fee tempest-GroupsV314Test-264440590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0ff5a4f9-8160-435f-b213-855cf9f9be7b {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:19 devstack sudo[97203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0ff5a4f9-8160-435f-b213-855cf9f9be7b Aug 05 10:20:19 devstack sudo[97203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:19 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-234f5646-c549-46a8-935b-3fd2b76fd72e tempest-GroupSnapshotsTest-980016808 None] Group tempest-GroupSnapshotsTest-Group-958500950: creating Aug 05 10:20:19 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-234f5646-c549-46a8-935b-3fd2b76fd72e tempest-GroupSnapshotsTest-980016808 None] Group tempest-GroupSnapshotsTest-Group-958500950: created successfully Aug 05 10:20:19 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-234f5646-c549-46a8-935b-3fd2b76fd72e tempest-GroupSnapshotsTest-980016808 None] Create group completed successfully. Aug 05 10:20:19 devstack sudo[97203]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a0e2443d-a4fb-4c85-bda7-e475e1253fee tempest-GroupsV314Test-264440590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0ff5a4f9-8160-435f-b213-855cf9f9be7b" returned: 0 in 0.292s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:19 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-a0e2443d-a4fb-4c85-bda7-e475e1253fee tempest-GroupsV314Test-264440590 None] Lock "cinder-quobyte-0ff5a4f9-8160-435f-b213-855cf9f9be7b" released by "_copy_volume_from_snapshot" :: held 7.621s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:20:19 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-a0e2443d-a4fb-4c85-bda7-e475e1253fee tempest-GroupsV314Test-264440590 None] Acquiring lock "cinder-quobyte-e9f6a18e-c068-48f9-80db-f1769f702951" by "_delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:20:19 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-a0e2443d-a4fb-4c85-bda7-e475e1253fee tempest-GroupsV314Test-264440590 None] Lock "cinder-quobyte-e9f6a18e-c068-48f9-80db-f1769f702951" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:20:19 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-a0e2443d-a4fb-4c85-bda7-e475e1253fee tempest-GroupsV314Test-264440590 None] Deleting offline snapshot e9f6a18e-c068-48f9-80db-f1769f702951 of volume 8133d4d7-e4aa-42f4-85e8-08a97cc7ddb4 {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:20:19 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-a0e2443d-a4fb-4c85-bda7-e475e1253fee tempest-GroupsV314Test-264440590 None] snapshot_file for this snap is: volume-8133d4d7-e4aa-42f4-85e8-08a97cc7ddb4.e9f6a18e-c068-48f9-80db-f1769f702951 {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:20:19 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[affc2825-e1fd-4b5d-9e41-d6049898bbfe]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:20:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a0e2443d-a4fb-4c85-bda7-e475e1253fee tempest-GroupsV314Test-264440590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8133d4d7-e4aa-42f4-85e8-08a97cc7ddb4.e9f6a18e-c068-48f9-80db-f1769f702951 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:20 devstack sudo[97206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8133d4d7-e4aa-42f4-85e8-08a97cc7ddb4.e9f6a18e-c068-48f9-80db-f1769f702951 Aug 05 10:20:20 devstack sudo[97206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:20 devstack sudo[97206]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a0e2443d-a4fb-4c85-bda7-e475e1253fee tempest-GroupsV314Test-264440590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8133d4d7-e4aa-42f4-85e8-08a97cc7ddb4.e9f6a18e-c068-48f9-80db-f1769f702951" returned: 0 in 0.437s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:20 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-a0e2443d-a4fb-4c85-bda7-e475e1253fee tempest-GroupsV314Test-264440590 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8133d4d7-e4aa-42f4-85e8-08a97cc7ddb4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88613) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:20:20 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8bbbfb1-1dc3-4156-9bb0-ccc4933d053e]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:20:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a0e2443d-a4fb-4c85-bda7-e475e1253fee tempest-GroupsV314Test-264440590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8133d4d7-e4aa-42f4-85e8-08a97cc7ddb4 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:20 devstack sudo[97218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8133d4d7-e4aa-42f4-85e8-08a97cc7ddb4 Aug 05 10:20:20 devstack sudo[97218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-dd044fa0-35b4-4e79-902c-1b3528b87aea req-31aa2462-7c81-4dfb-beb9-3cee1500f524 tempest-TestInstancesWithCinderVolumes-1602349945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:20:21 devstack sudo[97218]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a0e2443d-a4fb-4c85-bda7-e475e1253fee tempest-GroupsV314Test-264440590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8133d4d7-e4aa-42f4-85e8-08a97cc7ddb4" returned: 0 in 0.843s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a0e2443d-a4fb-4c85-bda7-e475e1253fee tempest-GroupsV314Test-264440590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8133d4d7-e4aa-42f4-85e8-08a97cc7ddb4.e9f6a18e-c068-48f9-80db-f1769f702951 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:21 devstack sudo[97224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8133d4d7-e4aa-42f4-85e8-08a97cc7ddb4.e9f6a18e-c068-48f9-80db-f1769f702951 Aug 05 10:20:21 devstack sudo[97224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:21 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a04f64e-d6c8-40d9-a40f-6f9645969522 tempest-GroupSnapshotsTest-980016808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:20:21 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-7a04f64e-d6c8-40d9-a40f-6f9645969522 tempest-GroupSnapshotsTest-980016808 None] Flow 'volume_create_manager' (cc8aab58-44d6-4d5d-aa42-70d1e2f2331c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:20:21 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-7a04f64e-d6c8-40d9-a40f-6f9645969522 tempest-GroupSnapshotsTest-980016808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1f001d9-1c83-4ac6-8a82-ff7e2cd7dc4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:20:21 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-7a04f64e-d6c8-40d9-a40f-6f9645969522 tempest-GroupSnapshotsTest-980016808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1f001d9-1c83-4ac6-8a82-ff7e2cd7dc4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:20:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-964785275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dc18d10f-599b-442f-b884-7def8b3c7dc2,host='devstack@QuobyteHD#QuobyteHD',id=3fbbaaa5-0ac9-40f6-8a6c-317f4a833ed2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf6ca537cd4147f6a8e5a1bf0fd4de76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:20:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:20:21Z,use_quota=True,user_id='4e1afba1e682464c9783bea1384a3847',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(74c2f04c-54d8-4365-836d-3c40da556c28),volume_type_id=74c2f04c-54d8-4365-836d-3c40da556c28)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:20:21 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-7a04f64e-d6c8-40d9-a40f-6f9645969522 tempest-GroupSnapshotsTest-980016808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c20da27e-6991-483f-9040-3e882e480663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:20:21 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-7a04f64e-d6c8-40d9-a40f-6f9645969522 tempest-GroupSnapshotsTest-980016808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c20da27e-6991-483f-9040-3e882e480663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:20:21 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-7a04f64e-d6c8-40d9-a40f-6f9645969522 tempest-GroupSnapshotsTest-980016808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18fca5c7-a729-44f7-a5c4-554e68152316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:20:21 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-7a04f64e-d6c8-40d9-a40f-6f9645969522 tempest-GroupSnapshotsTest-980016808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18fca5c7-a729-44f7-a5c4-554e68152316) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fbbaaa5-0ac9-40f6-8a6c-317f4a833ed2', 'volume_name': 'volume-3fbbaaa5-0ac9-40f6-8a6c-317f4a833ed2', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:20:21 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-7a04f64e-d6c8-40d9-a40f-6f9645969522 tempest-GroupSnapshotsTest-980016808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1d61539-5fbd-4bd1-871e-37725230c3eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:20:21 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-7a04f64e-d6c8-40d9-a40f-6f9645969522 tempest-GroupSnapshotsTest-980016808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1d61539-5fbd-4bd1-871e-37725230c3eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:20:21 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-7a04f64e-d6c8-40d9-a40f-6f9645969522 tempest-GroupSnapshotsTest-980016808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dde25b2b-a5c4-4acd-abce-2b30f6aa0878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:20:21 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-7a04f64e-d6c8-40d9-a40f-6f9645969522 tempest-GroupSnapshotsTest-980016808 None] Volume 3fbbaaa5-0ac9-40f6-8a6c-317f4a833ed2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fbbaaa5-0ac9-40f6-8a6c-317f4a833ed2', 'volume_size': 1} Aug 05 10:20:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-7a04f64e-d6c8-40d9-a40f-6f9645969522 tempest-GroupSnapshotsTest-980016808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:20:21 devstack cinder-volume[88613]: DEBUG oslo_service.periodic_task [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88613) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:20:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:20:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:20:21 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:20:21 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:20:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:20:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:21 devstack sudo[97235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:20:21 devstack sudo[97235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:21 devstack sudo[97224]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a0e2443d-a4fb-4c85-bda7-e475e1253fee tempest-GroupsV314Test-264440590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8133d4d7-e4aa-42f4-85e8-08a97cc7ddb4.e9f6a18e-c068-48f9-80db-f1769f702951" returned: 0 in 0.709s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a0e2443d-a4fb-4c85-bda7-e475e1253fee tempest-GroupsV314Test-264440590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8133d4d7-e4aa-42f4-85e8-08a97cc7ddb4.e9f6a18e-c068-48f9-80db-f1769f702951 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:21 devstack sudo[97242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8133d4d7-e4aa-42f4-85e8-08a97cc7ddb4.e9f6a18e-c068-48f9-80db-f1769f702951 Aug 05 10:20:21 devstack sudo[97242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:22 devstack sudo[97235]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.500s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:22 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:20:22 devstack cinder-volume[88613]: DEBUG oslo_service.periodic_task [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Running periodic task VolumeManager._thread_info {{(pid=88613) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:20:22 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] thread count: 28 {{(pid=88613) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 10:20:22 devstack sudo[97242]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:22 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] thread info: [<_MainThread(MainThread, started 126173666128000)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88613) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 10:20:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a0e2443d-a4fb-4c85-bda7-e475e1253fee tempest-GroupsV314Test-264440590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8133d4d7-e4aa-42f4-85e8-08a97cc7ddb4.e9f6a18e-c068-48f9-80db-f1769f702951" returned: 0 in 0.371s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:22 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-a0e2443d-a4fb-4c85-bda7-e475e1253fee tempest-GroupsV314Test-264440590 None] Lock "cinder-quobyte-e9f6a18e-c068-48f9-80db-f1769f702951" released by "_delete_snapshot" :: held 2.523s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:20:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a0e2443d-a4fb-4c85-bda7-e475e1253fee tempest-GroupsV314Test-264440590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.827s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:20:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-dd044fa0-35b4-4e79-902c-1b3528b87aea req-31aa2462-7c81-4dfb-beb9-3cee1500f524 tempest-TestInstancesWithCinderVolumes-1602349945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.731s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:20:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-dd044fa0-35b4-4e79-902c-1b3528b87aea req-31aa2462-7c81-4dfb-beb9-3cee1500f524 tempest-TestInstancesWithCinderVolumes-1602349945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:20:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-7a04f64e-d6c8-40d9-a40f-6f9645969522 tempest-GroupSnapshotsTest-980016808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.703s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:20:22 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-7a04f64e-d6c8-40d9-a40f-6f9645969522 tempest-GroupSnapshotsTest-980016808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=dc18d10f-599b-442f-b884-7def8b3c7dc2,created_at=2026-08-05T08:20:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-964785275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dc18d10f-599b-442f-b884-7def8b3c7dc2,host='devstack@QuobyteHD#QuobyteHD',id=3fbbaaa5-0ac9-40f6-8a6c-317f4a833ed2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf6ca537cd4147f6a8e5a1bf0fd4de76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:20:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:20:21Z,use_quota=True,user_id='4e1afba1e682464c9783bea1384a3847',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(74c2f04c-54d8-4365-836d-3c40da556c28),volume_type_id=74c2f04c-54d8-4365-836d-3c40da556c28)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:20:22 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-7a04f64e-d6c8-40d9-a40f-6f9645969522 tempest-GroupSnapshotsTest-980016808 None] Creating volume 3fbbaaa5-0ac9-40f6-8a6c-317f4a833ed2 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:20:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-7a04f64e-d6c8-40d9-a40f-6f9645969522 tempest-GroupSnapshotsTest-980016808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:20:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-7a04f64e-d6c8-40d9-a40f-6f9645969522 tempest-GroupSnapshotsTest-980016808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:20:22 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-7a04f64e-d6c8-40d9-a40f-6f9645969522 tempest-GroupSnapshotsTest-980016808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:20:22 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-7a04f64e-d6c8-40d9-a40f-6f9645969522 tempest-GroupSnapshotsTest-980016808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:20:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-7a04f64e-d6c8-40d9-a40f-6f9645969522 tempest-GroupSnapshotsTest-980016808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:20:22 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-7a04f64e-d6c8-40d9-a40f-6f9645969522 tempest-GroupSnapshotsTest-980016808 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:20:22 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-7a04f64e-d6c8-40d9-a40f-6f9645969522 tempest-GroupSnapshotsTest-980016808 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:20:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7a04f64e-d6c8-40d9-a40f-6f9645969522 tempest-GroupSnapshotsTest-980016808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3fbbaaa5-0ac9-40f6-8a6c-317f4a833ed2 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:22 devstack sudo[97252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3fbbaaa5-0ac9-40f6-8a6c-317f4a833ed2 1073741824 Aug 05 10:20:22 devstack sudo[97252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:22 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [req-dd044fa0-35b4-4e79-902c-1b3528b87aea req-31aa2462-7c81-4dfb-beb9-3cee1500f524 tempest-TestInstancesWithCinderVolumes-1602349945 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1', 'name': 'volume-ba3e0006-8d42-4334-a04d-74e5aa13cde8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f00a2e3d-c805-433d-b67e-c6928c781053', 'enforce_multipath': True} {{(pid=88613) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 10:20:22 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-a0e2443d-a4fb-4c85-bda7-e475e1253fee tempest-GroupsV314Test-264440590 None] Create group from source-group-0aef0657-2dd6-401a-9fc2-b18b70256b45 completed successfully. Aug 05 10:20:22 devstack cinder-volume[88613]: INFO cinder.volume.manager [req-dd044fa0-35b4-4e79-902c-1b3528b87aea req-31aa2462-7c81-4dfb-beb9-3cee1500f524 tempest-TestInstancesWithCinderVolumes-1602349945 None] attachment_update completed successfully. Aug 05 10:20:23 devstack sudo[97252]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7a04f64e-d6c8-40d9-a40f-6f9645969522 tempest-GroupSnapshotsTest-980016808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3fbbaaa5-0ac9-40f6-8a6c-317f4a833ed2 1073741824" returned: 0 in 0.793s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7a04f64e-d6c8-40d9-a40f-6f9645969522 tempest-GroupSnapshotsTest-980016808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3fbbaaa5-0ac9-40f6-8a6c-317f4a833ed2 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:23 devstack sudo[97259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3fbbaaa5-0ac9-40f6-8a6c-317f4a833ed2 Aug 05 10:20:23 devstack sudo[97259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:23 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-317e886d-50a2-48bd-98de-06f9eae9687f tempest-GroupsV314Test-264440590 None] Acquiring lock "cinder-quobyte-0ff5a4f9-8160-435f-b213-855cf9f9be7b" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:20:23 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-317e886d-50a2-48bd-98de-06f9eae9687f tempest-GroupsV314Test-264440590 None] Lock "cinder-quobyte-0ff5a4f9-8160-435f-b213-855cf9f9be7b" acquired by "delete_volume" :: waited 0.038s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:20:23 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[bccedf5d-8d38-4689-8329-86f63b78d7f4]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:20:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-317e886d-50a2-48bd-98de-06f9eae9687f tempest-GroupsV314Test-264440590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0ff5a4f9-8160-435f-b213-855cf9f9be7b {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:23 devstack sudo[97259]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7a04f64e-d6c8-40d9-a40f-6f9645969522 tempest-GroupSnapshotsTest-980016808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3fbbaaa5-0ac9-40f6-8a6c-317f4a833ed2" returned: 0 in 0.402s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:23 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-7a04f64e-d6c8-40d9-a40f-6f9645969522 tempest-GroupSnapshotsTest-980016808 None] <== create_volume: return (1278ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:20:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-7a04f64e-d6c8-40d9-a40f-6f9645969522 tempest-GroupSnapshotsTest-980016808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.282s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:20:23 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-7a04f64e-d6c8-40d9-a40f-6f9645969522 tempest-GroupSnapshotsTest-980016808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dde25b2b-a5c4-4acd-abce-2b30f6aa0878) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fbbaaa5-0ac9-40f6-8a6c-317f4a833ed2', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:20:23 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-7a04f64e-d6c8-40d9-a40f-6f9645969522 tempest-GroupSnapshotsTest-980016808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96699048-f2fc-4938-b8de-d7955d5c1ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:20:23 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-7a04f64e-d6c8-40d9-a40f-6f9645969522 tempest-GroupSnapshotsTest-980016808 None] Volume volume-3fbbaaa5-0ac9-40f6-8a6c-317f4a833ed2 (3fbbaaa5-0ac9-40f6-8a6c-317f4a833ed2): created successfully Aug 05 10:20:23 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-7a04f64e-d6c8-40d9-a40f-6f9645969522 tempest-GroupSnapshotsTest-980016808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96699048-f2fc-4938-b8de-d7955d5c1ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:20:23 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-7a04f64e-d6c8-40d9-a40f-6f9645969522 tempest-GroupSnapshotsTest-980016808 None] Flow 'volume_create_manager' (cc8aab58-44d6-4d5d-aa42-70d1e2f2331c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:20:23 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-7a04f64e-d6c8-40d9-a40f-6f9645969522 tempest-GroupSnapshotsTest-980016808 None] Created volume successfully. Aug 05 10:20:23 devstack sudo[97263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0ff5a4f9-8160-435f-b213-855cf9f9be7b Aug 05 10:20:23 devstack sudo[97263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:24 devstack sudo[97263]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:24 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-317e886d-50a2-48bd-98de-06f9eae9687f tempest-GroupsV314Test-264440590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0ff5a4f9-8160-435f-b213-855cf9f9be7b" returned: 0 in 0.834s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:24 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-317e886d-50a2-48bd-98de-06f9eae9687f tempest-GroupsV314Test-264440590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0ff5a4f9-8160-435f-b213-855cf9f9be7b {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:24 devstack sudo[97678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0ff5a4f9-8160-435f-b213-855cf9f9be7b Aug 05 10:20:24 devstack sudo[97678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:24 devstack sudo[97678]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:24 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-317e886d-50a2-48bd-98de-06f9eae9687f tempest-GroupsV314Test-264440590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0ff5a4f9-8160-435f-b213-855cf9f9be7b" returned: 0 in 0.440s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:24 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-317e886d-50a2-48bd-98de-06f9eae9687f tempest-GroupsV314Test-264440590 None] Lock "cinder-quobyte-0ff5a4f9-8160-435f-b213-855cf9f9be7b" released by "delete_volume" :: held 1.346s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:20:25 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-317e886d-50a2-48bd-98de-06f9eae9687f tempest-GroupsV314Test-264440590 None] Created reservations ['a21a885e-8665-41c5-bcd1-232020ba9969'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:20:25 devstack cinder-volume[88613]: WARNING cinder.quota [None req-317e886d-50a2-48bd-98de-06f9eae9687f tempest-GroupsV314Test-264440590 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-676474029 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-676474029, it is now deprecated. Please use the default quota class for default quota. Aug 05 10:20:25 devstack cinder-volume[88613]: WARNING cinder.quota [None req-317e886d-50a2-48bd-98de-06f9eae9687f tempest-GroupsV314Test-264440590 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-676474029 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-676474029, it is now deprecated. Please use the default quota class for default quota. Aug 05 10:20:25 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-317e886d-50a2-48bd-98de-06f9eae9687f tempest-GroupsV314Test-264440590 None] Created reservations ['41483045-4260-4602-85fc-7e1f72538018', 'ae47ed6a-314b-4061-85ba-a8a826e6d884', 'f5d47974-378a-47e5-bbfc-f57aa34d022c', '0857604f-6887-489b-ac59-8b9655f1dcb9'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:20:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-317e886d-50a2-48bd-98de-06f9eae9687f tempest-GroupsV314Test-264440590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:20:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-317e886d-50a2-48bd-98de-06f9eae9687f tempest-GroupsV314Test-264440590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:20:25 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-317e886d-50a2-48bd-98de-06f9eae9687f tempest-GroupsV314Test-264440590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:20:25 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-317e886d-50a2-48bd-98de-06f9eae9687f tempest-GroupsV314Test-264440590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:20:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-317e886d-50a2-48bd-98de-06f9eae9687f tempest-GroupsV314Test-264440590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:20:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-317e886d-50a2-48bd-98de-06f9eae9687f tempest-GroupsV314Test-264440590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:25 devstack sudo[97708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:20:25 devstack sudo[97708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:25 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-98d46c9c-f1ac-4d72-9088-951267607b81 tempest-GroupSnapshotsTest-980016808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:20:25 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-98d46c9c-f1ac-4d72-9088-951267607b81 tempest-GroupSnapshotsTest-980016808 None] Flow 'volume_create_manager' (e6a8bf0b-4f9a-4fb3-848f-9e056e550c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:20:25 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-98d46c9c-f1ac-4d72-9088-951267607b81 tempest-GroupSnapshotsTest-980016808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e95b848-3e41-4535-a928-c78fc3519846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:20:25 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-98d46c9c-f1ac-4d72-9088-951267607b81 tempest-GroupSnapshotsTest-980016808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e95b848-3e41-4535-a928-c78fc3519846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:20:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-188406683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dc18d10f-599b-442f-b884-7def8b3c7dc2,host='devstack@QuobyteHD#QuobyteHD',id=9dc27c55-b32c-42bb-85e4-3fa4940bc741,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf6ca537cd4147f6a8e5a1bf0fd4de76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:20:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:20:25Z,use_quota=True,user_id='4e1afba1e682464c9783bea1384a3847',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(74c2f04c-54d8-4365-836d-3c40da556c28),volume_type_id=74c2f04c-54d8-4365-836d-3c40da556c28)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:20:25 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-98d46c9c-f1ac-4d72-9088-951267607b81 tempest-GroupSnapshotsTest-980016808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f3d2497-d5bf-4eec-8bfd-fd66c69fe62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:20:25 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-98d46c9c-f1ac-4d72-9088-951267607b81 tempest-GroupSnapshotsTest-980016808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f3d2497-d5bf-4eec-8bfd-fd66c69fe62b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:20:25 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-98d46c9c-f1ac-4d72-9088-951267607b81 tempest-GroupSnapshotsTest-980016808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66602a3d-47de-494b-92cf-5e1f89ea33e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:20:25 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-98d46c9c-f1ac-4d72-9088-951267607b81 tempest-GroupSnapshotsTest-980016808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66602a3d-47de-494b-92cf-5e1f89ea33e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9dc27c55-b32c-42bb-85e4-3fa4940bc741', 'volume_name': 'volume-9dc27c55-b32c-42bb-85e4-3fa4940bc741', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:20:25 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-98d46c9c-f1ac-4d72-9088-951267607b81 tempest-GroupSnapshotsTest-980016808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b53b619f-4e27-41d8-8579-9b05593c9f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:20:25 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-98d46c9c-f1ac-4d72-9088-951267607b81 tempest-GroupSnapshotsTest-980016808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b53b619f-4e27-41d8-8579-9b05593c9f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:20:25 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-98d46c9c-f1ac-4d72-9088-951267607b81 tempest-GroupSnapshotsTest-980016808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04453ee2-4d53-43d1-b1a3-75cf388817d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:20:25 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-98d46c9c-f1ac-4d72-9088-951267607b81 tempest-GroupSnapshotsTest-980016808 None] Volume 9dc27c55-b32c-42bb-85e4-3fa4940bc741: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9dc27c55-b32c-42bb-85e4-3fa4940bc741', 'volume_size': 1} Aug 05 10:20:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-98d46c9c-f1ac-4d72-9088-951267607b81 tempest-GroupSnapshotsTest-980016808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:20:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-98d46c9c-f1ac-4d72-9088-951267607b81 tempest-GroupSnapshotsTest-980016808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:20:25 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-98d46c9c-f1ac-4d72-9088-951267607b81 tempest-GroupSnapshotsTest-980016808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=dc18d10f-599b-442f-b884-7def8b3c7dc2,created_at=2026-08-05T08:20:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-188406683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dc18d10f-599b-442f-b884-7def8b3c7dc2,host='devstack@QuobyteHD#QuobyteHD',id=9dc27c55-b32c-42bb-85e4-3fa4940bc741,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf6ca537cd4147f6a8e5a1bf0fd4de76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:20:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:20:25Z,use_quota=True,user_id='4e1afba1e682464c9783bea1384a3847',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(74c2f04c-54d8-4365-836d-3c40da556c28),volume_type_id=74c2f04c-54d8-4365-836d-3c40da556c28)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:20:25 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-98d46c9c-f1ac-4d72-9088-951267607b81 tempest-GroupSnapshotsTest-980016808 None] Creating volume 9dc27c55-b32c-42bb-85e4-3fa4940bc741 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:20:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-98d46c9c-f1ac-4d72-9088-951267607b81 tempest-GroupSnapshotsTest-980016808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:20:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-98d46c9c-f1ac-4d72-9088-951267607b81 tempest-GroupSnapshotsTest-980016808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:20:25 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-98d46c9c-f1ac-4d72-9088-951267607b81 tempest-GroupSnapshotsTest-980016808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:20:25 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-98d46c9c-f1ac-4d72-9088-951267607b81 tempest-GroupSnapshotsTest-980016808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:20:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-98d46c9c-f1ac-4d72-9088-951267607b81 tempest-GroupSnapshotsTest-980016808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:20:25 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-98d46c9c-f1ac-4d72-9088-951267607b81 tempest-GroupSnapshotsTest-980016808 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:20:25 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-98d46c9c-f1ac-4d72-9088-951267607b81 tempest-GroupSnapshotsTest-980016808 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:20:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-98d46c9c-f1ac-4d72-9088-951267607b81 tempest-GroupSnapshotsTest-980016808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9dc27c55-b32c-42bb-85e4-3fa4940bc741 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:25 devstack sudo[97714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9dc27c55-b32c-42bb-85e4-3fa4940bc741 1073741824 Aug 05 10:20:25 devstack sudo[97714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:25 devstack sudo[97708]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-317e886d-50a2-48bd-98de-06f9eae9687f tempest-GroupsV314Test-264440590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.389s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:25 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-317e886d-50a2-48bd-98de-06f9eae9687f tempest-GroupsV314Test-264440590 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:20:25 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-317e886d-50a2-48bd-98de-06f9eae9687f tempest-GroupsV314Test-264440590 None] Delete group completed successfully. Aug 05 10:20:26 devstack sudo[97714]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:26 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-98d46c9c-f1ac-4d72-9088-951267607b81 tempest-GroupSnapshotsTest-980016808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9dc27c55-b32c-42bb-85e4-3fa4940bc741 1073741824" returned: 0 in 0.814s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:26 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-98d46c9c-f1ac-4d72-9088-951267607b81 tempest-GroupSnapshotsTest-980016808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9dc27c55-b32c-42bb-85e4-3fa4940bc741 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:26 devstack sudo[97753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9dc27c55-b32c-42bb-85e4-3fa4940bc741 Aug 05 10:20:26 devstack sudo[97753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:26 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-c4c8db6a-50c0-4612-b4ee-6a834c0d3e51 tempest-GroupsV314Test-264440590 None] Acquiring lock "cinder-quobyte-8133d4d7-e4aa-42f4-85e8-08a97cc7ddb4" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:20:26 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-c4c8db6a-50c0-4612-b4ee-6a834c0d3e51 tempest-GroupsV314Test-264440590 None] Lock "cinder-quobyte-8133d4d7-e4aa-42f4-85e8-08a97cc7ddb4" acquired by "delete_volume" :: waited 0.061s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:20:27 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ebe8e0c-e61a-4bf1-a64c-062a1620fba7]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:20:27 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c4c8db6a-50c0-4612-b4ee-6a834c0d3e51 tempest-GroupsV314Test-264440590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8133d4d7-e4aa-42f4-85e8-08a97cc7ddb4 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:27 devstack sudo[97753]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:27 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-98d46c9c-f1ac-4d72-9088-951267607b81 tempest-GroupSnapshotsTest-980016808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9dc27c55-b32c-42bb-85e4-3fa4940bc741" returned: 0 in 0.524s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:27 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-98d46c9c-f1ac-4d72-9088-951267607b81 tempest-GroupSnapshotsTest-980016808 None] <== create_volume: return (1441ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:20:27 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-98d46c9c-f1ac-4d72-9088-951267607b81 tempest-GroupSnapshotsTest-980016808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.447s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:20:27 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-98d46c9c-f1ac-4d72-9088-951267607b81 tempest-GroupSnapshotsTest-980016808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04453ee2-4d53-43d1-b1a3-75cf388817d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9dc27c55-b32c-42bb-85e4-3fa4940bc741', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:20:27 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-98d46c9c-f1ac-4d72-9088-951267607b81 tempest-GroupSnapshotsTest-980016808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cefe9468-842d-46b4-b240-a94c8ade0b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:20:27 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-98d46c9c-f1ac-4d72-9088-951267607b81 tempest-GroupSnapshotsTest-980016808 None] Volume volume-9dc27c55-b32c-42bb-85e4-3fa4940bc741 (9dc27c55-b32c-42bb-85e4-3fa4940bc741): created successfully Aug 05 10:20:27 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-98d46c9c-f1ac-4d72-9088-951267607b81 tempest-GroupSnapshotsTest-980016808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cefe9468-842d-46b4-b240-a94c8ade0b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:20:27 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-98d46c9c-f1ac-4d72-9088-951267607b81 tempest-GroupSnapshotsTest-980016808 None] Flow 'volume_create_manager' (e6a8bf0b-4f9a-4fb3-848f-9e056e550c05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:20:27 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-98d46c9c-f1ac-4d72-9088-951267607b81 tempest-GroupSnapshotsTest-980016808 None] Created volume successfully. Aug 05 10:20:27 devstack sudo[97774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8133d4d7-e4aa-42f4-85e8-08a97cc7ddb4 Aug 05 10:20:27 devstack sudo[97774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:27 devstack sudo[97774]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:27 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c4c8db6a-50c0-4612-b4ee-6a834c0d3e51 tempest-GroupsV314Test-264440590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8133d4d7-e4aa-42f4-85e8-08a97cc7ddb4" returned: 0 in 0.671s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:27 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c4c8db6a-50c0-4612-b4ee-6a834c0d3e51 tempest-GroupsV314Test-264440590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8133d4d7-e4aa-42f4-85e8-08a97cc7ddb4 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:27 devstack sudo[97805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8133d4d7-e4aa-42f4-85e8-08a97cc7ddb4 Aug 05 10:20:27 devstack sudo[97805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:28 devstack sudo[97805]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:28 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c4c8db6a-50c0-4612-b4ee-6a834c0d3e51 tempest-GroupsV314Test-264440590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8133d4d7-e4aa-42f4-85e8-08a97cc7ddb4" returned: 0 in 0.400s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:28 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-c4c8db6a-50c0-4612-b4ee-6a834c0d3e51 tempest-GroupsV314Test-264440590 None] Lock "cinder-quobyte-8133d4d7-e4aa-42f4-85e8-08a97cc7ddb4" released by "delete_volume" :: held 1.232s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:20:28 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-c4c8db6a-50c0-4612-b4ee-6a834c0d3e51 tempest-GroupsV314Test-264440590 None] Created reservations ['41d1a811-ee59-4459-8d5d-57c3208e5159'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:20:28 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-c4c8db6a-50c0-4612-b4ee-6a834c0d3e51 tempest-GroupsV314Test-264440590 None] Created reservations ['ba9bcf08-fa83-4971-b553-daf4b60d31ac', 'e1309d96-2120-4079-9356-1bbe84f039c6', 'f265726b-f997-4e90-a526-45ed121f681c', '983291a2-20ba-40fd-904e-0621a91d5db6'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:20:28 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c4c8db6a-50c0-4612-b4ee-6a834c0d3e51 tempest-GroupsV314Test-264440590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:20:28 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c4c8db6a-50c0-4612-b4ee-6a834c0d3e51 tempest-GroupsV314Test-264440590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:20:28 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-c4c8db6a-50c0-4612-b4ee-6a834c0d3e51 tempest-GroupsV314Test-264440590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:20:28 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-c4c8db6a-50c0-4612-b4ee-6a834c0d3e51 tempest-GroupsV314Test-264440590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:20:28 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c4c8db6a-50c0-4612-b4ee-6a834c0d3e51 tempest-GroupsV314Test-264440590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:20:28 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c4c8db6a-50c0-4612-b4ee-6a834c0d3e51 tempest-GroupsV314Test-264440590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:28 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-6de34347-7e36-4ed5-9612-0e91b04ec249 tempest-GroupSnapshotsTest-980016808 None] Update group completed successfully. Aug 05 10:20:28 devstack sudo[97825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:20:28 devstack sudo[97825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:28 devstack sudo[97825]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:28 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c4c8db6a-50c0-4612-b4ee-6a834c0d3e51 tempest-GroupsV314Test-264440590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.373s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:28 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-c4c8db6a-50c0-4612-b4ee-6a834c0d3e51 tempest-GroupsV314Test-264440590 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:20:29 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-c4c8db6a-50c0-4612-b4ee-6a834c0d3e51 tempest-GroupsV314Test-264440590 None] Delete group completed successfully. Aug 05 10:20:30 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-0709bf7d-4128-41e3-b8da-5786fefad817 tempest-GroupSnapshotsTest-980016808 None] Update group completed successfully. Aug 05 10:20:31 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-9117af17-b474-4082-99d2-58f10aa24069 tempest-GroupSnapshotsTest-980016808 None] Update group completed successfully. Aug 05 10:20:32 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-cd333dc6-c957-4999-88b1-dabe2f8dcf9e tempest-GroupSnapshotsTest-980016808 None] Update group completed successfully. Aug 05 10:20:34 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-6baf4fe6-0af3-4dc3-a022-66721848933c tempest-GroupSnapshotsTest-980016808 None] GroupSnapshot eb28d616-4eb6-4e56-8ef2-848720cce0e6: creating. Aug 05 10:20:34 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-6baf4fe6-0af3-4dc3-a022-66721848933c tempest-GroupSnapshotsTest-980016808 None] Group snapshot eb28d616-4eb6-4e56-8ef2-848720cce0e6: creating. {{(pid=88613) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 05 10:20:34 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-6baf4fe6-0af3-4dc3-a022-66721848933c tempest-GroupSnapshotsTest-980016808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:20:34 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-6baf4fe6-0af3-4dc3-a022-66721848933c tempest-GroupSnapshotsTest-980016808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:20:34 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-6baf4fe6-0af3-4dc3-a022-66721848933c tempest-GroupSnapshotsTest-980016808 None] Creating offline snapshot 4f736e6f-08eb-4633-bb49-4be0454c6e3d of volume 9dc27c55-b32c-42bb-85e4-3fa4940bc741 {{(pid=88613) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:20:35 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[42153721-4f53-4fe2-80d2-993dd02e3dce]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:20:35 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6baf4fe6-0af3-4dc3-a022-66721848933c tempest-GroupSnapshotsTest-980016808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9dc27c55-b32c-42bb-85e4-3fa4940bc741 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:35 devstack sudo[97845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9dc27c55-b32c-42bb-85e4-3fa4940bc741 Aug 05 10:20:35 devstack sudo[97845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:35 devstack sudo[97845]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:35 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6baf4fe6-0af3-4dc3-a022-66721848933c tempest-GroupSnapshotsTest-980016808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9dc27c55-b32c-42bb-85e4-3fa4940bc741" returned: 0 in 0.795s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:35 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6baf4fe6-0af3-4dc3-a022-66721848933c tempest-GroupSnapshotsTest-980016808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9dc27c55-b32c-42bb-85e4-3fa4940bc741,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9dc27c55-b32c-42bb-85e4-3fa4940bc741.4f736e6f-08eb-4633-bb49-4be0454c6e3d 1G {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:35 devstack sudo[97852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9dc27c55-b32c-42bb-85e4-3fa4940bc741,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9dc27c55-b32c-42bb-85e4-3fa4940bc741.4f736e6f-08eb-4633-bb49-4be0454c6e3d 1G Aug 05 10:20:35 devstack sudo[97852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:36 devstack sudo[97852]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:36 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6baf4fe6-0af3-4dc3-a022-66721848933c tempest-GroupSnapshotsTest-980016808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9dc27c55-b32c-42bb-85e4-3fa4940bc741,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9dc27c55-b32c-42bb-85e4-3fa4940bc741.4f736e6f-08eb-4633-bb49-4be0454c6e3d 1G" returned: 0 in 0.699s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:36 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6baf4fe6-0af3-4dc3-a022-66721848933c tempest-GroupSnapshotsTest-980016808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9dc27c55-b32c-42bb-85e4-3fa4940bc741 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9dc27c55-b32c-42bb-85e4-3fa4940bc741.4f736e6f-08eb-4633-bb49-4be0454c6e3d {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:36 devstack sudo[97858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9dc27c55-b32c-42bb-85e4-3fa4940bc741 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9dc27c55-b32c-42bb-85e4-3fa4940bc741.4f736e6f-08eb-4633-bb49-4be0454c6e3d Aug 05 10:20:36 devstack sudo[97858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:36 devstack sudo[97858]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:36 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6baf4fe6-0af3-4dc3-a022-66721848933c tempest-GroupSnapshotsTest-980016808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9dc27c55-b32c-42bb-85e4-3fa4940bc741 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9dc27c55-b32c-42bb-85e4-3fa4940bc741.4f736e6f-08eb-4633-bb49-4be0454c6e3d" returned: 0 in 0.426s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:36 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-6baf4fe6-0af3-4dc3-a022-66721848933c tempest-GroupSnapshotsTest-980016808 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9dc27c55-b32c-42bb-85e4-3fa4940bc741.4f736e6f-08eb-4633-bb49-4be0454c6e3d is being set with open permissions: ugo+rw: NotImplementedError Aug 05 10:20:36 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6baf4fe6-0af3-4dc3-a022-66721848933c tempest-GroupSnapshotsTest-980016808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9dc27c55-b32c-42bb-85e4-3fa4940bc741.4f736e6f-08eb-4633-bb49-4be0454c6e3d {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:36 devstack sudo[97864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9dc27c55-b32c-42bb-85e4-3fa4940bc741.4f736e6f-08eb-4633-bb49-4be0454c6e3d Aug 05 10:20:36 devstack sudo[97864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:37 devstack sudo[97864]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6baf4fe6-0af3-4dc3-a022-66721848933c tempest-GroupSnapshotsTest-980016808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9dc27c55-b32c-42bb-85e4-3fa4940bc741.4f736e6f-08eb-4633-bb49-4be0454c6e3d" returned: 0 in 0.378s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6baf4fe6-0af3-4dc3-a022-66721848933c tempest-GroupSnapshotsTest-980016808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9dc27c55-b32c-42bb-85e4-3fa4940bc741.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:37 devstack sudo[97867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9dc27c55-b32c-42bb-85e4-3fa4940bc741.info Aug 05 10:20:37 devstack sudo[97867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:37 devstack sudo[97867]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6baf4fe6-0af3-4dc3-a022-66721848933c tempest-GroupSnapshotsTest-980016808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9dc27c55-b32c-42bb-85e4-3fa4940bc741.info" returned: 0 in 0.443s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:37 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-6baf4fe6-0af3-4dc3-a022-66721848933c tempest-GroupSnapshotsTest-980016808 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9dc27c55-b32c-42bb-85e4-3fa4940bc741.info is being set with open permissions: ugo+rw: NotImplementedError Aug 05 10:20:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6baf4fe6-0af3-4dc3-a022-66721848933c tempest-GroupSnapshotsTest-980016808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9dc27c55-b32c-42bb-85e4-3fa4940bc741.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:37 devstack sudo[97870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9dc27c55-b32c-42bb-85e4-3fa4940bc741.info Aug 05 10:20:37 devstack sudo[97870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:38 devstack sudo[97870]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:38 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6baf4fe6-0af3-4dc3-a022-66721848933c tempest-GroupSnapshotsTest-980016808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9dc27c55-b32c-42bb-85e4-3fa4940bc741.info" returned: 0 in 0.727s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:38 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-6baf4fe6-0af3-4dc3-a022-66721848933c tempest-GroupSnapshotsTest-980016808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.681s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:20:38 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-6baf4fe6-0af3-4dc3-a022-66721848933c tempest-GroupSnapshotsTest-980016808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:20:38 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-6baf4fe6-0af3-4dc3-a022-66721848933c tempest-GroupSnapshotsTest-980016808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:20:38 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-6baf4fe6-0af3-4dc3-a022-66721848933c tempest-GroupSnapshotsTest-980016808 None] Creating offline snapshot e4f355b7-7771-42f1-aaf0-7e6f42b2dfd1 of volume 3fbbaaa5-0ac9-40f6-8a6c-317f4a833ed2 {{(pid=88613) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:20:38 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[21791d84-3907-4f47-b392-24f63768ce95]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:20:38 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6baf4fe6-0af3-4dc3-a022-66721848933c tempest-GroupSnapshotsTest-980016808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3fbbaaa5-0ac9-40f6-8a6c-317f4a833ed2 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:38 devstack sudo[97873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3fbbaaa5-0ac9-40f6-8a6c-317f4a833ed2 Aug 05 10:20:38 devstack sudo[97873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:39 devstack sudo[97873]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:39 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6baf4fe6-0af3-4dc3-a022-66721848933c tempest-GroupSnapshotsTest-980016808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3fbbaaa5-0ac9-40f6-8a6c-317f4a833ed2" returned: 0 in 0.660s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:39 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6baf4fe6-0af3-4dc3-a022-66721848933c tempest-GroupSnapshotsTest-980016808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3fbbaaa5-0ac9-40f6-8a6c-317f4a833ed2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3fbbaaa5-0ac9-40f6-8a6c-317f4a833ed2.e4f355b7-7771-42f1-aaf0-7e6f42b2dfd1 1G {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:39 devstack sudo[97878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3fbbaaa5-0ac9-40f6-8a6c-317f4a833ed2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3fbbaaa5-0ac9-40f6-8a6c-317f4a833ed2.e4f355b7-7771-42f1-aaf0-7e6f42b2dfd1 1G Aug 05 10:20:39 devstack sudo[97878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:40 devstack sudo[97878]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:40 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6baf4fe6-0af3-4dc3-a022-66721848933c tempest-GroupSnapshotsTest-980016808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3fbbaaa5-0ac9-40f6-8a6c-317f4a833ed2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3fbbaaa5-0ac9-40f6-8a6c-317f4a833ed2.e4f355b7-7771-42f1-aaf0-7e6f42b2dfd1 1G" returned: 0 in 0.679s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:40 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6baf4fe6-0af3-4dc3-a022-66721848933c tempest-GroupSnapshotsTest-980016808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fbbaaa5-0ac9-40f6-8a6c-317f4a833ed2 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3fbbaaa5-0ac9-40f6-8a6c-317f4a833ed2.e4f355b7-7771-42f1-aaf0-7e6f42b2dfd1 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:40 devstack sudo[97885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fbbaaa5-0ac9-40f6-8a6c-317f4a833ed2 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3fbbaaa5-0ac9-40f6-8a6c-317f4a833ed2.e4f355b7-7771-42f1-aaf0-7e6f42b2dfd1 Aug 05 10:20:40 devstack sudo[97885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:40 devstack sudo[97885]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:40 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6baf4fe6-0af3-4dc3-a022-66721848933c tempest-GroupSnapshotsTest-980016808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fbbaaa5-0ac9-40f6-8a6c-317f4a833ed2 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3fbbaaa5-0ac9-40f6-8a6c-317f4a833ed2.e4f355b7-7771-42f1-aaf0-7e6f42b2dfd1" returned: 0 in 0.508s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:40 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-6baf4fe6-0af3-4dc3-a022-66721848933c tempest-GroupSnapshotsTest-980016808 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3fbbaaa5-0ac9-40f6-8a6c-317f4a833ed2.e4f355b7-7771-42f1-aaf0-7e6f42b2dfd1 is being set with open permissions: ugo+rw: NotImplementedError Aug 05 10:20:40 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6baf4fe6-0af3-4dc3-a022-66721848933c tempest-GroupSnapshotsTest-980016808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3fbbaaa5-0ac9-40f6-8a6c-317f4a833ed2.e4f355b7-7771-42f1-aaf0-7e6f42b2dfd1 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:40 devstack sudo[97890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3fbbaaa5-0ac9-40f6-8a6c-317f4a833ed2.e4f355b7-7771-42f1-aaf0-7e6f42b2dfd1 Aug 05 10:20:40 devstack sudo[97890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:41 devstack sudo[97890]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:41 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6baf4fe6-0af3-4dc3-a022-66721848933c tempest-GroupSnapshotsTest-980016808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3fbbaaa5-0ac9-40f6-8a6c-317f4a833ed2.e4f355b7-7771-42f1-aaf0-7e6f42b2dfd1" returned: 0 in 0.489s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:41 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6baf4fe6-0af3-4dc3-a022-66721848933c tempest-GroupSnapshotsTest-980016808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3fbbaaa5-0ac9-40f6-8a6c-317f4a833ed2.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:41 devstack sudo[97893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3fbbaaa5-0ac9-40f6-8a6c-317f4a833ed2.info Aug 05 10:20:41 devstack sudo[97893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:41 devstack sudo[97893]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:41 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6baf4fe6-0af3-4dc3-a022-66721848933c tempest-GroupSnapshotsTest-980016808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3fbbaaa5-0ac9-40f6-8a6c-317f4a833ed2.info" returned: 0 in 0.597s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:41 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-6baf4fe6-0af3-4dc3-a022-66721848933c tempest-GroupSnapshotsTest-980016808 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3fbbaaa5-0ac9-40f6-8a6c-317f4a833ed2.info is being set with open permissions: ugo+rw: NotImplementedError Aug 05 10:20:41 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6baf4fe6-0af3-4dc3-a022-66721848933c tempest-GroupSnapshotsTest-980016808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3fbbaaa5-0ac9-40f6-8a6c-317f4a833ed2.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:41 devstack sudo[97896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3fbbaaa5-0ac9-40f6-8a6c-317f4a833ed2.info Aug 05 10:20:41 devstack sudo[97896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:42 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-8f8e8499-d33a-423a-9628-3f2b5040a4cb tempest-GroupsV320Test-946158295 None] Group tempest-GroupsV320Test-Group-1677147704: creating Aug 05 10:20:42 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-8f8e8499-d33a-423a-9628-3f2b5040a4cb tempest-GroupsV320Test-946158295 None] Group tempest-GroupsV320Test-Group-1677147704: created successfully Aug 05 10:20:42 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-8f8e8499-d33a-423a-9628-3f2b5040a4cb tempest-GroupsV320Test-946158295 None] Create group completed successfully. Aug 05 10:20:42 devstack sudo[97896]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:42 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6baf4fe6-0af3-4dc3-a022-66721848933c tempest-GroupSnapshotsTest-980016808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3fbbaaa5-0ac9-40f6-8a6c-317f4a833ed2.info" returned: 0 in 0.680s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:42 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-6baf4fe6-0af3-4dc3-a022-66721848933c tempest-GroupSnapshotsTest-980016808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.799s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:20:42 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-6baf4fe6-0af3-4dc3-a022-66721848933c tempest-GroupSnapshotsTest-980016808 None] group_snapshot eb28d616-4eb6-4e56-8ef2-848720cce0e6: created successfully Aug 05 10:20:43 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-bda867f6-51e1-4974-9a7a-de8dfba38f96 tempest-GroupSnapshotsTest-980016808 None] group_snapshot eb28d616-4eb6-4e56-8ef2-848720cce0e6: deleting Aug 05 10:20:43 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-bda867f6-51e1-4974-9a7a-de8dfba38f96 tempest-GroupSnapshotsTest-980016808 None] group_snapshot eb28d616-4eb6-4e56-8ef2-848720cce0e6: deleting {{(pid=88613) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 05 10:20:43 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-bda867f6-51e1-4974-9a7a-de8dfba38f96 tempest-GroupSnapshotsTest-980016808 None] Acquiring lock "cinder-quobyte-9dc27c55-b32c-42bb-85e4-3fa4940bc741" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:20:43 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-bda867f6-51e1-4974-9a7a-de8dfba38f96 tempest-GroupSnapshotsTest-980016808 None] Lock "cinder-quobyte-9dc27c55-b32c-42bb-85e4-3fa4940bc741" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:20:43 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-bda867f6-51e1-4974-9a7a-de8dfba38f96 tempest-GroupSnapshotsTest-980016808 None] Acquiring lock "cinder-quobyte-4f736e6f-08eb-4633-bb49-4be0454c6e3d" by "_delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:20:43 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-bda867f6-51e1-4974-9a7a-de8dfba38f96 tempest-GroupSnapshotsTest-980016808 None] Lock "cinder-quobyte-4f736e6f-08eb-4633-bb49-4be0454c6e3d" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:20:43 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-bda867f6-51e1-4974-9a7a-de8dfba38f96 tempest-GroupSnapshotsTest-980016808 None] Deleting offline snapshot 4f736e6f-08eb-4633-bb49-4be0454c6e3d of volume 9dc27c55-b32c-42bb-85e4-3fa4940bc741 {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:20:43 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-bda867f6-51e1-4974-9a7a-de8dfba38f96 tempest-GroupSnapshotsTest-980016808 None] snapshot_file for this snap is: volume-9dc27c55-b32c-42bb-85e4-3fa4940bc741.4f736e6f-08eb-4633-bb49-4be0454c6e3d {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:20:43 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8c8c1a-2a1b-40bb-851b-fc517e6881c4]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:20:43 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-bda867f6-51e1-4974-9a7a-de8dfba38f96 tempest-GroupSnapshotsTest-980016808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9dc27c55-b32c-42bb-85e4-3fa4940bc741.4f736e6f-08eb-4633-bb49-4be0454c6e3d {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:44 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-3010994f-6a6c-4aa8-b530-9c5cdca93893 tempest-GroupsV320Test-946158295 None] Created reservations ['fbe5d0d2-1fd3-4b4c-80df-104e7043ed76'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:20:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-3010994f-6a6c-4aa8-b530-9c5cdca93893 tempest-GroupsV320Test-946158295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:20:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-3010994f-6a6c-4aa8-b530-9c5cdca93893 tempest-GroupsV320Test-946158295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:20:44 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-3010994f-6a6c-4aa8-b530-9c5cdca93893 tempest-GroupsV320Test-946158295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:20:44 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-3010994f-6a6c-4aa8-b530-9c5cdca93893 tempest-GroupsV320Test-946158295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:20:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-3010994f-6a6c-4aa8-b530-9c5cdca93893 tempest-GroupsV320Test-946158295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:20:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3010994f-6a6c-4aa8-b530-9c5cdca93893 tempest-GroupsV320Test-946158295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:44 devstack sudo[97924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9dc27c55-b32c-42bb-85e4-3fa4940bc741.4f736e6f-08eb-4633-bb49-4be0454c6e3d Aug 05 10:20:44 devstack sudo[97924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:44 devstack sudo[97928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:20:44 devstack sudo[97928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:44 devstack sudo[97928]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3010994f-6a6c-4aa8-b530-9c5cdca93893 tempest-GroupsV320Test-946158295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.351s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:44 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-3010994f-6a6c-4aa8-b530-9c5cdca93893 tempest-GroupsV320Test-946158295 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:20:44 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-3010994f-6a6c-4aa8-b530-9c5cdca93893 tempest-GroupsV320Test-946158295 None] Delete group completed successfully. Aug 05 10:20:44 devstack sudo[97924]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-bda867f6-51e1-4974-9a7a-de8dfba38f96 tempest-GroupSnapshotsTest-980016808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9dc27c55-b32c-42bb-85e4-3fa4940bc741.4f736e6f-08eb-4633-bb49-4be0454c6e3d" returned: 0 in 0.568s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:44 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-bda867f6-51e1-4974-9a7a-de8dfba38f96 tempest-GroupSnapshotsTest-980016808 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9dc27c55-b32c-42bb-85e4-3fa4940bc741(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88613) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:20:44 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[b70cce3a-5038-4a94-b808-6d3726b79514]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:20:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-bda867f6-51e1-4974-9a7a-de8dfba38f96 tempest-GroupSnapshotsTest-980016808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9dc27c55-b32c-42bb-85e4-3fa4940bc741 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:44 devstack sudo[97935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9dc27c55-b32c-42bb-85e4-3fa4940bc741 Aug 05 10:20:44 devstack sudo[97935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:44 devstack sudo[97935]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-bda867f6-51e1-4974-9a7a-de8dfba38f96 tempest-GroupSnapshotsTest-980016808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9dc27c55-b32c-42bb-85e4-3fa4940bc741" returned: 0 in 0.395s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-bda867f6-51e1-4974-9a7a-de8dfba38f96 tempest-GroupSnapshotsTest-980016808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9dc27c55-b32c-42bb-85e4-3fa4940bc741.4f736e6f-08eb-4633-bb49-4be0454c6e3d {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:44 devstack sudo[97958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9dc27c55-b32c-42bb-85e4-3fa4940bc741.4f736e6f-08eb-4633-bb49-4be0454c6e3d Aug 05 10:20:44 devstack sudo[97958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:45 devstack sudo[97958]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:45 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-bda867f6-51e1-4974-9a7a-de8dfba38f96 tempest-GroupSnapshotsTest-980016808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9dc27c55-b32c-42bb-85e4-3fa4940bc741.4f736e6f-08eb-4633-bb49-4be0454c6e3d" returned: 0 in 0.375s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:45 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-bda867f6-51e1-4974-9a7a-de8dfba38f96 tempest-GroupSnapshotsTest-980016808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9dc27c55-b32c-42bb-85e4-3fa4940bc741.4f736e6f-08eb-4633-bb49-4be0454c6e3d {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:45 devstack sudo[97963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9dc27c55-b32c-42bb-85e4-3fa4940bc741.4f736e6f-08eb-4633-bb49-4be0454c6e3d Aug 05 10:20:45 devstack sudo[97963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:45 devstack sudo[97963]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:45 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-bda867f6-51e1-4974-9a7a-de8dfba38f96 tempest-GroupSnapshotsTest-980016808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9dc27c55-b32c-42bb-85e4-3fa4940bc741.4f736e6f-08eb-4633-bb49-4be0454c6e3d" returned: 0 in 0.263s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:45 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-bda867f6-51e1-4974-9a7a-de8dfba38f96 tempest-GroupSnapshotsTest-980016808 None] Lock "cinder-quobyte-4f736e6f-08eb-4633-bb49-4be0454c6e3d" released by "_delete_snapshot" :: held 1.752s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:20:45 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-bda867f6-51e1-4974-9a7a-de8dfba38f96 tempest-GroupSnapshotsTest-980016808 None] Lock "cinder-quobyte-9dc27c55-b32c-42bb-85e4-3fa4940bc741" released by "delete_snapshot" :: held 1.808s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:20:45 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-bda867f6-51e1-4974-9a7a-de8dfba38f96 tempest-GroupSnapshotsTest-980016808 None] Acquiring lock "cinder-quobyte-3fbbaaa5-0ac9-40f6-8a6c-317f4a833ed2" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:20:45 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-bda867f6-51e1-4974-9a7a-de8dfba38f96 tempest-GroupSnapshotsTest-980016808 None] Lock "cinder-quobyte-3fbbaaa5-0ac9-40f6-8a6c-317f4a833ed2" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:20:45 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-bda867f6-51e1-4974-9a7a-de8dfba38f96 tempest-GroupSnapshotsTest-980016808 None] Acquiring lock "cinder-quobyte-e4f355b7-7771-42f1-aaf0-7e6f42b2dfd1" by "_delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:20:45 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-bda867f6-51e1-4974-9a7a-de8dfba38f96 tempest-GroupSnapshotsTest-980016808 None] Lock "cinder-quobyte-e4f355b7-7771-42f1-aaf0-7e6f42b2dfd1" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:20:45 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-bda867f6-51e1-4974-9a7a-de8dfba38f96 tempest-GroupSnapshotsTest-980016808 None] Deleting offline snapshot e4f355b7-7771-42f1-aaf0-7e6f42b2dfd1 of volume 3fbbaaa5-0ac9-40f6-8a6c-317f4a833ed2 {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:20:45 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-bda867f6-51e1-4974-9a7a-de8dfba38f96 tempest-GroupSnapshotsTest-980016808 None] snapshot_file for this snap is: volume-3fbbaaa5-0ac9-40f6-8a6c-317f4a833ed2.e4f355b7-7771-42f1-aaf0-7e6f42b2dfd1 {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:20:45 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[6069a500-b5dc-43ea-904b-e2986249b952]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:20:45 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-bda867f6-51e1-4974-9a7a-de8dfba38f96 tempest-GroupSnapshotsTest-980016808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3fbbaaa5-0ac9-40f6-8a6c-317f4a833ed2.e4f355b7-7771-42f1-aaf0-7e6f42b2dfd1 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:45 devstack sudo[97966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3fbbaaa5-0ac9-40f6-8a6c-317f4a833ed2.e4f355b7-7771-42f1-aaf0-7e6f42b2dfd1 Aug 05 10:20:45 devstack sudo[97966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:46 devstack sudo[97966]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-bda867f6-51e1-4974-9a7a-de8dfba38f96 tempest-GroupSnapshotsTest-980016808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3fbbaaa5-0ac9-40f6-8a6c-317f4a833ed2.e4f355b7-7771-42f1-aaf0-7e6f42b2dfd1" returned: 0 in 0.386s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:46 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-bda867f6-51e1-4974-9a7a-de8dfba38f96 tempest-GroupSnapshotsTest-980016808 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3fbbaaa5-0ac9-40f6-8a6c-317f4a833ed2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88613) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:20:46 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a899829-1abd-46ce-a42e-b4c7d61442f8]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:20:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-bda867f6-51e1-4974-9a7a-de8dfba38f96 tempest-GroupSnapshotsTest-980016808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3fbbaaa5-0ac9-40f6-8a6c-317f4a833ed2 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:46 devstack sudo[97971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3fbbaaa5-0ac9-40f6-8a6c-317f4a833ed2 Aug 05 10:20:46 devstack sudo[97971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:46 devstack sudo[97971]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-bda867f6-51e1-4974-9a7a-de8dfba38f96 tempest-GroupSnapshotsTest-980016808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3fbbaaa5-0ac9-40f6-8a6c-317f4a833ed2" returned: 0 in 0.464s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-bda867f6-51e1-4974-9a7a-de8dfba38f96 tempest-GroupSnapshotsTest-980016808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3fbbaaa5-0ac9-40f6-8a6c-317f4a833ed2.e4f355b7-7771-42f1-aaf0-7e6f42b2dfd1 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:46 devstack sudo[97976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3fbbaaa5-0ac9-40f6-8a6c-317f4a833ed2.e4f355b7-7771-42f1-aaf0-7e6f42b2dfd1 Aug 05 10:20:46 devstack sudo[97976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:47 devstack sudo[97976]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:47 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-bda867f6-51e1-4974-9a7a-de8dfba38f96 tempest-GroupSnapshotsTest-980016808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3fbbaaa5-0ac9-40f6-8a6c-317f4a833ed2.e4f355b7-7771-42f1-aaf0-7e6f42b2dfd1" returned: 0 in 0.480s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:47 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-bda867f6-51e1-4974-9a7a-de8dfba38f96 tempest-GroupSnapshotsTest-980016808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3fbbaaa5-0ac9-40f6-8a6c-317f4a833ed2.e4f355b7-7771-42f1-aaf0-7e6f42b2dfd1 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:47 devstack sudo[97985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3fbbaaa5-0ac9-40f6-8a6c-317f4a833ed2.e4f355b7-7771-42f1-aaf0-7e6f42b2dfd1 Aug 05 10:20:47 devstack sudo[97985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:47 devstack sudo[97985]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:47 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-bda867f6-51e1-4974-9a7a-de8dfba38f96 tempest-GroupSnapshotsTest-980016808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3fbbaaa5-0ac9-40f6-8a6c-317f4a833ed2.e4f355b7-7771-42f1-aaf0-7e6f42b2dfd1" returned: 0 in 0.297s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:47 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-bda867f6-51e1-4974-9a7a-de8dfba38f96 tempest-GroupSnapshotsTest-980016808 None] Lock "cinder-quobyte-e4f355b7-7771-42f1-aaf0-7e6f42b2dfd1" released by "_delete_snapshot" :: held 1.761s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:20:47 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-bda867f6-51e1-4974-9a7a-de8dfba38f96 tempest-GroupSnapshotsTest-980016808 None] Lock "cinder-quobyte-3fbbaaa5-0ac9-40f6-8a6c-317f4a833ed2" released by "delete_snapshot" :: held 1.803s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:20:47 devstack cinder-volume[88613]: WARNING cinder.quota [None req-bda867f6-51e1-4974-9a7a-de8dfba38f96 tempest-GroupSnapshotsTest-980016808 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-935079038 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-935079038, it is now deprecated. Please use the default quota class for default quota. Aug 05 10:20:47 devstack cinder-volume[88613]: WARNING cinder.quota [None req-bda867f6-51e1-4974-9a7a-de8dfba38f96 tempest-GroupSnapshotsTest-980016808 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-935079038 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-935079038, it is now deprecated. Please use the default quota class for default quota. Aug 05 10:20:47 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-bda867f6-51e1-4974-9a7a-de8dfba38f96 tempest-GroupSnapshotsTest-980016808 None] Created reservations ['4623f1d3-8c56-4146-a71e-08d4702e2050', 'dee2e26f-6f05-4953-905d-f0c954007a7a', 'aa06814c-6cac-41f6-888f-113741bc7e26', '50d0bc41-809a-423c-8f44-95ca67b4679a'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:20:47 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-bda867f6-51e1-4974-9a7a-de8dfba38f96 tempest-GroupSnapshotsTest-980016808 None] Created reservations ['eab39187-c03a-4511-b945-dcfb51de554e', '02b95d67-0ec7-4ca6-90fb-e7c0b6071c8f', '5e90bc8e-2b19-4c58-bd8d-0427a8ebfd45', '82f4cfdf-3422-483f-863e-e52f9f98b7e9'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:20:47 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-bda867f6-51e1-4974-9a7a-de8dfba38f96 tempest-GroupSnapshotsTest-980016808 None] group_snapshot eb28d616-4eb6-4e56-8ef2-848720cce0e6: deleted successfully Aug 05 10:20:49 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-11a92f4e-1bfc-470d-8509-9e65a50c62c1 tempest-GroupSnapshotsTest-980016808 None] Acquiring lock "cinder-quobyte-3fbbaaa5-0ac9-40f6-8a6c-317f4a833ed2" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:20:49 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-11a92f4e-1bfc-470d-8509-9e65a50c62c1 tempest-GroupSnapshotsTest-980016808 None] Lock "cinder-quobyte-3fbbaaa5-0ac9-40f6-8a6c-317f4a833ed2" acquired by "delete_volume" :: waited 0.020s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:20:49 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[512f4554-ba0a-43ae-aea4-9cd43fc7c469]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:20:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-11a92f4e-1bfc-470d-8509-9e65a50c62c1 tempest-GroupSnapshotsTest-980016808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3fbbaaa5-0ac9-40f6-8a6c-317f4a833ed2 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:49 devstack sudo[97997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3fbbaaa5-0ac9-40f6-8a6c-317f4a833ed2 Aug 05 10:20:49 devstack sudo[97997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:49 devstack sudo[97997]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-11a92f4e-1bfc-470d-8509-9e65a50c62c1 tempest-GroupSnapshotsTest-980016808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3fbbaaa5-0ac9-40f6-8a6c-317f4a833ed2" returned: 0 in 0.371s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-11a92f4e-1bfc-470d-8509-9e65a50c62c1 tempest-GroupSnapshotsTest-980016808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3fbbaaa5-0ac9-40f6-8a6c-317f4a833ed2 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:49 devstack sudo[98002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3fbbaaa5-0ac9-40f6-8a6c-317f4a833ed2 Aug 05 10:20:49 devstack sudo[98002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:49 devstack sudo[98002]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-11a92f4e-1bfc-470d-8509-9e65a50c62c1 tempest-GroupSnapshotsTest-980016808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3fbbaaa5-0ac9-40f6-8a6c-317f4a833ed2" returned: 0 in 0.267s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:49 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-11a92f4e-1bfc-470d-8509-9e65a50c62c1 tempest-GroupSnapshotsTest-980016808 None] Lock "cinder-quobyte-3fbbaaa5-0ac9-40f6-8a6c-317f4a833ed2" released by "delete_volume" :: held 0.707s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:20:49 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-11a92f4e-1bfc-470d-8509-9e65a50c62c1 tempest-GroupSnapshotsTest-980016808 None] Acquiring lock "cinder-quobyte-9dc27c55-b32c-42bb-85e4-3fa4940bc741" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:20:49 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-11a92f4e-1bfc-470d-8509-9e65a50c62c1 tempest-GroupSnapshotsTest-980016808 None] Lock "cinder-quobyte-9dc27c55-b32c-42bb-85e4-3fa4940bc741" acquired by "delete_volume" :: waited 0.015s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:20:49 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5aa79a7-382b-4b7e-8b74-ebf37221c65f]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:20:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-11a92f4e-1bfc-470d-8509-9e65a50c62c1 tempest-GroupSnapshotsTest-980016808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9dc27c55-b32c-42bb-85e4-3fa4940bc741 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:49 devstack sudo[98005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9dc27c55-b32c-42bb-85e4-3fa4940bc741 Aug 05 10:20:49 devstack sudo[98005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:50 devstack sudo[98005]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-11a92f4e-1bfc-470d-8509-9e65a50c62c1 tempest-GroupSnapshotsTest-980016808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9dc27c55-b32c-42bb-85e4-3fa4940bc741" returned: 0 in 0.443s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-11a92f4e-1bfc-470d-8509-9e65a50c62c1 tempest-GroupSnapshotsTest-980016808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9dc27c55-b32c-42bb-85e4-3fa4940bc741 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:50 devstack sudo[98025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9dc27c55-b32c-42bb-85e4-3fa4940bc741 Aug 05 10:20:50 devstack sudo[98025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:50 devstack sudo[98025]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-11a92f4e-1bfc-470d-8509-9e65a50c62c1 tempest-GroupSnapshotsTest-980016808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9dc27c55-b32c-42bb-85e4-3fa4940bc741" returned: 0 in 0.364s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:50 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-11a92f4e-1bfc-470d-8509-9e65a50c62c1 tempest-GroupSnapshotsTest-980016808 None] Lock "cinder-quobyte-9dc27c55-b32c-42bb-85e4-3fa4940bc741" released by "delete_volume" :: held 0.877s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:20:50 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-11a92f4e-1bfc-470d-8509-9e65a50c62c1 tempest-GroupSnapshotsTest-980016808 None] Created reservations ['945b6001-6536-41da-a033-21a3ea6ea376'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:20:50 devstack cinder-volume[88613]: WARNING cinder.quota [None req-11a92f4e-1bfc-470d-8509-9e65a50c62c1 tempest-GroupSnapshotsTest-980016808 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-935079038 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-935079038, it is now deprecated. Please use the default quota class for default quota. Aug 05 10:20:50 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-11a92f4e-1bfc-470d-8509-9e65a50c62c1 tempest-GroupSnapshotsTest-980016808 None] Created reservations ['7c0994ce-dfdc-4963-b4f3-b79b1cd6f2b9', 'ceee79db-6ad2-4fde-84a7-30e8f11d61f3', '5e3efb95-f473-4a5c-b990-b11e2273351d', '6d0576bc-6afc-4517-9b0c-d684be38a3fe'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:20:51 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-11a92f4e-1bfc-470d-8509-9e65a50c62c1 tempest-GroupSnapshotsTest-980016808 None] Created reservations ['b81ae160-fcc3-4e0e-b572-cd076190ffd5', '15995d6f-30c5-48c5-b41c-13bdb6aeafe2', '7d12749f-9842-460d-ac6e-03509347c872', 'c0060582-96e6-4c36-9d61-873f4b010089'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:20:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-11a92f4e-1bfc-470d-8509-9e65a50c62c1 tempest-GroupSnapshotsTest-980016808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:20:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-11a92f4e-1bfc-470d-8509-9e65a50c62c1 tempest-GroupSnapshotsTest-980016808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:20:51 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-11a92f4e-1bfc-470d-8509-9e65a50c62c1 tempest-GroupSnapshotsTest-980016808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:20:51 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-11a92f4e-1bfc-470d-8509-9e65a50c62c1 tempest-GroupSnapshotsTest-980016808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:20:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-11a92f4e-1bfc-470d-8509-9e65a50c62c1 tempest-GroupSnapshotsTest-980016808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:20:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-11a92f4e-1bfc-470d-8509-9e65a50c62c1 tempest-GroupSnapshotsTest-980016808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:51 devstack sudo[98050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:20:51 devstack sudo[98050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:51 devstack sudo[98050]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-11a92f4e-1bfc-470d-8509-9e65a50c62c1 tempest-GroupSnapshotsTest-980016808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.311s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:51 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-11a92f4e-1bfc-470d-8509-9e65a50c62c1 tempest-GroupSnapshotsTest-980016808 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:20:51 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-11a92f4e-1bfc-470d-8509-9e65a50c62c1 tempest-GroupSnapshotsTest-980016808 None] Delete group completed successfully. Aug 05 10:20:52 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-b8153f11-75dc-4891-ac5c-7b4b68cfe3d6 tempest-GroupSnapshotsTest-980016808 None] Group tempest-GroupSnapshotsTest-Group-1040760218: creating Aug 05 10:20:52 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-b8153f11-75dc-4891-ac5c-7b4b68cfe3d6 tempest-GroupSnapshotsTest-980016808 None] Group tempest-GroupSnapshotsTest-Group-1040760218: created successfully Aug 05 10:20:52 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-b8153f11-75dc-4891-ac5c-7b4b68cfe3d6 tempest-GroupSnapshotsTest-980016808 None] Create group completed successfully. Aug 05 10:20:53 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-f10ffec4-66f6-41e5-8b36-1d68b95abb60 tempest-GroupSnapshotsTest-980016808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:20:53 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-f10ffec4-66f6-41e5-8b36-1d68b95abb60 tempest-GroupSnapshotsTest-980016808 None] Flow 'volume_create_manager' (b2269b55-296c-492b-ae6d-9c53fc4a77e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:20:53 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-f10ffec4-66f6-41e5-8b36-1d68b95abb60 tempest-GroupSnapshotsTest-980016808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (147c4365-abb5-496f-9faa-64d9bb7135dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:20:53 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-f10ffec4-66f6-41e5-8b36-1d68b95abb60 tempest-GroupSnapshotsTest-980016808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (147c4365-abb5-496f-9faa-64d9bb7135dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:20:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2142170059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c63c3113-c443-49f4-bbb8-8ccfbb3f2b1f,host='devstack@QuobyteHD#QuobyteHD',id=19ead964-2e1d-4f13-adf5-e9c0c45776a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf6ca537cd4147f6a8e5a1bf0fd4de76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:20:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:20:54Z,use_quota=True,user_id='4e1afba1e682464c9783bea1384a3847',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e2e7393-7661-40e2-9b3f-f38c6fda43fa),volume_type_id=9e2e7393-7661-40e2-9b3f-f38c6fda43fa)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:20:53 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-f10ffec4-66f6-41e5-8b36-1d68b95abb60 tempest-GroupSnapshotsTest-980016808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b61e222-0bdc-4217-9351-6f769c1eb808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:20:53 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-f10ffec4-66f6-41e5-8b36-1d68b95abb60 tempest-GroupSnapshotsTest-980016808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b61e222-0bdc-4217-9351-6f769c1eb808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:20:53 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-f10ffec4-66f6-41e5-8b36-1d68b95abb60 tempest-GroupSnapshotsTest-980016808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (088b0b4f-71e0-4b71-9266-47f3446c6edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:20:53 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-f10ffec4-66f6-41e5-8b36-1d68b95abb60 tempest-GroupSnapshotsTest-980016808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (088b0b4f-71e0-4b71-9266-47f3446c6edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19ead964-2e1d-4f13-adf5-e9c0c45776a3', 'volume_name': 'volume-19ead964-2e1d-4f13-adf5-e9c0c45776a3', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:20:53 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-f10ffec4-66f6-41e5-8b36-1d68b95abb60 tempest-GroupSnapshotsTest-980016808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b82aa8c-8812-4f85-860d-fb06bb2957ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:20:53 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-f10ffec4-66f6-41e5-8b36-1d68b95abb60 tempest-GroupSnapshotsTest-980016808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b82aa8c-8812-4f85-860d-fb06bb2957ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:20:53 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-f10ffec4-66f6-41e5-8b36-1d68b95abb60 tempest-GroupSnapshotsTest-980016808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (551b796e-8b08-4332-8b78-cea01ee76d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:20:53 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-f10ffec4-66f6-41e5-8b36-1d68b95abb60 tempest-GroupSnapshotsTest-980016808 None] Volume 19ead964-2e1d-4f13-adf5-e9c0c45776a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19ead964-2e1d-4f13-adf5-e9c0c45776a3', 'volume_size': 1} Aug 05 10:20:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-f10ffec4-66f6-41e5-8b36-1d68b95abb60 tempest-GroupSnapshotsTest-980016808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:20:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-f10ffec4-66f6-41e5-8b36-1d68b95abb60 tempest-GroupSnapshotsTest-980016808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:20:53 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-f10ffec4-66f6-41e5-8b36-1d68b95abb60 tempest-GroupSnapshotsTest-980016808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c63c3113-c443-49f4-bbb8-8ccfbb3f2b1f,created_at=2026-08-05T08:20:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2142170059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c63c3113-c443-49f4-bbb8-8ccfbb3f2b1f,host='devstack@QuobyteHD#QuobyteHD',id=19ead964-2e1d-4f13-adf5-e9c0c45776a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf6ca537cd4147f6a8e5a1bf0fd4de76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:20:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:20:54Z,use_quota=True,user_id='4e1afba1e682464c9783bea1384a3847',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e2e7393-7661-40e2-9b3f-f38c6fda43fa),volume_type_id=9e2e7393-7661-40e2-9b3f-f38c6fda43fa)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:20:53 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-f10ffec4-66f6-41e5-8b36-1d68b95abb60 tempest-GroupSnapshotsTest-980016808 None] Creating volume 19ead964-2e1d-4f13-adf5-e9c0c45776a3 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:20:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-f10ffec4-66f6-41e5-8b36-1d68b95abb60 tempest-GroupSnapshotsTest-980016808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:20:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-f10ffec4-66f6-41e5-8b36-1d68b95abb60 tempest-GroupSnapshotsTest-980016808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:20:53 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-f10ffec4-66f6-41e5-8b36-1d68b95abb60 tempest-GroupSnapshotsTest-980016808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:20:53 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-f10ffec4-66f6-41e5-8b36-1d68b95abb60 tempest-GroupSnapshotsTest-980016808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:20:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-f10ffec4-66f6-41e5-8b36-1d68b95abb60 tempest-GroupSnapshotsTest-980016808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:20:53 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-f10ffec4-66f6-41e5-8b36-1d68b95abb60 tempest-GroupSnapshotsTest-980016808 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:20:53 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-f10ffec4-66f6-41e5-8b36-1d68b95abb60 tempest-GroupSnapshotsTest-980016808 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:20:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f10ffec4-66f6-41e5-8b36-1d68b95abb60 tempest-GroupSnapshotsTest-980016808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-19ead964-2e1d-4f13-adf5-e9c0c45776a3 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:53 devstack sudo[98053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-19ead964-2e1d-4f13-adf5-e9c0c45776a3 1073741824 Aug 05 10:20:53 devstack sudo[98053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:54 devstack sudo[98053]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f10ffec4-66f6-41e5-8b36-1d68b95abb60 tempest-GroupSnapshotsTest-980016808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-19ead964-2e1d-4f13-adf5-e9c0c45776a3 1073741824" returned: 0 in 0.456s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:54 devstack cinder-volume[88613]: DEBUG dbcounter [-] [88613] Writing DB stats cinder:SELECT=145,cinder:UPDATE=123,cinder:INSERT=30,cinder:DELETE=3 {{(pid=88613) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:20:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f10ffec4-66f6-41e5-8b36-1d68b95abb60 tempest-GroupSnapshotsTest-980016808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-19ead964-2e1d-4f13-adf5-e9c0c45776a3 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:54 devstack sudo[98060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-19ead964-2e1d-4f13-adf5-e9c0c45776a3 Aug 05 10:20:54 devstack sudo[98060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:54 devstack sudo[98060]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f10ffec4-66f6-41e5-8b36-1d68b95abb60 tempest-GroupSnapshotsTest-980016808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-19ead964-2e1d-4f13-adf5-e9c0c45776a3" returned: 0 in 0.274s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:54 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-f10ffec4-66f6-41e5-8b36-1d68b95abb60 tempest-GroupSnapshotsTest-980016808 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:20:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-f10ffec4-66f6-41e5-8b36-1d68b95abb60 tempest-GroupSnapshotsTest-980016808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:20:54 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-f10ffec4-66f6-41e5-8b36-1d68b95abb60 tempest-GroupSnapshotsTest-980016808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (551b796e-8b08-4332-8b78-cea01ee76d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19ead964-2e1d-4f13-adf5-e9c0c45776a3', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:20:54 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-f10ffec4-66f6-41e5-8b36-1d68b95abb60 tempest-GroupSnapshotsTest-980016808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8cc6b47-f02a-4361-96bd-2fabbfcd18b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:20:54 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-f10ffec4-66f6-41e5-8b36-1d68b95abb60 tempest-GroupSnapshotsTest-980016808 None] Volume volume-19ead964-2e1d-4f13-adf5-e9c0c45776a3 (19ead964-2e1d-4f13-adf5-e9c0c45776a3): created successfully Aug 05 10:20:54 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-f10ffec4-66f6-41e5-8b36-1d68b95abb60 tempest-GroupSnapshotsTest-980016808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8cc6b47-f02a-4361-96bd-2fabbfcd18b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:20:54 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-f10ffec4-66f6-41e5-8b36-1d68b95abb60 tempest-GroupSnapshotsTest-980016808 None] Flow 'volume_create_manager' (b2269b55-296c-492b-ae6d-9c53fc4a77e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:20:54 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-f10ffec4-66f6-41e5-8b36-1d68b95abb60 tempest-GroupSnapshotsTest-980016808 None] Created volume successfully. Aug 05 10:20:55 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-5c3d6d97-9276-428b-b86c-1ede74759a5a tempest-GroupSnapshotsTest-980016808 None] GroupSnapshot a2fc7148-c81b-41da-8e71-1af648f807d0: creating. Aug 05 10:20:55 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5c3d6d97-9276-428b-b86c-1ede74759a5a tempest-GroupSnapshotsTest-980016808 None] Group snapshot a2fc7148-c81b-41da-8e71-1af648f807d0: creating. {{(pid=88613) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 05 10:20:55 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5c3d6d97-9276-428b-b86c-1ede74759a5a tempest-GroupSnapshotsTest-980016808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:20:55 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5c3d6d97-9276-428b-b86c-1ede74759a5a tempest-GroupSnapshotsTest-980016808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:20:55 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-5c3d6d97-9276-428b-b86c-1ede74759a5a tempest-GroupSnapshotsTest-980016808 None] Creating offline snapshot f89a6602-dc0a-4000-9a4a-edd51e9f9b57 of volume 19ead964-2e1d-4f13-adf5-e9c0c45776a3 {{(pid=88613) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:20:55 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[b218c8a1-09de-4248-83a5-fdd9a615ef74]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:20:55 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5c3d6d97-9276-428b-b86c-1ede74759a5a tempest-GroupSnapshotsTest-980016808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-19ead964-2e1d-4f13-adf5-e9c0c45776a3 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:55 devstack sudo[98065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-19ead964-2e1d-4f13-adf5-e9c0c45776a3 Aug 05 10:20:55 devstack sudo[98065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:55 devstack sudo[98065]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:55 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5c3d6d97-9276-428b-b86c-1ede74759a5a tempest-GroupSnapshotsTest-980016808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-19ead964-2e1d-4f13-adf5-e9c0c45776a3" returned: 0 in 0.564s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:55 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5c3d6d97-9276-428b-b86c-1ede74759a5a tempest-GroupSnapshotsTest-980016808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-19ead964-2e1d-4f13-adf5-e9c0c45776a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-19ead964-2e1d-4f13-adf5-e9c0c45776a3.f89a6602-dc0a-4000-9a4a-edd51e9f9b57 1G {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:55 devstack sudo[98070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-19ead964-2e1d-4f13-adf5-e9c0c45776a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-19ead964-2e1d-4f13-adf5-e9c0c45776a3.f89a6602-dc0a-4000-9a4a-edd51e9f9b57 1G Aug 05 10:20:55 devstack sudo[98070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:56 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-af9c5f1e-8bf1-486d-8ad0-692c98f45c66 tempest-AttachVolumeShelveTestJSON-1141396775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:20:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-af9c5f1e-8bf1-486d-8ad0-692c98f45c66 tempest-AttachVolumeShelveTestJSON-1141396775 None] Flow 'volume_create_manager' (23cd163f-536e-4260-97b0-09628f01a9a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:20:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-af9c5f1e-8bf1-486d-8ad0-692c98f45c66 tempest-AttachVolumeShelveTestJSON-1141396775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (101c06cd-3fa8-4f32-97cf-0cb1607743f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:20:56 devstack cinder-volume[88613]: DEBUG dbcounter [-] [88613] Writing DB stats cinder:UPDATE=128,cinder:SELECT=127,cinder:INSERT=34,cinder:DELETE=4 {{(pid=88613) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:20:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-af9c5f1e-8bf1-486d-8ad0-692c98f45c66 tempest-AttachVolumeShelveTestJSON-1141396775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (101c06cd-3fa8-4f32-97cf-0cb1607743f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:20:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1543164819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb0d1c47-7f21-41f9-bdcc-592888fbbf36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4159c7fc49ef43939d24c515caab8fdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:20:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:20:56Z,use_quota=True,user_id='9254f16e8f12425995ac7cf5888d367b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:20:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-af9c5f1e-8bf1-486d-8ad0-692c98f45c66 tempest-AttachVolumeShelveTestJSON-1141396775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dd81c69-c276-45f9-8132-e073f3720a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:20:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-af9c5f1e-8bf1-486d-8ad0-692c98f45c66 tempest-AttachVolumeShelveTestJSON-1141396775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dd81c69-c276-45f9-8132-e073f3720a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:20:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-af9c5f1e-8bf1-486d-8ad0-692c98f45c66 tempest-AttachVolumeShelveTestJSON-1141396775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7558b38a-0833-4223-9ab0-262eac6ef17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:20:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-af9c5f1e-8bf1-486d-8ad0-692c98f45c66 tempest-AttachVolumeShelveTestJSON-1141396775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7558b38a-0833-4223-9ab0-262eac6ef17b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb0d1c47-7f21-41f9-bdcc-592888fbbf36', 'volume_name': 'volume-fb0d1c47-7f21-41f9-bdcc-592888fbbf36', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:20:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-af9c5f1e-8bf1-486d-8ad0-692c98f45c66 tempest-AttachVolumeShelveTestJSON-1141396775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae1f6c2e-33de-479d-b900-b38e2158c852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:20:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-af9c5f1e-8bf1-486d-8ad0-692c98f45c66 tempest-AttachVolumeShelveTestJSON-1141396775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae1f6c2e-33de-479d-b900-b38e2158c852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:20:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-af9c5f1e-8bf1-486d-8ad0-692c98f45c66 tempest-AttachVolumeShelveTestJSON-1141396775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cdd9b49-eeb6-4d57-a6ca-b8e16b6df5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:20:56 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-af9c5f1e-8bf1-486d-8ad0-692c98f45c66 tempest-AttachVolumeShelveTestJSON-1141396775 None] Volume fb0d1c47-7f21-41f9-bdcc-592888fbbf36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb0d1c47-7f21-41f9-bdcc-592888fbbf36', 'volume_size': 1} Aug 05 10:20:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-af9c5f1e-8bf1-486d-8ad0-692c98f45c66 tempest-AttachVolumeShelveTestJSON-1141396775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:20:56 devstack sudo[98070]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5c3d6d97-9276-428b-b86c-1ede74759a5a tempest-GroupSnapshotsTest-980016808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-19ead964-2e1d-4f13-adf5-e9c0c45776a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-19ead964-2e1d-4f13-adf5-e9c0c45776a3.f89a6602-dc0a-4000-9a4a-edd51e9f9b57 1G" returned: 0 in 0.526s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5c3d6d97-9276-428b-b86c-1ede74759a5a tempest-GroupSnapshotsTest-980016808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19ead964-2e1d-4f13-adf5-e9c0c45776a3 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-19ead964-2e1d-4f13-adf5-e9c0c45776a3.f89a6602-dc0a-4000-9a4a-edd51e9f9b57 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:56 devstack sudo[98075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19ead964-2e1d-4f13-adf5-e9c0c45776a3 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-19ead964-2e1d-4f13-adf5-e9c0c45776a3.f89a6602-dc0a-4000-9a4a-edd51e9f9b57 Aug 05 10:20:56 devstack sudo[98075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:56 devstack sudo[98075]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5c3d6d97-9276-428b-b86c-1ede74759a5a tempest-GroupSnapshotsTest-980016808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19ead964-2e1d-4f13-adf5-e9c0c45776a3 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-19ead964-2e1d-4f13-adf5-e9c0c45776a3.f89a6602-dc0a-4000-9a4a-edd51e9f9b57" returned: 0 in 0.337s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:56 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-5c3d6d97-9276-428b-b86c-1ede74759a5a tempest-GroupSnapshotsTest-980016808 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-19ead964-2e1d-4f13-adf5-e9c0c45776a3.f89a6602-dc0a-4000-9a4a-edd51e9f9b57 is being set with open permissions: ugo+rw: NotImplementedError Aug 05 10:20:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5c3d6d97-9276-428b-b86c-1ede74759a5a tempest-GroupSnapshotsTest-980016808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-19ead964-2e1d-4f13-adf5-e9c0c45776a3.f89a6602-dc0a-4000-9a4a-edd51e9f9b57 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:56 devstack sudo[98091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-19ead964-2e1d-4f13-adf5-e9c0c45776a3.f89a6602-dc0a-4000-9a4a-edd51e9f9b57 Aug 05 10:20:56 devstack sudo[98091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:57 devstack sudo[98091]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5c3d6d97-9276-428b-b86c-1ede74759a5a tempest-GroupSnapshotsTest-980016808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-19ead964-2e1d-4f13-adf5-e9c0c45776a3.f89a6602-dc0a-4000-9a4a-edd51e9f9b57" returned: 0 in 0.309s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5c3d6d97-9276-428b-b86c-1ede74759a5a tempest-GroupSnapshotsTest-980016808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-19ead964-2e1d-4f13-adf5-e9c0c45776a3.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:57 devstack sudo[98094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-19ead964-2e1d-4f13-adf5-e9c0c45776a3.info Aug 05 10:20:57 devstack sudo[98094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:57 devstack sudo[98094]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5c3d6d97-9276-428b-b86c-1ede74759a5a tempest-GroupSnapshotsTest-980016808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-19ead964-2e1d-4f13-adf5-e9c0c45776a3.info" returned: 0 in 0.283s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:57 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-5c3d6d97-9276-428b-b86c-1ede74759a5a tempest-GroupSnapshotsTest-980016808 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-19ead964-2e1d-4f13-adf5-e9c0c45776a3.info is being set with open permissions: ugo+rw: NotImplementedError Aug 05 10:20:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5c3d6d97-9276-428b-b86c-1ede74759a5a tempest-GroupSnapshotsTest-980016808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-19ead964-2e1d-4f13-adf5-e9c0c45776a3.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:57 devstack sudo[98097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-19ead964-2e1d-4f13-adf5-e9c0c45776a3.info Aug 05 10:20:57 devstack sudo[98097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:57 devstack sudo[98097]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5c3d6d97-9276-428b-b86c-1ede74759a5a tempest-GroupSnapshotsTest-980016808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-19ead964-2e1d-4f13-adf5-e9c0c45776a3.info" returned: 0 in 0.287s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5c3d6d97-9276-428b-b86c-1ede74759a5a tempest-GroupSnapshotsTest-980016808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.446s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:20:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-af9c5f1e-8bf1-486d-8ad0-692c98f45c66 tempest-AttachVolumeShelveTestJSON-1141396775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.571s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:20:57 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-af9c5f1e-8bf1-486d-8ad0-692c98f45c66 tempest-AttachVolumeShelveTestJSON-1141396775 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:20:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1543164819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb0d1c47-7f21-41f9-bdcc-592888fbbf36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4159c7fc49ef43939d24c515caab8fdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:20:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:20:56Z,use_quota=True,user_id='9254f16e8f12425995ac7cf5888d367b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:20:57 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-af9c5f1e-8bf1-486d-8ad0-692c98f45c66 tempest-AttachVolumeShelveTestJSON-1141396775 None] Creating volume fb0d1c47-7f21-41f9-bdcc-592888fbbf36 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:20:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-af9c5f1e-8bf1-486d-8ad0-692c98f45c66 tempest-AttachVolumeShelveTestJSON-1141396775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:20:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-af9c5f1e-8bf1-486d-8ad0-692c98f45c66 tempest-AttachVolumeShelveTestJSON-1141396775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:20:57 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-af9c5f1e-8bf1-486d-8ad0-692c98f45c66 tempest-AttachVolumeShelveTestJSON-1141396775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:20:57 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-af9c5f1e-8bf1-486d-8ad0-692c98f45c66 tempest-AttachVolumeShelveTestJSON-1141396775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:20:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-af9c5f1e-8bf1-486d-8ad0-692c98f45c66 tempest-AttachVolumeShelveTestJSON-1141396775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:20:57 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-af9c5f1e-8bf1-486d-8ad0-692c98f45c66 tempest-AttachVolumeShelveTestJSON-1141396775 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:20:57 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-af9c5f1e-8bf1-486d-8ad0-692c98f45c66 tempest-AttachVolumeShelveTestJSON-1141396775 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:20:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-af9c5f1e-8bf1-486d-8ad0-692c98f45c66 tempest-AttachVolumeShelveTestJSON-1141396775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-fb0d1c47-7f21-41f9-bdcc-592888fbbf36 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:57 devstack sudo[98100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-fb0d1c47-7f21-41f9-bdcc-592888fbbf36 1073741824 Aug 05 10:20:57 devstack sudo[98100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:57 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-5c3d6d97-9276-428b-b86c-1ede74759a5a tempest-GroupSnapshotsTest-980016808 None] group_snapshot a2fc7148-c81b-41da-8e71-1af648f807d0: created successfully Aug 05 10:20:58 devstack sudo[98100]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-af9c5f1e-8bf1-486d-8ad0-692c98f45c66 tempest-AttachVolumeShelveTestJSON-1141396775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-fb0d1c47-7f21-41f9-bdcc-592888fbbf36 1073741824" returned: 0 in 0.474s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-af9c5f1e-8bf1-486d-8ad0-692c98f45c66 tempest-AttachVolumeShelveTestJSON-1141396775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-fb0d1c47-7f21-41f9-bdcc-592888fbbf36 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:58 devstack sudo[98106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-fb0d1c47-7f21-41f9-bdcc-592888fbbf36 Aug 05 10:20:58 devstack sudo[98106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:58 devstack sudo[98106]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-af9c5f1e-8bf1-486d-8ad0-692c98f45c66 tempest-AttachVolumeShelveTestJSON-1141396775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-fb0d1c47-7f21-41f9-bdcc-592888fbbf36" returned: 0 in 0.254s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:58 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-af9c5f1e-8bf1-486d-8ad0-692c98f45c66 tempest-AttachVolumeShelveTestJSON-1141396775 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:20:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-af9c5f1e-8bf1-486d-8ad0-692c98f45c66 tempest-AttachVolumeShelveTestJSON-1141396775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:20:58 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-af9c5f1e-8bf1-486d-8ad0-692c98f45c66 tempest-AttachVolumeShelveTestJSON-1141396775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cdd9b49-eeb6-4d57-a6ca-b8e16b6df5cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb0d1c47-7f21-41f9-bdcc-592888fbbf36', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:20:58 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-af9c5f1e-8bf1-486d-8ad0-692c98f45c66 tempest-AttachVolumeShelveTestJSON-1141396775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cb2c589-f30c-491e-bae6-34c75ad27035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:20:58 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-af9c5f1e-8bf1-486d-8ad0-692c98f45c66 tempest-AttachVolumeShelveTestJSON-1141396775 None] Volume volume-fb0d1c47-7f21-41f9-bdcc-592888fbbf36 (fb0d1c47-7f21-41f9-bdcc-592888fbbf36): created successfully Aug 05 10:20:58 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-af9c5f1e-8bf1-486d-8ad0-692c98f45c66 tempest-AttachVolumeShelveTestJSON-1141396775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cb2c589-f30c-491e-bae6-34c75ad27035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:20:58 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-af9c5f1e-8bf1-486d-8ad0-692c98f45c66 tempest-AttachVolumeShelveTestJSON-1141396775 None] Flow 'volume_create_manager' (23cd163f-536e-4260-97b0-09628f01a9a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:20:58 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-af9c5f1e-8bf1-486d-8ad0-692c98f45c66 tempest-AttachVolumeShelveTestJSON-1141396775 None] Created volume successfully. Aug 05 10:20:58 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-9d27cc4b-08fb-4c6b-886d-5ef6f1fd7612 tempest-GroupSnapshotsTest-980016808 None] group_snapshot a2fc7148-c81b-41da-8e71-1af648f807d0: deleting Aug 05 10:20:58 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9d27cc4b-08fb-4c6b-886d-5ef6f1fd7612 tempest-GroupSnapshotsTest-980016808 None] group_snapshot a2fc7148-c81b-41da-8e71-1af648f807d0: deleting {{(pid=88613) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 05 10:20:58 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-9d27cc4b-08fb-4c6b-886d-5ef6f1fd7612 tempest-GroupSnapshotsTest-980016808 None] Acquiring lock "cinder-quobyte-19ead964-2e1d-4f13-adf5-e9c0c45776a3" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:20:58 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-9d27cc4b-08fb-4c6b-886d-5ef6f1fd7612 tempest-GroupSnapshotsTest-980016808 None] Lock "cinder-quobyte-19ead964-2e1d-4f13-adf5-e9c0c45776a3" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:20:58 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-9d27cc4b-08fb-4c6b-886d-5ef6f1fd7612 tempest-GroupSnapshotsTest-980016808 None] Acquiring lock "cinder-quobyte-f89a6602-dc0a-4000-9a4a-edd51e9f9b57" by "_delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:20:58 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-9d27cc4b-08fb-4c6b-886d-5ef6f1fd7612 tempest-GroupSnapshotsTest-980016808 None] Lock "cinder-quobyte-f89a6602-dc0a-4000-9a4a-edd51e9f9b57" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:20:58 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-9d27cc4b-08fb-4c6b-886d-5ef6f1fd7612 tempest-GroupSnapshotsTest-980016808 None] Deleting offline snapshot f89a6602-dc0a-4000-9a4a-edd51e9f9b57 of volume 19ead964-2e1d-4f13-adf5-e9c0c45776a3 {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:20:58 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-9d27cc4b-08fb-4c6b-886d-5ef6f1fd7612 tempest-GroupSnapshotsTest-980016808 None] snapshot_file for this snap is: volume-19ead964-2e1d-4f13-adf5-e9c0c45776a3.f89a6602-dc0a-4000-9a4a-edd51e9f9b57 {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:20:58 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c0fcdcd-847e-4622-a223-9ba241eb35d8]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:20:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9d27cc4b-08fb-4c6b-886d-5ef6f1fd7612 tempest-GroupSnapshotsTest-980016808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-19ead964-2e1d-4f13-adf5-e9c0c45776a3.f89a6602-dc0a-4000-9a4a-edd51e9f9b57 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:58 devstack sudo[98109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-19ead964-2e1d-4f13-adf5-e9c0c45776a3.f89a6602-dc0a-4000-9a4a-edd51e9f9b57 Aug 05 10:20:58 devstack sudo[98109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:59 devstack sudo[98109]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9d27cc4b-08fb-4c6b-886d-5ef6f1fd7612 tempest-GroupSnapshotsTest-980016808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-19ead964-2e1d-4f13-adf5-e9c0c45776a3.f89a6602-dc0a-4000-9a4a-edd51e9f9b57" returned: 0 in 0.408s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:59 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-9d27cc4b-08fb-4c6b-886d-5ef6f1fd7612 tempest-GroupSnapshotsTest-980016808 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19ead964-2e1d-4f13-adf5-e9c0c45776a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88613) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:20:59 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc561c89-3785-415d-aa4d-5d06d89afa68]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:20:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9d27cc4b-08fb-4c6b-886d-5ef6f1fd7612 tempest-GroupSnapshotsTest-980016808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-19ead964-2e1d-4f13-adf5-e9c0c45776a3 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:59 devstack sudo[98116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-19ead964-2e1d-4f13-adf5-e9c0c45776a3 Aug 05 10:20:59 devstack sudo[98116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:59 devstack sudo[98116]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9d27cc4b-08fb-4c6b-886d-5ef6f1fd7612 tempest-GroupSnapshotsTest-980016808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-19ead964-2e1d-4f13-adf5-e9c0c45776a3" returned: 0 in 0.384s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9d27cc4b-08fb-4c6b-886d-5ef6f1fd7612 tempest-GroupSnapshotsTest-980016808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-19ead964-2e1d-4f13-adf5-e9c0c45776a3.f89a6602-dc0a-4000-9a4a-edd51e9f9b57 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:59 devstack sudo[98123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-19ead964-2e1d-4f13-adf5-e9c0c45776a3.f89a6602-dc0a-4000-9a4a-edd51e9f9b57 Aug 05 10:20:59 devstack sudo[98123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:59 devstack sudo[98123]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9d27cc4b-08fb-4c6b-886d-5ef6f1fd7612 tempest-GroupSnapshotsTest-980016808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-19ead964-2e1d-4f13-adf5-e9c0c45776a3.f89a6602-dc0a-4000-9a4a-edd51e9f9b57" returned: 0 in 0.416s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9d27cc4b-08fb-4c6b-886d-5ef6f1fd7612 tempest-GroupSnapshotsTest-980016808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-19ead964-2e1d-4f13-adf5-e9c0c45776a3.f89a6602-dc0a-4000-9a4a-edd51e9f9b57 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:59 devstack sudo[98129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-19ead964-2e1d-4f13-adf5-e9c0c45776a3.f89a6602-dc0a-4000-9a4a-edd51e9f9b57 Aug 05 10:20:59 devstack sudo[98129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:21:00 devstack sudo[98129]: pam_unix(sudo:session): session closed for user root Aug 05 10:21:00 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9d27cc4b-08fb-4c6b-886d-5ef6f1fd7612 tempest-GroupSnapshotsTest-980016808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-19ead964-2e1d-4f13-adf5-e9c0c45776a3.f89a6602-dc0a-4000-9a4a-edd51e9f9b57" returned: 0 in 0.292s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:21:00 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-9d27cc4b-08fb-4c6b-886d-5ef6f1fd7612 tempest-GroupSnapshotsTest-980016808 None] Lock "cinder-quobyte-f89a6602-dc0a-4000-9a4a-edd51e9f9b57" released by "_delete_snapshot" :: held 1.620s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:21:00 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-9d27cc4b-08fb-4c6b-886d-5ef6f1fd7612 tempest-GroupSnapshotsTest-980016808 None] Lock "cinder-quobyte-19ead964-2e1d-4f13-adf5-e9c0c45776a3" released by "delete_snapshot" :: held 1.650s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:21:00 devstack cinder-volume[88613]: WARNING cinder.quota [None req-9d27cc4b-08fb-4c6b-886d-5ef6f1fd7612 tempest-GroupSnapshotsTest-980016808 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1026404036 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1026404036, it is now deprecated. Please use the default quota class for default quota. Aug 05 10:21:00 devstack cinder-volume[88613]: WARNING cinder.quota [None req-9d27cc4b-08fb-4c6b-886d-5ef6f1fd7612 tempest-GroupSnapshotsTest-980016808 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1026404036 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1026404036, it is now deprecated. Please use the default quota class for default quota. Aug 05 10:21:00 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-9d27cc4b-08fb-4c6b-886d-5ef6f1fd7612 tempest-GroupSnapshotsTest-980016808 None] Created reservations ['48e48e0f-72d8-4bee-af8e-fb47fe330d1b', 'dcec0df7-f32e-4a4d-9539-6b9bab74f333', '7e7f8fee-6349-404f-8f07-9d298dc9a5d0', '638a2fe6-9bd9-4ad9-83d7-648f99fd85c9'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:21:00 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-9d27cc4b-08fb-4c6b-886d-5ef6f1fd7612 tempest-GroupSnapshotsTest-980016808 None] group_snapshot a2fc7148-c81b-41da-8e71-1af648f807d0: deleted successfully Aug 05 10:21:01 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-c5c2e765-252e-4070-9cf7-36b5f51d88c0 tempest-GroupSnapshotsTest-980016808 None] Acquiring lock "cinder-quobyte-19ead964-2e1d-4f13-adf5-e9c0c45776a3" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:21:01 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-c5c2e765-252e-4070-9cf7-36b5f51d88c0 tempest-GroupSnapshotsTest-980016808 None] Lock "cinder-quobyte-19ead964-2e1d-4f13-adf5-e9c0c45776a3" acquired by "delete_volume" :: waited 0.028s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:21:01 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[98749e14-51ba-4e0a-8113-dc4fa0624797]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:21:01 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c5c2e765-252e-4070-9cf7-36b5f51d88c0 tempest-GroupSnapshotsTest-980016808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-19ead964-2e1d-4f13-adf5-e9c0c45776a3 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:21:01 devstack sudo[98140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-19ead964-2e1d-4f13-adf5-e9c0c45776a3 Aug 05 10:21:01 devstack sudo[98140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:21:01 devstack sudo[98140]: pam_unix(sudo:session): session closed for user root Aug 05 10:21:01 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c5c2e765-252e-4070-9cf7-36b5f51d88c0 tempest-GroupSnapshotsTest-980016808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-19ead964-2e1d-4f13-adf5-e9c0c45776a3" returned: 0 in 0.402s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:21:01 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c5c2e765-252e-4070-9cf7-36b5f51d88c0 tempest-GroupSnapshotsTest-980016808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-19ead964-2e1d-4f13-adf5-e9c0c45776a3 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:21:01 devstack sudo[98147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-19ead964-2e1d-4f13-adf5-e9c0c45776a3 Aug 05 10:21:01 devstack sudo[98147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:21:02 devstack sudo[98147]: pam_unix(sudo:session): session closed for user root Aug 05 10:21:02 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c5c2e765-252e-4070-9cf7-36b5f51d88c0 tempest-GroupSnapshotsTest-980016808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-19ead964-2e1d-4f13-adf5-e9c0c45776a3" returned: 0 in 0.311s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:21:02 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-c5c2e765-252e-4070-9cf7-36b5f51d88c0 tempest-GroupSnapshotsTest-980016808 None] Lock "cinder-quobyte-19ead964-2e1d-4f13-adf5-e9c0c45776a3" released by "delete_volume" :: held 0.798s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:21:02 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-c5c2e765-252e-4070-9cf7-36b5f51d88c0 tempest-GroupSnapshotsTest-980016808 None] Created reservations ['02d1168f-676e-47ca-999a-0efb0b51c2b5'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:21:02 devstack cinder-volume[88613]: WARNING cinder.quota [None req-c5c2e765-252e-4070-9cf7-36b5f51d88c0 tempest-GroupSnapshotsTest-980016808 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1026404036 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1026404036, it is now deprecated. Please use the default quota class for default quota. Aug 05 10:21:02 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-c5c2e765-252e-4070-9cf7-36b5f51d88c0 tempest-GroupSnapshotsTest-980016808 None] Created reservations ['b1d0b716-762a-4c2e-a9f9-ae83d8ea78c1', '89c68ee6-e262-491d-b32d-d6a5d11c9dd5', '74f1a854-ca89-4b49-9371-8bc9473f339e', 'aa518185-4eda-4867-bb6b-3e2469333079'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:21:02 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c5c2e765-252e-4070-9cf7-36b5f51d88c0 tempest-GroupSnapshotsTest-980016808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:21:02 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c5c2e765-252e-4070-9cf7-36b5f51d88c0 tempest-GroupSnapshotsTest-980016808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:21:02 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-c5c2e765-252e-4070-9cf7-36b5f51d88c0 tempest-GroupSnapshotsTest-980016808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:21:02 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-c5c2e765-252e-4070-9cf7-36b5f51d88c0 tempest-GroupSnapshotsTest-980016808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:21:02 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c5c2e765-252e-4070-9cf7-36b5f51d88c0 tempest-GroupSnapshotsTest-980016808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:21:02 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c5c2e765-252e-4070-9cf7-36b5f51d88c0 tempest-GroupSnapshotsTest-980016808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:21:02 devstack sudo[98162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:21:02 devstack sudo[98162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:21:02 devstack sudo[98162]: pam_unix(sudo:session): session closed for user root Aug 05 10:21:02 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c5c2e765-252e-4070-9cf7-36b5f51d88c0 tempest-GroupSnapshotsTest-980016808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.307s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:21:02 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-c5c2e765-252e-4070-9cf7-36b5f51d88c0 tempest-GroupSnapshotsTest-980016808 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:21:02 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-c5c2e765-252e-4070-9cf7-36b5f51d88c0 tempest-GroupSnapshotsTest-980016808 None] Delete group completed successfully. Aug 05 10:21:03 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-fbcac9dd-ed01-4782-9713-ed42645f5ea8 req-4a15263c-c08c-4f3a-a5ed-5a5cb0b890fa tempest-TestInstancesWithCinderVolumes-1602349945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:21:03 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-fbcac9dd-ed01-4782-9713-ed42645f5ea8 req-4a15263c-c08c-4f3a-a5ed-5a5cb0b890fa tempest-TestInstancesWithCinderVolumes-1602349945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:21:03 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-fbcac9dd-ed01-4782-9713-ed42645f5ea8 req-4a15263c-c08c-4f3a-a5ed-5a5cb0b890fa tempest-TestInstancesWithCinderVolumes-1602349945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:21:03 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [req-fbcac9dd-ed01-4782-9713-ed42645f5ea8 req-4a15263c-c08c-4f3a-a5ed-5a5cb0b890fa tempest-TestInstancesWithCinderVolumes-1602349945 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1', 'name': 'volume-79d6f427-4b59-4387-914c-78fb879ddb34', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '729ca5eb-0336-4c40-a75a-e69c8aec100a', 'enforce_multipath': True} {{(pid=88613) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 10:21:03 devstack cinder-volume[88613]: INFO cinder.volume.manager [req-fbcac9dd-ed01-4782-9713-ed42645f5ea8 req-4a15263c-c08c-4f3a-a5ed-5a5cb0b890fa tempest-TestInstancesWithCinderVolumes-1602349945 None] attachment_update completed successfully. Aug 05 10:21:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-769a36ef-4495-41a9-8d2d-b7fb4f9f99f4 req-4f77e3d6-7e89-4cb0-9d4b-56500b92dd47 tempest-TestInstancesWithCinderVolumes-1602349945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:21:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-769a36ef-4495-41a9-8d2d-b7fb4f9f99f4 req-4f77e3d6-7e89-4cb0-9d4b-56500b92dd47 tempest-TestInstancesWithCinderVolumes-1602349945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:21:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-769a36ef-4495-41a9-8d2d-b7fb4f9f99f4 req-4f77e3d6-7e89-4cb0-9d4b-56500b92dd47 tempest-TestInstancesWithCinderVolumes-1602349945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:21:07 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [req-769a36ef-4495-41a9-8d2d-b7fb4f9f99f4 req-4f77e3d6-7e89-4cb0-9d4b-56500b92dd47 tempest-TestInstancesWithCinderVolumes-1602349945 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1', 'name': 'volume-50576984-0bf7-4b5e-9c5c-2f95caef2616', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '91889c0b-1f73-4120-b59f-7b107c4dd74b', 'enforce_multipath': True} {{(pid=88613) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 10:21:07 devstack cinder-volume[88613]: INFO cinder.volume.manager [req-769a36ef-4495-41a9-8d2d-b7fb4f9f99f4 req-4f77e3d6-7e89-4cb0-9d4b-56500b92dd47 tempest-TestInstancesWithCinderVolumes-1602349945 None] attachment_update completed successfully. Aug 05 10:21:12 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [req-d15dc082-88ce-4dbf-ab46-16244f3dfd20 req-f89d721f-6ce7-4f0e-9c0b-13a97c31e832 tempest-AttachVolumeShelveTestJSON-1141396775 None] No connector for attachment d1917a7b-bb85-4304-a90e-ca2f426f6cdf; skipping storage backend terminate_connection call. {{(pid=88613) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Aug 05 10:21:12 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [req-d15dc082-88ce-4dbf-ab46-16244f3dfd20 req-f89d721f-6ce7-4f0e-9c0b-13a97c31e832 tempest-AttachVolumeShelveTestJSON-1141396775 None] Deleting attachment d1917a7b-bb85-4304-a90e-ca2f426f6cdf. {{(pid=88613) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 10:21:14 devstack cinder-volume[88613]: INFO cinder.volume.manager [req-cebc56ba-a769-4882-9f77-a619e1e04749 req-be6db95c-22c9-4235-ab61-73b524801d13 tempest-TestInstancesWithCinderVolumes-1602349945 None] Terminate volume connection completed successfully. Aug 05 10:21:14 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [req-cebc56ba-a769-4882-9f77-a619e1e04749 req-be6db95c-22c9-4235-ab61-73b524801d13 tempest-TestInstancesWithCinderVolumes-1602349945 None] Deleting attachment 729ca5eb-0336-4c40-a75a-e69c8aec100a. {{(pid=88613) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 10:21:15 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-f2be9d01-6d9d-4e3e-8dad-2b4410ea5884 tempest-TestInstancesWithCinderVolumes-1602349945 None] Acquiring lock "cinder-79d6f427-4b59-4387-914c-78fb879ddb34-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:21:15 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-f2be9d01-6d9d-4e3e-8dad-2b4410ea5884 tempest-TestInstancesWithCinderVolumes-1602349945 None] Lock "cinder-79d6f427-4b59-4387-914c-78fb879ddb34-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:21:15 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-f2be9d01-6d9d-4e3e-8dad-2b4410ea5884 tempest-TestInstancesWithCinderVolumes-1602349945 None] Acquiring lock "cinder-quobyte-79d6f427-4b59-4387-914c-78fb879ddb34" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:21:15 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-f2be9d01-6d9d-4e3e-8dad-2b4410ea5884 tempest-TestInstancesWithCinderVolumes-1602349945 None] Lock "cinder-quobyte-79d6f427-4b59-4387-914c-78fb879ddb34" acquired by "delete_volume" :: waited 0.027s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:21:15 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6cbee6-1ea5-4f23-9858-e37df297ed95]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:21:15 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f2be9d01-6d9d-4e3e-8dad-2b4410ea5884 tempest-TestInstancesWithCinderVolumes-1602349945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-79d6f427-4b59-4387-914c-78fb879ddb34 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:21:15 devstack sudo[98269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-79d6f427-4b59-4387-914c-78fb879ddb34 Aug 05 10:21:15 devstack sudo[98269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:21:16 devstack sudo[98269]: pam_unix(sudo:session): session closed for user root Aug 05 10:21:16 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f2be9d01-6d9d-4e3e-8dad-2b4410ea5884 tempest-TestInstancesWithCinderVolumes-1602349945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-79d6f427-4b59-4387-914c-78fb879ddb34" returned: 0 in 0.616s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:21:16 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f2be9d01-6d9d-4e3e-8dad-2b4410ea5884 tempest-TestInstancesWithCinderVolumes-1602349945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-79d6f427-4b59-4387-914c-78fb879ddb34 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:21:16 devstack sudo[98276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-79d6f427-4b59-4387-914c-78fb879ddb34 Aug 05 10:21:16 devstack sudo[98276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:21:16 devstack sudo[98276]: pam_unix(sudo:session): session closed for user root Aug 05 10:21:16 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f2be9d01-6d9d-4e3e-8dad-2b4410ea5884 tempest-TestInstancesWithCinderVolumes-1602349945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-79d6f427-4b59-4387-914c-78fb879ddb34" returned: 0 in 0.440s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:21:16 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-f2be9d01-6d9d-4e3e-8dad-2b4410ea5884 tempest-TestInstancesWithCinderVolumes-1602349945 None] Lock "cinder-quobyte-79d6f427-4b59-4387-914c-78fb879ddb34" released by "delete_volume" :: held 1.160s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:21:16 devstack cinder-volume[88613]: WARNING cinder.quota [None req-f2be9d01-6d9d-4e3e-8dad-2b4410ea5884 tempest-TestInstancesWithCinderVolumes-1602349945 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2116994446-1416901919 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2116994446-1416901919, it is now deprecated. Please use the default quota class for default quota. Aug 05 10:21:16 devstack cinder-volume[88613]: WARNING cinder.quota [None req-f2be9d01-6d9d-4e3e-8dad-2b4410ea5884 tempest-TestInstancesWithCinderVolumes-1602349945 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2116994446-1416901919 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2116994446-1416901919, it is now deprecated. Please use the default quota class for default quota. Aug 05 10:21:16 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-5096c6ec-7294-4b19-b2a1-a26b71e01c1b tempest-VolumeQuotasAdminTestJSON-671200856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:21:16 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5096c6ec-7294-4b19-b2a1-a26b71e01c1b tempest-VolumeQuotasAdminTestJSON-671200856 None] Flow 'volume_create_manager' (da3f1531-d216-45a0-8638-c4f5c0983177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:21:16 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5096c6ec-7294-4b19-b2a1-a26b71e01c1b tempest-VolumeQuotasAdminTestJSON-671200856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52fe08d3-5c9e-4a92-8f42-5a857984724d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:21:16 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-f2be9d01-6d9d-4e3e-8dad-2b4410ea5884 tempest-TestInstancesWithCinderVolumes-1602349945 None] Created reservations ['876d6d5f-8f8c-4562-a9b8-9554c2b0c0dc', '31609f84-ba03-468d-bb3f-46dae5aa32db', '37da524d-6473-4635-9fc4-a2a6bb0f8725', '572c9728-79b2-4d97-bfea-6dcb5367dd77'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:21:16 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5096c6ec-7294-4b19-b2a1-a26b71e01c1b tempest-VolumeQuotasAdminTestJSON-671200856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52fe08d3-5c9e-4a92-8f42-5a857984724d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:21:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-87418263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a60e9139-e780-4ec6-aff2-711204c2e9f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc4cd93439c9487696d0ee65ac7fe07e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:21:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:21:17Z,use_quota=True,user_id='98b87d1d34db4740a8f028739b82b136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:21:16 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5096c6ec-7294-4b19-b2a1-a26b71e01c1b tempest-VolumeQuotasAdminTestJSON-671200856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf9c91df-8436-43bd-91c8-8dd8f5d2f06a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:21:16 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5096c6ec-7294-4b19-b2a1-a26b71e01c1b tempest-VolumeQuotasAdminTestJSON-671200856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf9c91df-8436-43bd-91c8-8dd8f5d2f06a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:21:16 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5096c6ec-7294-4b19-b2a1-a26b71e01c1b tempest-VolumeQuotasAdminTestJSON-671200856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b8d0016-cf51-43a2-b158-150702fb89d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:21:16 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5096c6ec-7294-4b19-b2a1-a26b71e01c1b tempest-VolumeQuotasAdminTestJSON-671200856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b8d0016-cf51-43a2-b158-150702fb89d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a60e9139-e780-4ec6-aff2-711204c2e9f5', 'volume_name': 'volume-a60e9139-e780-4ec6-aff2-711204c2e9f5', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:21:16 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5096c6ec-7294-4b19-b2a1-a26b71e01c1b tempest-VolumeQuotasAdminTestJSON-671200856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50872472-9c4e-4e50-9ad5-094a15f11c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:21:16 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5096c6ec-7294-4b19-b2a1-a26b71e01c1b tempest-VolumeQuotasAdminTestJSON-671200856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50872472-9c4e-4e50-9ad5-094a15f11c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:21:16 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5096c6ec-7294-4b19-b2a1-a26b71e01c1b tempest-VolumeQuotasAdminTestJSON-671200856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95ebe4e3-fc79-47a0-983f-5e939d837dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:21:16 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-5096c6ec-7294-4b19-b2a1-a26b71e01c1b tempest-VolumeQuotasAdminTestJSON-671200856 None] Volume a60e9139-e780-4ec6-aff2-711204c2e9f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a60e9139-e780-4ec6-aff2-711204c2e9f5', 'volume_size': 1} Aug 05 10:21:16 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5096c6ec-7294-4b19-b2a1-a26b71e01c1b tempest-VolumeQuotasAdminTestJSON-671200856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:21:16 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5096c6ec-7294-4b19-b2a1-a26b71e01c1b tempest-VolumeQuotasAdminTestJSON-671200856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:21:16 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-5096c6ec-7294-4b19-b2a1-a26b71e01c1b tempest-VolumeQuotasAdminTestJSON-671200856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:21:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-87418263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a60e9139-e780-4ec6-aff2-711204c2e9f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc4cd93439c9487696d0ee65ac7fe07e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:21:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:21:17Z,use_quota=True,user_id='98b87d1d34db4740a8f028739b82b136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:21:16 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-5096c6ec-7294-4b19-b2a1-a26b71e01c1b tempest-VolumeQuotasAdminTestJSON-671200856 None] Creating volume a60e9139-e780-4ec6-aff2-711204c2e9f5 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:21:16 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5096c6ec-7294-4b19-b2a1-a26b71e01c1b tempest-VolumeQuotasAdminTestJSON-671200856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:21:16 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5096c6ec-7294-4b19-b2a1-a26b71e01c1b tempest-VolumeQuotasAdminTestJSON-671200856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:21:16 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-5096c6ec-7294-4b19-b2a1-a26b71e01c1b tempest-VolumeQuotasAdminTestJSON-671200856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:21:16 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-5096c6ec-7294-4b19-b2a1-a26b71e01c1b tempest-VolumeQuotasAdminTestJSON-671200856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:21:16 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5096c6ec-7294-4b19-b2a1-a26b71e01c1b tempest-VolumeQuotasAdminTestJSON-671200856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:21:16 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-5096c6ec-7294-4b19-b2a1-a26b71e01c1b tempest-VolumeQuotasAdminTestJSON-671200856 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:21:16 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-5096c6ec-7294-4b19-b2a1-a26b71e01c1b tempest-VolumeQuotasAdminTestJSON-671200856 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:21:16 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5096c6ec-7294-4b19-b2a1-a26b71e01c1b tempest-VolumeQuotasAdminTestJSON-671200856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a60e9139-e780-4ec6-aff2-711204c2e9f5 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:21:16 devstack sudo[98279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a60e9139-e780-4ec6-aff2-711204c2e9f5 1073741824 Aug 05 10:21:16 devstack sudo[98279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:21:16 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-f2be9d01-6d9d-4e3e-8dad-2b4410ea5884 tempest-TestInstancesWithCinderVolumes-1602349945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:21:16 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-f2be9d01-6d9d-4e3e-8dad-2b4410ea5884 tempest-TestInstancesWithCinderVolumes-1602349945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:21:16 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-f2be9d01-6d9d-4e3e-8dad-2b4410ea5884 tempest-TestInstancesWithCinderVolumes-1602349945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:21:16 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-f2be9d01-6d9d-4e3e-8dad-2b4410ea5884 tempest-TestInstancesWithCinderVolumes-1602349945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:21:16 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-f2be9d01-6d9d-4e3e-8dad-2b4410ea5884 tempest-TestInstancesWithCinderVolumes-1602349945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:21:16 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f2be9d01-6d9d-4e3e-8dad-2b4410ea5884 tempest-TestInstancesWithCinderVolumes-1602349945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:21:16 devstack sudo[98281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:21:16 devstack sudo[98281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:21:17 devstack sudo[98281]: pam_unix(sudo:session): session closed for user root Aug 05 10:21:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f2be9d01-6d9d-4e3e-8dad-2b4410ea5884 tempest-TestInstancesWithCinderVolumes-1602349945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.371s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:21:17 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-f2be9d01-6d9d-4e3e-8dad-2b4410ea5884 tempest-TestInstancesWithCinderVolumes-1602349945 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:21:17 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-f2be9d01-6d9d-4e3e-8dad-2b4410ea5884 tempest-TestInstancesWithCinderVolumes-1602349945 None] Deleted volume successfully. Aug 05 10:21:17 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-f2be9d01-6d9d-4e3e-8dad-2b4410ea5884 tempest-TestInstancesWithCinderVolumes-1602349945 None] Lock "cinder-79d6f427-4b59-4387-914c-78fb879ddb34-delete_volume" released by "delete_volume" :: held 2.005s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:21:17 devstack sudo[98279]: pam_unix(sudo:session): session closed for user root Aug 05 10:21:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5096c6ec-7294-4b19-b2a1-a26b71e01c1b tempest-VolumeQuotasAdminTestJSON-671200856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a60e9139-e780-4ec6-aff2-711204c2e9f5 1073741824" returned: 0 in 0.741s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:21:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5096c6ec-7294-4b19-b2a1-a26b71e01c1b tempest-VolumeQuotasAdminTestJSON-671200856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a60e9139-e780-4ec6-aff2-711204c2e9f5 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:21:17 devstack sudo[98289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a60e9139-e780-4ec6-aff2-711204c2e9f5 Aug 05 10:21:17 devstack sudo[98289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:21:17 devstack sudo[98289]: pam_unix(sudo:session): session closed for user root Aug 05 10:21:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5096c6ec-7294-4b19-b2a1-a26b71e01c1b tempest-VolumeQuotasAdminTestJSON-671200856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a60e9139-e780-4ec6-aff2-711204c2e9f5" returned: 0 in 0.353s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:21:17 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-5096c6ec-7294-4b19-b2a1-a26b71e01c1b tempest-VolumeQuotasAdminTestJSON-671200856 None] <== create_volume: return (1154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:21:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5096c6ec-7294-4b19-b2a1-a26b71e01c1b tempest-VolumeQuotasAdminTestJSON-671200856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.160s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:21:17 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5096c6ec-7294-4b19-b2a1-a26b71e01c1b tempest-VolumeQuotasAdminTestJSON-671200856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95ebe4e3-fc79-47a0-983f-5e939d837dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a60e9139-e780-4ec6-aff2-711204c2e9f5', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:21:17 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5096c6ec-7294-4b19-b2a1-a26b71e01c1b tempest-VolumeQuotasAdminTestJSON-671200856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2f06085-c07b-4cd1-9dbc-a86b90e930aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:21:17 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-5096c6ec-7294-4b19-b2a1-a26b71e01c1b tempest-VolumeQuotasAdminTestJSON-671200856 None] Volume volume-a60e9139-e780-4ec6-aff2-711204c2e9f5 (a60e9139-e780-4ec6-aff2-711204c2e9f5): created successfully Aug 05 10:21:17 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5096c6ec-7294-4b19-b2a1-a26b71e01c1b tempest-VolumeQuotasAdminTestJSON-671200856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2f06085-c07b-4cd1-9dbc-a86b90e930aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:21:17 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5096c6ec-7294-4b19-b2a1-a26b71e01c1b tempest-VolumeQuotasAdminTestJSON-671200856 None] Flow 'volume_create_manager' (da3f1531-d216-45a0-8638-c4f5c0983177) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:21:17 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-5096c6ec-7294-4b19-b2a1-a26b71e01c1b tempest-VolumeQuotasAdminTestJSON-671200856 None] Created volume successfully. Aug 05 10:21:18 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-560768ce-4671-4601-8ef7-05006897f3f3 tempest-VolumeQuotasAdminTestJSON-671200856 None] Acquiring lock "cinder-a60e9139-e780-4ec6-aff2-711204c2e9f5-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:21:18 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-560768ce-4671-4601-8ef7-05006897f3f3 tempest-VolumeQuotasAdminTestJSON-671200856 None] Lock "cinder-a60e9139-e780-4ec6-aff2-711204c2e9f5-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:21:18 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-560768ce-4671-4601-8ef7-05006897f3f3 tempest-VolumeQuotasAdminTestJSON-671200856 None] Acquiring lock "cinder-quobyte-a60e9139-e780-4ec6-aff2-711204c2e9f5" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:21:18 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-560768ce-4671-4601-8ef7-05006897f3f3 tempest-VolumeQuotasAdminTestJSON-671200856 None] Lock "cinder-quobyte-a60e9139-e780-4ec6-aff2-711204c2e9f5" acquired by "delete_volume" :: waited 0.038s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:21:18 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac54d44-2804-4017-8335-bbe2c0a9a46c]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:21:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-560768ce-4671-4601-8ef7-05006897f3f3 tempest-VolumeQuotasAdminTestJSON-671200856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a60e9139-e780-4ec6-aff2-711204c2e9f5 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:21:19 devstack sudo[98311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a60e9139-e780-4ec6-aff2-711204c2e9f5 Aug 05 10:21:19 devstack sudo[98311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:21:19 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f757093-a104-4abb-ac75-e8b7238b9540 tempest-VolumeQuotasNegativeTestJSON-1284939560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:21:19 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-8f757093-a104-4abb-ac75-e8b7238b9540 tempest-VolumeQuotasNegativeTestJSON-1284939560 None] Flow 'volume_create_manager' (14c181d9-404b-4c1c-a739-07435f675b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:21:19 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-8f757093-a104-4abb-ac75-e8b7238b9540 tempest-VolumeQuotasNegativeTestJSON-1284939560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28b33351-8ad6-421d-b717-e6339c2e12e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:21:19 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-8f757093-a104-4abb-ac75-e8b7238b9540 tempest-VolumeQuotasNegativeTestJSON-1284939560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28b33351-8ad6-421d-b717-e6339c2e12e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:21:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1948183891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a0898bd-52da-4134-9e39-ffae54be265d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b73a91f039d84bbb8852dad275b36200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:21:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:21:19Z,use_quota=True,user_id='d6aabec277444a6d9b07a9726f88ef6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:21:19 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-8f757093-a104-4abb-ac75-e8b7238b9540 tempest-VolumeQuotasNegativeTestJSON-1284939560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a02a403-f06c-4dca-b87e-a5e89ec15ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:21:19 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-8f757093-a104-4abb-ac75-e8b7238b9540 tempest-VolumeQuotasNegativeTestJSON-1284939560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a02a403-f06c-4dca-b87e-a5e89ec15ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:21:19 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-8f757093-a104-4abb-ac75-e8b7238b9540 tempest-VolumeQuotasNegativeTestJSON-1284939560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24be66ab-4359-4fd1-9cdc-b09c70339733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:21:19 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-8f757093-a104-4abb-ac75-e8b7238b9540 tempest-VolumeQuotasNegativeTestJSON-1284939560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24be66ab-4359-4fd1-9cdc-b09c70339733) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a0898bd-52da-4134-9e39-ffae54be265d', 'volume_name': 'volume-3a0898bd-52da-4134-9e39-ffae54be265d', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:21:19 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-8f757093-a104-4abb-ac75-e8b7238b9540 tempest-VolumeQuotasNegativeTestJSON-1284939560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a7821a6-72ca-4e29-b2c4-cc28b746b607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:21:19 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-8f757093-a104-4abb-ac75-e8b7238b9540 tempest-VolumeQuotasNegativeTestJSON-1284939560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a7821a6-72ca-4e29-b2c4-cc28b746b607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:21:19 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-8f757093-a104-4abb-ac75-e8b7238b9540 tempest-VolumeQuotasNegativeTestJSON-1284939560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90015c21-b016-4f70-b9e4-8bc6b552b2b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:21:19 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-8f757093-a104-4abb-ac75-e8b7238b9540 tempest-VolumeQuotasNegativeTestJSON-1284939560 None] Volume 3a0898bd-52da-4134-9e39-ffae54be265d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a0898bd-52da-4134-9e39-ffae54be265d', 'volume_size': 1} Aug 05 10:21:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-8f757093-a104-4abb-ac75-e8b7238b9540 tempest-VolumeQuotasNegativeTestJSON-1284939560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:21:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-8f757093-a104-4abb-ac75-e8b7238b9540 tempest-VolumeQuotasNegativeTestJSON-1284939560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:21:19 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-8f757093-a104-4abb-ac75-e8b7238b9540 tempest-VolumeQuotasNegativeTestJSON-1284939560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:21:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1948183891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a0898bd-52da-4134-9e39-ffae54be265d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b73a91f039d84bbb8852dad275b36200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:21:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:21:19Z,use_quota=True,user_id='d6aabec277444a6d9b07a9726f88ef6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:21:19 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-8f757093-a104-4abb-ac75-e8b7238b9540 tempest-VolumeQuotasNegativeTestJSON-1284939560 None] Creating volume 3a0898bd-52da-4134-9e39-ffae54be265d {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:21:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-8f757093-a104-4abb-ac75-e8b7238b9540 tempest-VolumeQuotasNegativeTestJSON-1284939560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:21:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-8f757093-a104-4abb-ac75-e8b7238b9540 tempest-VolumeQuotasNegativeTestJSON-1284939560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:21:19 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-8f757093-a104-4abb-ac75-e8b7238b9540 tempest-VolumeQuotasNegativeTestJSON-1284939560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:21:19 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-8f757093-a104-4abb-ac75-e8b7238b9540 tempest-VolumeQuotasNegativeTestJSON-1284939560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:21:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-8f757093-a104-4abb-ac75-e8b7238b9540 tempest-VolumeQuotasNegativeTestJSON-1284939560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:21:19 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-8f757093-a104-4abb-ac75-e8b7238b9540 tempest-VolumeQuotasNegativeTestJSON-1284939560 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:21:19 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-8f757093-a104-4abb-ac75-e8b7238b9540 tempest-VolumeQuotasNegativeTestJSON-1284939560 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:21:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-8f757093-a104-4abb-ac75-e8b7238b9540 tempest-VolumeQuotasNegativeTestJSON-1284939560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3a0898bd-52da-4134-9e39-ffae54be265d 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:21:19 devstack sudo[98311]: pam_unix(sudo:session): session closed for user root Aug 05 10:21:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-560768ce-4671-4601-8ef7-05006897f3f3 tempest-VolumeQuotasAdminTestJSON-671200856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a60e9139-e780-4ec6-aff2-711204c2e9f5" returned: 0 in 0.517s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:21:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-560768ce-4671-4601-8ef7-05006897f3f3 tempest-VolumeQuotasAdminTestJSON-671200856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a60e9139-e780-4ec6-aff2-711204c2e9f5 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:21:19 devstack sudo[98320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3a0898bd-52da-4134-9e39-ffae54be265d 1073741824 Aug 05 10:21:19 devstack sudo[98320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:21:19 devstack sudo[98321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a60e9139-e780-4ec6-aff2-711204c2e9f5 Aug 05 10:21:19 devstack sudo[98321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:21:19 devstack sudo[98321]: pam_unix(sudo:session): session closed for user root Aug 05 10:21:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-560768ce-4671-4601-8ef7-05006897f3f3 tempest-VolumeQuotasAdminTestJSON-671200856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a60e9139-e780-4ec6-aff2-711204c2e9f5" returned: 0 in 0.301s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:21:19 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-560768ce-4671-4601-8ef7-05006897f3f3 tempest-VolumeQuotasAdminTestJSON-671200856 None] Lock "cinder-quobyte-a60e9139-e780-4ec6-aff2-711204c2e9f5" released by "delete_volume" :: held 0.913s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:21:19 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-560768ce-4671-4601-8ef7-05006897f3f3 tempest-VolumeQuotasAdminTestJSON-671200856 None] Created reservations ['af7fb94f-50e8-4981-ab91-d61f1c2b0930', '872ebf89-942e-4a03-a977-a65ece691c6c', 'e285def1-ecf2-4f65-80a2-ba39b7487965', '1b2d770e-e7ad-44f9-80a9-b5a4f8e2bcca'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:21:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-560768ce-4671-4601-8ef7-05006897f3f3 tempest-VolumeQuotasAdminTestJSON-671200856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:21:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-560768ce-4671-4601-8ef7-05006897f3f3 tempest-VolumeQuotasAdminTestJSON-671200856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:21:19 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-560768ce-4671-4601-8ef7-05006897f3f3 tempest-VolumeQuotasAdminTestJSON-671200856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:21:19 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-560768ce-4671-4601-8ef7-05006897f3f3 tempest-VolumeQuotasAdminTestJSON-671200856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:21:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-560768ce-4671-4601-8ef7-05006897f3f3 tempest-VolumeQuotasAdminTestJSON-671200856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:21:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-560768ce-4671-4601-8ef7-05006897f3f3 tempest-VolumeQuotasAdminTestJSON-671200856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:21:19 devstack sudo[98331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:21:19 devstack sudo[98331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:21:20 devstack sudo[98320]: pam_unix(sudo:session): session closed for user root Aug 05 10:21:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-8f757093-a104-4abb-ac75-e8b7238b9540 tempest-VolumeQuotasNegativeTestJSON-1284939560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3a0898bd-52da-4134-9e39-ffae54be265d 1073741824" returned: 0 in 0.658s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:21:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-8f757093-a104-4abb-ac75-e8b7238b9540 tempest-VolumeQuotasNegativeTestJSON-1284939560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3a0898bd-52da-4134-9e39-ffae54be265d {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:21:20 devstack sudo[98335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3a0898bd-52da-4134-9e39-ffae54be265d Aug 05 10:21:20 devstack sudo[98335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:21:20 devstack cinder-volume[88613]: INFO cinder.volume.manager [req-f0eaece9-5c90-433d-90bf-73af678783c3 req-68ff7183-921b-4cea-88b3-d2250b88ca6f tempest-TestInstancesWithCinderVolumes-1602349945 None] Terminate volume connection completed successfully. Aug 05 10:21:20 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [req-f0eaece9-5c90-433d-90bf-73af678783c3 req-68ff7183-921b-4cea-88b3-d2250b88ca6f tempest-TestInstancesWithCinderVolumes-1602349945 None] Deleting attachment 91889c0b-1f73-4120-b59f-7b107c4dd74b. {{(pid=88613) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 10:21:20 devstack sudo[98331]: pam_unix(sudo:session): session closed for user root Aug 05 10:21:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-560768ce-4671-4601-8ef7-05006897f3f3 tempest-VolumeQuotasAdminTestJSON-671200856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.301s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:21:20 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-560768ce-4671-4601-8ef7-05006897f3f3 tempest-VolumeQuotasAdminTestJSON-671200856 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:21:20 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-560768ce-4671-4601-8ef7-05006897f3f3 tempest-VolumeQuotasAdminTestJSON-671200856 None] Deleted volume successfully. Aug 05 10:21:20 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-560768ce-4671-4601-8ef7-05006897f3f3 tempest-VolumeQuotasAdminTestJSON-671200856 None] Lock "cinder-a60e9139-e780-4ec6-aff2-711204c2e9f5-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:21:20 devstack sudo[98335]: pam_unix(sudo:session): session closed for user root Aug 05 10:21:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-8f757093-a104-4abb-ac75-e8b7238b9540 tempest-VolumeQuotasNegativeTestJSON-1284939560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3a0898bd-52da-4134-9e39-ffae54be265d" returned: 0 in 0.324s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:21:20 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-8f757093-a104-4abb-ac75-e8b7238b9540 tempest-VolumeQuotasNegativeTestJSON-1284939560 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:21:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-8f757093-a104-4abb-ac75-e8b7238b9540 tempest-VolumeQuotasNegativeTestJSON-1284939560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:21:20 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-8f757093-a104-4abb-ac75-e8b7238b9540 tempest-VolumeQuotasNegativeTestJSON-1284939560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90015c21-b016-4f70-b9e4-8bc6b552b2b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a0898bd-52da-4134-9e39-ffae54be265d', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:21:20 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-8f757093-a104-4abb-ac75-e8b7238b9540 tempest-VolumeQuotasNegativeTestJSON-1284939560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (004b551a-706c-4d1c-ae83-363446fc0e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:21:20 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-8f757093-a104-4abb-ac75-e8b7238b9540 tempest-VolumeQuotasNegativeTestJSON-1284939560 None] Volume volume-3a0898bd-52da-4134-9e39-ffae54be265d (3a0898bd-52da-4134-9e39-ffae54be265d): created successfully Aug 05 10:21:20 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-8f757093-a104-4abb-ac75-e8b7238b9540 tempest-VolumeQuotasNegativeTestJSON-1284939560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (004b551a-706c-4d1c-ae83-363446fc0e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:21:20 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-8f757093-a104-4abb-ac75-e8b7238b9540 tempest-VolumeQuotasNegativeTestJSON-1284939560 None] Flow 'volume_create_manager' (14c181d9-404b-4c1c-a739-07435f675b61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:21:20 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-8f757093-a104-4abb-ac75-e8b7238b9540 tempest-VolumeQuotasNegativeTestJSON-1284939560 None] Created volume successfully. Aug 05 10:21:20 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-5803e863-6a38-487c-8e83-e42aa8e9c6f0 tempest-TestInstancesWithCinderVolumes-1602349945 None] Acquiring lock "cinder-50576984-0bf7-4b5e-9c5c-2f95caef2616-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:21:20 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-5803e863-6a38-487c-8e83-e42aa8e9c6f0 tempest-TestInstancesWithCinderVolumes-1602349945 None] Lock "cinder-50576984-0bf7-4b5e-9c5c-2f95caef2616-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:21:20 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-5803e863-6a38-487c-8e83-e42aa8e9c6f0 tempest-TestInstancesWithCinderVolumes-1602349945 None] Acquiring lock "cinder-quobyte-50576984-0bf7-4b5e-9c5c-2f95caef2616" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:21:20 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-5803e863-6a38-487c-8e83-e42aa8e9c6f0 tempest-TestInstancesWithCinderVolumes-1602349945 None] Lock "cinder-quobyte-50576984-0bf7-4b5e-9c5c-2f95caef2616" acquired by "delete_volume" :: waited 0.016s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:21:20 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce481661-8d50-4f84-a3d4-efe8c5de92ea]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:21:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5803e863-6a38-487c-8e83-e42aa8e9c6f0 tempest-TestInstancesWithCinderVolumes-1602349945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50576984-0bf7-4b5e-9c5c-2f95caef2616 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:21:20 devstack sudo[98351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50576984-0bf7-4b5e-9c5c-2f95caef2616 Aug 05 10:21:20 devstack sudo[98351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:21:21 devstack sudo[98351]: pam_unix(sudo:session): session closed for user root Aug 05 10:21:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5803e863-6a38-487c-8e83-e42aa8e9c6f0 tempest-TestInstancesWithCinderVolumes-1602349945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50576984-0bf7-4b5e-9c5c-2f95caef2616" returned: 0 in 0.474s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:21:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5803e863-6a38-487c-8e83-e42aa8e9c6f0 tempest-TestInstancesWithCinderVolumes-1602349945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50576984-0bf7-4b5e-9c5c-2f95caef2616 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:21:21 devstack sudo[98369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50576984-0bf7-4b5e-9c5c-2f95caef2616 Aug 05 10:21:21 devstack sudo[98369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:21:21 devstack sudo[98369]: pam_unix(sudo:session): session closed for user root Aug 05 10:21:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5803e863-6a38-487c-8e83-e42aa8e9c6f0 tempest-TestInstancesWithCinderVolumes-1602349945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50576984-0bf7-4b5e-9c5c-2f95caef2616" returned: 0 in 0.432s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:21:21 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-5803e863-6a38-487c-8e83-e42aa8e9c6f0 tempest-TestInstancesWithCinderVolumes-1602349945 None] Lock "cinder-quobyte-50576984-0bf7-4b5e-9c5c-2f95caef2616" released by "delete_volume" :: held 0.960s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:21:21 devstack cinder-volume[88613]: DEBUG oslo_service.periodic_task [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88613) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:21:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:21:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:21:21 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:21:21 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:21:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:21:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:21:21 devstack sudo[98379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:21:21 devstack sudo[98379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:21:21 devstack cinder-volume[88613]: WARNING cinder.quota [None req-5803e863-6a38-487c-8e83-e42aa8e9c6f0 tempest-TestInstancesWithCinderVolumes-1602349945 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1907842696-1705054912 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1907842696-1705054912, it is now deprecated. Please use the default quota class for default quota. Aug 05 10:21:21 devstack cinder-volume[88613]: WARNING cinder.quota [None req-5803e863-6a38-487c-8e83-e42aa8e9c6f0 tempest-TestInstancesWithCinderVolumes-1602349945 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1907842696-1705054912 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1907842696-1705054912, it is now deprecated. Please use the default quota class for default quota. Aug 05 10:21:21 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4a8d55f-db1b-483c-9e96-562c073cd61d tempest-VolumeQuotasAdminTestJSON-671200856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:21:21 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-b4a8d55f-db1b-483c-9e96-562c073cd61d tempest-VolumeQuotasAdminTestJSON-671200856 None] Flow 'volume_create_manager' (1c419d73-de0a-4d7e-b93f-5cbed1070a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:21:21 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-b4a8d55f-db1b-483c-9e96-562c073cd61d tempest-VolumeQuotasAdminTestJSON-671200856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d88f2132-5e0b-4a1b-aef2-875c2fc59c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:21:21 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-5803e863-6a38-487c-8e83-e42aa8e9c6f0 tempest-TestInstancesWithCinderVolumes-1602349945 None] Created reservations ['d8dcc415-701e-4648-b3b2-b0f38d6f9477', '18ecd837-fb6b-4861-8551-ad128005a510', '6057aeb8-da37-40e4-834b-33e36a18ebe2', '4d4e4ece-488f-4f49-8007-4e505d6b4a61'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:21:21 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-b4a8d55f-db1b-483c-9e96-562c073cd61d tempest-VolumeQuotasAdminTestJSON-671200856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d88f2132-5e0b-4a1b-aef2-875c2fc59c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:21:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1265784081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8b00594-ebe4-4360-9f70-07746f61bb7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc4cd93439c9487696d0ee65ac7fe07e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:21:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:21:22Z,use_quota=True,user_id='98b87d1d34db4740a8f028739b82b136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:21:21 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-b4a8d55f-db1b-483c-9e96-562c073cd61d tempest-VolumeQuotasAdminTestJSON-671200856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (411690e2-b114-415f-81a4-b63b02520dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:21:21 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-b4a8d55f-db1b-483c-9e96-562c073cd61d tempest-VolumeQuotasAdminTestJSON-671200856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (411690e2-b114-415f-81a4-b63b02520dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:21:21 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-b4a8d55f-db1b-483c-9e96-562c073cd61d tempest-VolumeQuotasAdminTestJSON-671200856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ca3892f-41e0-4c28-a41d-7ecdd54293b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:21:21 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-b4a8d55f-db1b-483c-9e96-562c073cd61d tempest-VolumeQuotasAdminTestJSON-671200856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ca3892f-41e0-4c28-a41d-7ecdd54293b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8b00594-ebe4-4360-9f70-07746f61bb7e', 'volume_name': 'volume-a8b00594-ebe4-4360-9f70-07746f61bb7e', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:21:21 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-b4a8d55f-db1b-483c-9e96-562c073cd61d tempest-VolumeQuotasAdminTestJSON-671200856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32b449fb-da08-45b6-a18b-c3f407f055b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:21:22 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-b4a8d55f-db1b-483c-9e96-562c073cd61d tempest-VolumeQuotasAdminTestJSON-671200856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32b449fb-da08-45b6-a18b-c3f407f055b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:21:22 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-b4a8d55f-db1b-483c-9e96-562c073cd61d tempest-VolumeQuotasAdminTestJSON-671200856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d9afa88-63a1-43be-83fd-8e7d53df8616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:21:22 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-b4a8d55f-db1b-483c-9e96-562c073cd61d tempest-VolumeQuotasAdminTestJSON-671200856 None] Volume a8b00594-ebe4-4360-9f70-07746f61bb7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8b00594-ebe4-4360-9f70-07746f61bb7e', 'volume_size': 1} Aug 05 10:21:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-b4a8d55f-db1b-483c-9e96-562c073cd61d tempest-VolumeQuotasAdminTestJSON-671200856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:21:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-b4a8d55f-db1b-483c-9e96-562c073cd61d tempest-VolumeQuotasAdminTestJSON-671200856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:21:22 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-b4a8d55f-db1b-483c-9e96-562c073cd61d tempest-VolumeQuotasAdminTestJSON-671200856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:21:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1265784081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8b00594-ebe4-4360-9f70-07746f61bb7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc4cd93439c9487696d0ee65ac7fe07e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:21:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:21:22Z,use_quota=True,user_id='98b87d1d34db4740a8f028739b82b136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:21:22 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-b4a8d55f-db1b-483c-9e96-562c073cd61d tempest-VolumeQuotasAdminTestJSON-671200856 None] Creating volume a8b00594-ebe4-4360-9f70-07746f61bb7e {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:21:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-b4a8d55f-db1b-483c-9e96-562c073cd61d tempest-VolumeQuotasAdminTestJSON-671200856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:21:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-b4a8d55f-db1b-483c-9e96-562c073cd61d tempest-VolumeQuotasAdminTestJSON-671200856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:21:22 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-b4a8d55f-db1b-483c-9e96-562c073cd61d tempest-VolumeQuotasAdminTestJSON-671200856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:21:22 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-b4a8d55f-db1b-483c-9e96-562c073cd61d tempest-VolumeQuotasAdminTestJSON-671200856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:21:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-b4a8d55f-db1b-483c-9e96-562c073cd61d tempest-VolumeQuotasAdminTestJSON-671200856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:21:22 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-b4a8d55f-db1b-483c-9e96-562c073cd61d tempest-VolumeQuotasAdminTestJSON-671200856 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:21:22 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-b4a8d55f-db1b-483c-9e96-562c073cd61d tempest-VolumeQuotasAdminTestJSON-671200856 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:21:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b4a8d55f-db1b-483c-9e96-562c073cd61d tempest-VolumeQuotasAdminTestJSON-671200856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a8b00594-ebe4-4360-9f70-07746f61bb7e 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:21:22 devstack sudo[98386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a8b00594-ebe4-4360-9f70-07746f61bb7e 1073741824 Aug 05 10:21:22 devstack sudo[98386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:21:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5803e863-6a38-487c-8e83-e42aa8e9c6f0 tempest-TestInstancesWithCinderVolumes-1602349945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:21:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5803e863-6a38-487c-8e83-e42aa8e9c6f0 tempest-TestInstancesWithCinderVolumes-1602349945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:21:22 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-5803e863-6a38-487c-8e83-e42aa8e9c6f0 tempest-TestInstancesWithCinderVolumes-1602349945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:21:22 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-5803e863-6a38-487c-8e83-e42aa8e9c6f0 tempest-TestInstancesWithCinderVolumes-1602349945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:21:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5803e863-6a38-487c-8e83-e42aa8e9c6f0 tempest-TestInstancesWithCinderVolumes-1602349945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:21:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5803e863-6a38-487c-8e83-e42aa8e9c6f0 tempest-TestInstancesWithCinderVolumes-1602349945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:21:22 devstack sudo[98389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:21:22 devstack sudo[98389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:21:22 devstack sudo[98379]: pam_unix(sudo:session): session closed for user root Aug 05 10:21:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.439s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:21:22 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:21:22 devstack cinder-volume[88613]: DEBUG oslo_service.periodic_task [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Running periodic task VolumeManager._thread_info {{(pid=88613) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:21:22 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] thread count: 28 {{(pid=88613) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 10:21:22 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] thread info: [<_MainThread(MainThread, started 126173666128000)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88613) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 10:21:22 devstack sudo[98389]: pam_unix(sudo:session): session closed for user root Aug 05 10:21:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5803e863-6a38-487c-8e83-e42aa8e9c6f0 tempest-TestInstancesWithCinderVolumes-1602349945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.429s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:21:22 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-5803e863-6a38-487c-8e83-e42aa8e9c6f0 tempest-TestInstancesWithCinderVolumes-1602349945 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:21:22 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-5803e863-6a38-487c-8e83-e42aa8e9c6f0 tempest-TestInstancesWithCinderVolumes-1602349945 None] Deleted volume successfully. Aug 05 10:21:22 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-5803e863-6a38-487c-8e83-e42aa8e9c6f0 tempest-TestInstancesWithCinderVolumes-1602349945 None] Lock "cinder-50576984-0bf7-4b5e-9c5c-2f95caef2616-delete_volume" released by "delete_volume" :: held 1.893s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:21:22 devstack sudo[98386]: pam_unix(sudo:session): session closed for user root Aug 05 10:21:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b4a8d55f-db1b-483c-9e96-562c073cd61d tempest-VolumeQuotasAdminTestJSON-671200856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a8b00594-ebe4-4360-9f70-07746f61bb7e 1073741824" returned: 0 in 0.790s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:21:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b4a8d55f-db1b-483c-9e96-562c073cd61d tempest-VolumeQuotasAdminTestJSON-671200856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a8b00594-ebe4-4360-9f70-07746f61bb7e {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:21:22 devstack sudo[98397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a8b00594-ebe4-4360-9f70-07746f61bb7e Aug 05 10:21:22 devstack sudo[98397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:21:23 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-3fd3f5bd-ac6d-4a5a-a14b-3e82bc493993 tempest-VolumeQuotasNegativeTestJSON-1284939560 None] Acquiring lock "cinder-3a0898bd-52da-4134-9e39-ffae54be265d-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:21:23 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-3fd3f5bd-ac6d-4a5a-a14b-3e82bc493993 tempest-VolumeQuotasNegativeTestJSON-1284939560 None] Lock "cinder-3a0898bd-52da-4134-9e39-ffae54be265d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:21:23 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-3fd3f5bd-ac6d-4a5a-a14b-3e82bc493993 tempest-VolumeQuotasNegativeTestJSON-1284939560 None] Acquiring lock "cinder-quobyte-3a0898bd-52da-4134-9e39-ffae54be265d" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:21:23 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-3fd3f5bd-ac6d-4a5a-a14b-3e82bc493993 tempest-VolumeQuotasNegativeTestJSON-1284939560 None] Lock "cinder-quobyte-3a0898bd-52da-4134-9e39-ffae54be265d" acquired by "delete_volume" :: waited 0.038s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:21:23 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78c2915-198c-4a9a-a1f5-7955590256da]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:21:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3fd3f5bd-ac6d-4a5a-a14b-3e82bc493993 tempest-VolumeQuotasNegativeTestJSON-1284939560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3a0898bd-52da-4134-9e39-ffae54be265d {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:21:23 devstack sudo[98397]: pam_unix(sudo:session): session closed for user root Aug 05 10:21:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b4a8d55f-db1b-483c-9e96-562c073cd61d tempest-VolumeQuotasAdminTestJSON-671200856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a8b00594-ebe4-4360-9f70-07746f61bb7e" returned: 0 in 0.415s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:21:23 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-b4a8d55f-db1b-483c-9e96-562c073cd61d tempest-VolumeQuotasAdminTestJSON-671200856 None] <== create_volume: return (1266ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:21:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-b4a8d55f-db1b-483c-9e96-562c073cd61d tempest-VolumeQuotasAdminTestJSON-671200856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.272s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:21:23 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-b4a8d55f-db1b-483c-9e96-562c073cd61d tempest-VolumeQuotasAdminTestJSON-671200856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d9afa88-63a1-43be-83fd-8e7d53df8616) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8b00594-ebe4-4360-9f70-07746f61bb7e', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:21:23 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-b4a8d55f-db1b-483c-9e96-562c073cd61d tempest-VolumeQuotasAdminTestJSON-671200856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (055321b5-3e22-4e30-af73-d539912a0318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:21:23 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-b4a8d55f-db1b-483c-9e96-562c073cd61d tempest-VolumeQuotasAdminTestJSON-671200856 None] Volume volume-a8b00594-ebe4-4360-9f70-07746f61bb7e (a8b00594-ebe4-4360-9f70-07746f61bb7e): created successfully Aug 05 10:21:23 devstack sudo[98400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3a0898bd-52da-4134-9e39-ffae54be265d Aug 05 10:21:23 devstack sudo[98400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:21:23 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-b4a8d55f-db1b-483c-9e96-562c073cd61d tempest-VolumeQuotasAdminTestJSON-671200856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (055321b5-3e22-4e30-af73-d539912a0318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:21:23 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-b4a8d55f-db1b-483c-9e96-562c073cd61d tempest-VolumeQuotasAdminTestJSON-671200856 None] Flow 'volume_create_manager' (1c419d73-de0a-4d7e-b93f-5cbed1070a35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:21:23 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-b4a8d55f-db1b-483c-9e96-562c073cd61d tempest-VolumeQuotasAdminTestJSON-671200856 None] Created volume successfully. Aug 05 10:21:23 devstack sudo[98400]: pam_unix(sudo:session): session closed for user root Aug 05 10:21:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3fd3f5bd-ac6d-4a5a-a14b-3e82bc493993 tempest-VolumeQuotasNegativeTestJSON-1284939560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3a0898bd-52da-4134-9e39-ffae54be265d" returned: 0 in 0.478s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:21:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3fd3f5bd-ac6d-4a5a-a14b-3e82bc493993 tempest-VolumeQuotasNegativeTestJSON-1284939560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3a0898bd-52da-4134-9e39-ffae54be265d {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:21:23 devstack sudo[98405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3a0898bd-52da-4134-9e39-ffae54be265d Aug 05 10:21:23 devstack sudo[98405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:21:24 devstack sudo[98405]: pam_unix(sudo:session): session closed for user root Aug 05 10:21:24 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3fd3f5bd-ac6d-4a5a-a14b-3e82bc493993 tempest-VolumeQuotasNegativeTestJSON-1284939560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3a0898bd-52da-4134-9e39-ffae54be265d" returned: 0 in 0.400s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:21:24 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-3fd3f5bd-ac6d-4a5a-a14b-3e82bc493993 tempest-VolumeQuotasNegativeTestJSON-1284939560 None] Lock "cinder-quobyte-3a0898bd-52da-4134-9e39-ffae54be265d" released by "delete_volume" :: held 0.974s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:21:24 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-3fd3f5bd-ac6d-4a5a-a14b-3e82bc493993 tempest-VolumeQuotasNegativeTestJSON-1284939560 None] Created reservations ['8a55dccf-bd40-4920-b02b-5ad557c2a723', '23b6d377-20f6-494d-817f-1f76b69c7383', 'a5c841d6-39d9-45eb-b7f7-eace0ba31d84', 'ca5dcd76-d4ca-4ae3-8fd1-a7071b3293c8'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:21:24 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-3fd3f5bd-ac6d-4a5a-a14b-3e82bc493993 tempest-VolumeQuotasNegativeTestJSON-1284939560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:21:24 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-3fd3f5bd-ac6d-4a5a-a14b-3e82bc493993 tempest-VolumeQuotasNegativeTestJSON-1284939560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:21:24 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-3fd3f5bd-ac6d-4a5a-a14b-3e82bc493993 tempest-VolumeQuotasNegativeTestJSON-1284939560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:21:24 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-3fd3f5bd-ac6d-4a5a-a14b-3e82bc493993 tempest-VolumeQuotasNegativeTestJSON-1284939560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:21:24 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-3fd3f5bd-ac6d-4a5a-a14b-3e82bc493993 tempest-VolumeQuotasNegativeTestJSON-1284939560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:21:24 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3fd3f5bd-ac6d-4a5a-a14b-3e82bc493993 tempest-VolumeQuotasNegativeTestJSON-1284939560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:21:24 devstack sudo[98411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:21:24 devstack sudo[98411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:21:25 devstack sudo[98411]: pam_unix(sudo:session): session closed for user root Aug 05 10:21:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3fd3f5bd-ac6d-4a5a-a14b-3e82bc493993 tempest-VolumeQuotasNegativeTestJSON-1284939560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.599s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:21:25 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-3fd3f5bd-ac6d-4a5a-a14b-3e82bc493993 tempest-VolumeQuotasNegativeTestJSON-1284939560 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:21:25 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-3fd3f5bd-ac6d-4a5a-a14b-3e82bc493993 tempest-VolumeQuotasNegativeTestJSON-1284939560 None] Deleted volume successfully. Aug 05 10:21:25 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-3fd3f5bd-ac6d-4a5a-a14b-3e82bc493993 tempest-VolumeQuotasNegativeTestJSON-1284939560 None] Lock "cinder-3a0898bd-52da-4134-9e39-ffae54be265d-delete_volume" released by "delete_volume" :: held 2.066s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:21:25 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-fc8918af-60a5-4b91-9109-52290ec72e46 tempest-VolumeQuotasAdminTestJSON-343828543 None] Transfer volume completed successfully. Aug 05 10:21:26 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-ba77e899-a253-403e-bff4-8f73b9f8fe20 tempest-VolumeQuotasAdminTestJSON-851368391 None] Acquiring lock "cinder-a8b00594-ebe4-4360-9f70-07746f61bb7e-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:21:26 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-ba77e899-a253-403e-bff4-8f73b9f8fe20 tempest-VolumeQuotasAdminTestJSON-851368391 None] Lock "cinder-a8b00594-ebe4-4360-9f70-07746f61bb7e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:21:26 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-ba77e899-a253-403e-bff4-8f73b9f8fe20 tempest-VolumeQuotasAdminTestJSON-851368391 None] Acquiring lock "cinder-quobyte-a8b00594-ebe4-4360-9f70-07746f61bb7e" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:21:26 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-ba77e899-a253-403e-bff4-8f73b9f8fe20 tempest-VolumeQuotasAdminTestJSON-851368391 None] Lock "cinder-quobyte-a8b00594-ebe4-4360-9f70-07746f61bb7e" acquired by "delete_volume" :: waited 0.021s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:21:26 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[53be643d-6cba-4ee7-b754-3453321d4ddd]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:21:26 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ba77e899-a253-403e-bff4-8f73b9f8fe20 tempest-VolumeQuotasAdminTestJSON-851368391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a8b00594-ebe4-4360-9f70-07746f61bb7e {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:21:26 devstack sudo[98496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a8b00594-ebe4-4360-9f70-07746f61bb7e Aug 05 10:21:26 devstack sudo[98496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:21:27 devstack sudo[98496]: pam_unix(sudo:session): session closed for user root Aug 05 10:21:27 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ba77e899-a253-403e-bff4-8f73b9f8fe20 tempest-VolumeQuotasAdminTestJSON-851368391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a8b00594-ebe4-4360-9f70-07746f61bb7e" returned: 0 in 0.713s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:21:27 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ba77e899-a253-403e-bff4-8f73b9f8fe20 tempest-VolumeQuotasAdminTestJSON-851368391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a8b00594-ebe4-4360-9f70-07746f61bb7e {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:21:27 devstack sudo[98523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a8b00594-ebe4-4360-9f70-07746f61bb7e Aug 05 10:21:27 devstack sudo[98523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:21:27 devstack sudo[98523]: pam_unix(sudo:session): session closed for user root Aug 05 10:21:27 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ba77e899-a253-403e-bff4-8f73b9f8fe20 tempest-VolumeQuotasAdminTestJSON-851368391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a8b00594-ebe4-4360-9f70-07746f61bb7e" returned: 0 in 0.367s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:21:27 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-ba77e899-a253-403e-bff4-8f73b9f8fe20 tempest-VolumeQuotasAdminTestJSON-851368391 None] Lock "cinder-quobyte-a8b00594-ebe4-4360-9f70-07746f61bb7e" released by "delete_volume" :: held 1.213s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:21:27 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-ba77e899-a253-403e-bff4-8f73b9f8fe20 tempest-VolumeQuotasAdminTestJSON-851368391 None] Created reservations ['2277e842-b5e3-45e2-af9c-b0ac066c4d40', '5cefce05-8bc8-4c6f-b810-a0163bcde987', 'd397c719-501c-4d9d-938a-73fc65e8f81d', '1d07a2f5-b5df-49e5-9f01-bf0721335388'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:21:27 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-ba77e899-a253-403e-bff4-8f73b9f8fe20 tempest-VolumeQuotasAdminTestJSON-851368391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:21:27 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-ba77e899-a253-403e-bff4-8f73b9f8fe20 tempest-VolumeQuotasAdminTestJSON-851368391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:21:27 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-ba77e899-a253-403e-bff4-8f73b9f8fe20 tempest-VolumeQuotasAdminTestJSON-851368391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:21:27 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-ba77e899-a253-403e-bff4-8f73b9f8fe20 tempest-VolumeQuotasAdminTestJSON-851368391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:21:27 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-ba77e899-a253-403e-bff4-8f73b9f8fe20 tempest-VolumeQuotasAdminTestJSON-851368391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:21:27 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ba77e899-a253-403e-bff4-8f73b9f8fe20 tempest-VolumeQuotasAdminTestJSON-851368391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:21:27 devstack sudo[98527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:21:27 devstack sudo[98527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:21:28 devstack sudo[98527]: pam_unix(sudo:session): session closed for user root Aug 05 10:21:28 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ba77e899-a253-403e-bff4-8f73b9f8fe20 tempest-VolumeQuotasAdminTestJSON-851368391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.457s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:21:28 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-ba77e899-a253-403e-bff4-8f73b9f8fe20 tempest-VolumeQuotasAdminTestJSON-851368391 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:21:28 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-ba77e899-a253-403e-bff4-8f73b9f8fe20 tempest-VolumeQuotasAdminTestJSON-851368391 None] Deleted volume successfully. Aug 05 10:21:28 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-ba77e899-a253-403e-bff4-8f73b9f8fe20 tempest-VolumeQuotasAdminTestJSON-851368391 None] Lock "cinder-a8b00594-ebe4-4360-9f70-07746f61bb7e-delete_volume" released by "delete_volume" :: held 2.055s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:21:28 devstack cinder-volume[88613]: INFO cinder.volume.manager [req-5bd93c09-5adc-4548-9ff5-43da56efcd00 req-cdd3a88a-3030-461d-b61c-4b78a33deb74 tempest-TestInstancesWithCinderVolumes-1602349945 None] Terminate volume connection completed successfully. Aug 05 10:21:28 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [req-5bd93c09-5adc-4548-9ff5-43da56efcd00 req-cdd3a88a-3030-461d-b61c-4b78a33deb74 tempest-TestInstancesWithCinderVolumes-1602349945 None] Deleting attachment f00a2e3d-c805-433d-b67e-c6928c781053. {{(pid=88613) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 10:21:31 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-c39baff3-b460-4662-8e0b-f87f4a4a2b58 tempest-TestInstancesWithCinderVolumes-1602349945 None] Acquiring lock "cinder-ba3e0006-8d42-4334-a04d-74e5aa13cde8-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:21:31 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-c39baff3-b460-4662-8e0b-f87f4a4a2b58 tempest-TestInstancesWithCinderVolumes-1602349945 None] Lock "cinder-ba3e0006-8d42-4334-a04d-74e5aa13cde8-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:21:31 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-c39baff3-b460-4662-8e0b-f87f4a4a2b58 tempest-TestInstancesWithCinderVolumes-1602349945 None] Acquiring lock "cinder-quobyte-ba3e0006-8d42-4334-a04d-74e5aa13cde8" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:21:31 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-c39baff3-b460-4662-8e0b-f87f4a4a2b58 tempest-TestInstancesWithCinderVolumes-1602349945 None] Lock "cinder-quobyte-ba3e0006-8d42-4334-a04d-74e5aa13cde8" acquired by "delete_volume" :: waited 0.024s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:21:31 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[6028a808-2b1b-4099-a6bb-82f3bdbb007b]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:21:31 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c39baff3-b460-4662-8e0b-f87f4a4a2b58 tempest-TestInstancesWithCinderVolumes-1602349945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ba3e0006-8d42-4334-a04d-74e5aa13cde8 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:21:31 devstack sudo[98545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ba3e0006-8d42-4334-a04d-74e5aa13cde8 Aug 05 10:21:31 devstack sudo[98545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:21:32 devstack sudo[98545]: pam_unix(sudo:session): session closed for user root Aug 05 10:21:32 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c39baff3-b460-4662-8e0b-f87f4a4a2b58 tempest-TestInstancesWithCinderVolumes-1602349945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ba3e0006-8d42-4334-a04d-74e5aa13cde8" returned: 0 in 0.541s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:21:32 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c39baff3-b460-4662-8e0b-f87f4a4a2b58 tempest-TestInstancesWithCinderVolumes-1602349945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ba3e0006-8d42-4334-a04d-74e5aa13cde8 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:21:32 devstack sudo[98551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ba3e0006-8d42-4334-a04d-74e5aa13cde8 Aug 05 10:21:32 devstack sudo[98551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:21:32 devstack sudo[98551]: pam_unix(sudo:session): session closed for user root Aug 05 10:21:32 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c39baff3-b460-4662-8e0b-f87f4a4a2b58 tempest-TestInstancesWithCinderVolumes-1602349945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ba3e0006-8d42-4334-a04d-74e5aa13cde8" returned: 0 in 0.341s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:21:32 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-c39baff3-b460-4662-8e0b-f87f4a4a2b58 tempest-TestInstancesWithCinderVolumes-1602349945 None] Lock "cinder-quobyte-ba3e0006-8d42-4334-a04d-74e5aa13cde8" released by "delete_volume" :: held 0.958s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:21:32 devstack cinder-volume[88613]: WARNING cinder.quota [None req-c39baff3-b460-4662-8e0b-f87f4a4a2b58 tempest-TestInstancesWithCinderVolumes-1602349945 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-300864293-1307209585 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-300864293-1307209585, it is now deprecated. Please use the default quota class for default quota. Aug 05 10:21:32 devstack cinder-volume[88613]: WARNING cinder.quota [None req-c39baff3-b460-4662-8e0b-f87f4a4a2b58 tempest-TestInstancesWithCinderVolumes-1602349945 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-300864293-1307209585 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-300864293-1307209585, it is now deprecated. Please use the default quota class for default quota. Aug 05 10:21:32 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-c39baff3-b460-4662-8e0b-f87f4a4a2b58 tempest-TestInstancesWithCinderVolumes-1602349945 None] Created reservations ['7133d7ca-08bf-4b9d-aaab-5d3d069fb5ad', '01d3f11f-9df2-46a0-b60f-ce9456b7b5c7', 'ddb51ff5-768f-40c8-8255-6577cc9ea120', 'c39eb1a7-fbb6-439a-9e88-9aed57527790'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:21:32 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c39baff3-b460-4662-8e0b-f87f4a4a2b58 tempest-TestInstancesWithCinderVolumes-1602349945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:21:32 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c39baff3-b460-4662-8e0b-f87f4a4a2b58 tempest-TestInstancesWithCinderVolumes-1602349945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:21:32 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-c39baff3-b460-4662-8e0b-f87f4a4a2b58 tempest-TestInstancesWithCinderVolumes-1602349945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:21:32 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-c39baff3-b460-4662-8e0b-f87f4a4a2b58 tempest-TestInstancesWithCinderVolumes-1602349945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:21:32 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c39baff3-b460-4662-8e0b-f87f4a4a2b58 tempest-TestInstancesWithCinderVolumes-1602349945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:21:32 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c39baff3-b460-4662-8e0b-f87f4a4a2b58 tempest-TestInstancesWithCinderVolumes-1602349945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:21:32 devstack sudo[98554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:21:32 devstack sudo[98554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:21:33 devstack sudo[98554]: pam_unix(sudo:session): session closed for user root Aug 05 10:21:33 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c39baff3-b460-4662-8e0b-f87f4a4a2b58 tempest-TestInstancesWithCinderVolumes-1602349945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.408s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:21:33 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-c39baff3-b460-4662-8e0b-f87f4a4a2b58 tempest-TestInstancesWithCinderVolumes-1602349945 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:21:33 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-c39baff3-b460-4662-8e0b-f87f4a4a2b58 tempest-TestInstancesWithCinderVolumes-1602349945 None] Deleted volume successfully. Aug 05 10:21:33 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-c39baff3-b460-4662-8e0b-f87f4a4a2b58 tempest-TestInstancesWithCinderVolumes-1602349945 None] Lock "cinder-ba3e0006-8d42-4334-a04d-74e5aa13cde8-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:21:34 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-667c2e9e-756e-41ff-bae8-f76cecdabae0 tempest-VolumesServicesTestJSON-111881916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:21:34 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-667c2e9e-756e-41ff-bae8-f76cecdabae0 tempest-VolumesServicesTestJSON-111881916 None] Flow 'volume_create_manager' (00ef4af1-92bc-4c2a-94fa-6b58f8f5b139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:21:34 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-667c2e9e-756e-41ff-bae8-f76cecdabae0 tempest-VolumesServicesTestJSON-111881916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7ba314c-b4c1-4a2a-a2d8-e0a6e6673ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:21:34 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-667c2e9e-756e-41ff-bae8-f76cecdabae0 tempest-VolumesServicesTestJSON-111881916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7ba314c-b4c1-4a2a-a2d8-e0a6e6673ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:21:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-903132155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66f2604f-e340-4f15-8d00-695a41c8a40c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8af4ee6a863f42bfa6dcd70828bfea3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:21:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:21:34Z,use_quota=True,user_id='1be1cc4bae1b465d85fa8251bff75237',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:21:34 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-667c2e9e-756e-41ff-bae8-f76cecdabae0 tempest-VolumesServicesTestJSON-111881916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f6b4157-9ab8-44bd-988c-15b7505193ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:21:34 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-667c2e9e-756e-41ff-bae8-f76cecdabae0 tempest-VolumesServicesTestJSON-111881916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f6b4157-9ab8-44bd-988c-15b7505193ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:21:34 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-667c2e9e-756e-41ff-bae8-f76cecdabae0 tempest-VolumesServicesTestJSON-111881916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d47c0c1c-b526-422a-b27c-5c4d83c5cecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:21:34 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-667c2e9e-756e-41ff-bae8-f76cecdabae0 tempest-VolumesServicesTestJSON-111881916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d47c0c1c-b526-422a-b27c-5c4d83c5cecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66f2604f-e340-4f15-8d00-695a41c8a40c', 'volume_name': 'volume-66f2604f-e340-4f15-8d00-695a41c8a40c', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:21:34 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-667c2e9e-756e-41ff-bae8-f76cecdabae0 tempest-VolumesServicesTestJSON-111881916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e78625a-54fc-4701-999d-462a6fc7a878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:21:34 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-667c2e9e-756e-41ff-bae8-f76cecdabae0 tempest-VolumesServicesTestJSON-111881916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e78625a-54fc-4701-999d-462a6fc7a878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:21:34 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-667c2e9e-756e-41ff-bae8-f76cecdabae0 tempest-VolumesServicesTestJSON-111881916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5577d96c-9800-43a0-b5e7-a44557c69e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:21:34 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-667c2e9e-756e-41ff-bae8-f76cecdabae0 tempest-VolumesServicesTestJSON-111881916 None] Volume 66f2604f-e340-4f15-8d00-695a41c8a40c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66f2604f-e340-4f15-8d00-695a41c8a40c', 'volume_size': 1} Aug 05 10:21:34 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-667c2e9e-756e-41ff-bae8-f76cecdabae0 tempest-VolumesServicesTestJSON-111881916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:21:34 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-667c2e9e-756e-41ff-bae8-f76cecdabae0 tempest-VolumesServicesTestJSON-111881916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:21:34 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-667c2e9e-756e-41ff-bae8-f76cecdabae0 tempest-VolumesServicesTestJSON-111881916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:21:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-903132155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66f2604f-e340-4f15-8d00-695a41c8a40c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8af4ee6a863f42bfa6dcd70828bfea3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:21:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:21:34Z,use_quota=True,user_id='1be1cc4bae1b465d85fa8251bff75237',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:21:34 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-667c2e9e-756e-41ff-bae8-f76cecdabae0 tempest-VolumesServicesTestJSON-111881916 None] Creating volume 66f2604f-e340-4f15-8d00-695a41c8a40c {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:21:34 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-667c2e9e-756e-41ff-bae8-f76cecdabae0 tempest-VolumesServicesTestJSON-111881916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:21:34 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-667c2e9e-756e-41ff-bae8-f76cecdabae0 tempest-VolumesServicesTestJSON-111881916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:21:34 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-667c2e9e-756e-41ff-bae8-f76cecdabae0 tempest-VolumesServicesTestJSON-111881916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:21:34 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-667c2e9e-756e-41ff-bae8-f76cecdabae0 tempest-VolumesServicesTestJSON-111881916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:21:34 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-667c2e9e-756e-41ff-bae8-f76cecdabae0 tempest-VolumesServicesTestJSON-111881916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:21:34 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-667c2e9e-756e-41ff-bae8-f76cecdabae0 tempest-VolumesServicesTestJSON-111881916 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:21:34 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-667c2e9e-756e-41ff-bae8-f76cecdabae0 tempest-VolumesServicesTestJSON-111881916 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:21:34 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-667c2e9e-756e-41ff-bae8-f76cecdabae0 tempest-VolumesServicesTestJSON-111881916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-66f2604f-e340-4f15-8d00-695a41c8a40c 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:21:34 devstack sudo[98558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-66f2604f-e340-4f15-8d00-695a41c8a40c 1073741824 Aug 05 10:21:34 devstack sudo[98558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:21:35 devstack sudo[98558]: pam_unix(sudo:session): session closed for user root Aug 05 10:21:35 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-667c2e9e-756e-41ff-bae8-f76cecdabae0 tempest-VolumesServicesTestJSON-111881916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-66f2604f-e340-4f15-8d00-695a41c8a40c 1073741824" returned: 0 in 0.574s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:21:35 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-667c2e9e-756e-41ff-bae8-f76cecdabae0 tempest-VolumesServicesTestJSON-111881916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-66f2604f-e340-4f15-8d00-695a41c8a40c {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:21:35 devstack sudo[98564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-66f2604f-e340-4f15-8d00-695a41c8a40c Aug 05 10:21:35 devstack sudo[98564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:21:35 devstack sudo[98564]: pam_unix(sudo:session): session closed for user root Aug 05 10:21:35 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-667c2e9e-756e-41ff-bae8-f76cecdabae0 tempest-VolumesServicesTestJSON-111881916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-66f2604f-e340-4f15-8d00-695a41c8a40c" returned: 0 in 0.346s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:21:35 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-667c2e9e-756e-41ff-bae8-f76cecdabae0 tempest-VolumesServicesTestJSON-111881916 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:21:35 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-667c2e9e-756e-41ff-bae8-f76cecdabae0 tempest-VolumesServicesTestJSON-111881916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:21:35 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-667c2e9e-756e-41ff-bae8-f76cecdabae0 tempest-VolumesServicesTestJSON-111881916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5577d96c-9800-43a0-b5e7-a44557c69e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66f2604f-e340-4f15-8d00-695a41c8a40c', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:21:35 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-667c2e9e-756e-41ff-bae8-f76cecdabae0 tempest-VolumesServicesTestJSON-111881916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02e4c9c8-d70a-4690-980e-6e0b35874e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:21:35 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-667c2e9e-756e-41ff-bae8-f76cecdabae0 tempest-VolumesServicesTestJSON-111881916 None] Volume volume-66f2604f-e340-4f15-8d00-695a41c8a40c (66f2604f-e340-4f15-8d00-695a41c8a40c): created successfully Aug 05 10:21:35 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-667c2e9e-756e-41ff-bae8-f76cecdabae0 tempest-VolumesServicesTestJSON-111881916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02e4c9c8-d70a-4690-980e-6e0b35874e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:21:35 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-667c2e9e-756e-41ff-bae8-f76cecdabae0 tempest-VolumesServicesTestJSON-111881916 None] Flow 'volume_create_manager' (00ef4af1-92bc-4c2a-94fa-6b58f8f5b139) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:21:35 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-667c2e9e-756e-41ff-bae8-f76cecdabae0 tempest-VolumesServicesTestJSON-111881916 None] Created volume successfully. Aug 05 10:21:36 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-b0927172-9c94-4851-9d0b-e72538f8429d tempest-VolumesServicesTestJSON-111881916 None] Acquiring lock "cinder-66f2604f-e340-4f15-8d00-695a41c8a40c-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:21:36 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-b0927172-9c94-4851-9d0b-e72538f8429d tempest-VolumesServicesTestJSON-111881916 None] Lock "cinder-66f2604f-e340-4f15-8d00-695a41c8a40c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:21:37 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-b0927172-9c94-4851-9d0b-e72538f8429d tempest-VolumesServicesTestJSON-111881916 None] Acquiring lock "cinder-quobyte-66f2604f-e340-4f15-8d00-695a41c8a40c" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:21:37 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-b0927172-9c94-4851-9d0b-e72538f8429d tempest-VolumesServicesTestJSON-111881916 None] Lock "cinder-quobyte-66f2604f-e340-4f15-8d00-695a41c8a40c" acquired by "delete_volume" :: waited 0.031s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:21:37 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[d46a3ab2-ccc1-4837-b022-02bc14dc4357]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:21:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b0927172-9c94-4851-9d0b-e72538f8429d tempest-VolumesServicesTestJSON-111881916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-66f2604f-e340-4f15-8d00-695a41c8a40c {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:21:37 devstack sudo[98570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-66f2604f-e340-4f15-8d00-695a41c8a40c Aug 05 10:21:37 devstack sudo[98570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:21:37 devstack sudo[98570]: pam_unix(sudo:session): session closed for user root Aug 05 10:21:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b0927172-9c94-4851-9d0b-e72538f8429d tempest-VolumesServicesTestJSON-111881916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-66f2604f-e340-4f15-8d00-695a41c8a40c" returned: 0 in 0.505s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:21:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b0927172-9c94-4851-9d0b-e72538f8429d tempest-VolumesServicesTestJSON-111881916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-66f2604f-e340-4f15-8d00-695a41c8a40c {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:21:37 devstack sudo[98575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-66f2604f-e340-4f15-8d00-695a41c8a40c Aug 05 10:21:37 devstack sudo[98575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:21:38 devstack sudo[98575]: pam_unix(sudo:session): session closed for user root Aug 05 10:21:38 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b0927172-9c94-4851-9d0b-e72538f8429d tempest-VolumesServicesTestJSON-111881916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-66f2604f-e340-4f15-8d00-695a41c8a40c" returned: 0 in 0.411s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:21:38 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-b0927172-9c94-4851-9d0b-e72538f8429d tempest-VolumesServicesTestJSON-111881916 None] Lock "cinder-quobyte-66f2604f-e340-4f15-8d00-695a41c8a40c" released by "delete_volume" :: held 0.992s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:21:38 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-b0927172-9c94-4851-9d0b-e72538f8429d tempest-VolumesServicesTestJSON-111881916 None] Created reservations ['8a7039ab-c874-4825-8776-c1d6cb806418', 'd00216c8-7d56-4e71-a944-145b6babbeab', '63df7341-b022-4ad2-a83d-483286f55413', '9e229d8f-704b-4e5d-a066-0fb20b8b9c60'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:21:38 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-b0927172-9c94-4851-9d0b-e72538f8429d tempest-VolumesServicesTestJSON-111881916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:21:38 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-b0927172-9c94-4851-9d0b-e72538f8429d tempest-VolumesServicesTestJSON-111881916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:21:38 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-b0927172-9c94-4851-9d0b-e72538f8429d tempest-VolumesServicesTestJSON-111881916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:21:38 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-b0927172-9c94-4851-9d0b-e72538f8429d tempest-VolumesServicesTestJSON-111881916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:21:38 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-b0927172-9c94-4851-9d0b-e72538f8429d tempest-VolumesServicesTestJSON-111881916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:21:38 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b0927172-9c94-4851-9d0b-e72538f8429d tempest-VolumesServicesTestJSON-111881916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:21:38 devstack sudo[98578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:21:38 devstack sudo[98578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:21:38 devstack sudo[98578]: pam_unix(sudo:session): session closed for user root Aug 05 10:21:38 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b0927172-9c94-4851-9d0b-e72538f8429d tempest-VolumesServicesTestJSON-111881916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.289s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:21:38 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-b0927172-9c94-4851-9d0b-e72538f8429d tempest-VolumesServicesTestJSON-111881916 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:21:38 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-b0927172-9c94-4851-9d0b-e72538f8429d tempest-VolumesServicesTestJSON-111881916 None] Deleted volume successfully. Aug 05 10:21:38 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-b0927172-9c94-4851-9d0b-e72538f8429d tempest-VolumesServicesTestJSON-111881916 None] Lock "cinder-66f2604f-e340-4f15-8d00-695a41c8a40c-delete_volume" released by "delete_volume" :: held 1.816s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:21:48 devstack cinder-volume[88613]: DEBUG dbcounter [-] [88613] Writing DB stats cinder:UPDATE=92,cinder:SELECT=84,cinder:INSERT=22,cinder:DELETE=8 {{(pid=88613) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:21:48 devstack cinder-volume[88613]: DEBUG dbcounter [-] [88613] Writing DB stats cinder:INSERT=21,cinder:UPDATE=95,cinder:SELECT=80,cinder:DELETE=4 {{(pid=88613) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:21:55 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-77fca2c0-0089-4841-afab-e22f28c20521 tempest-AttachVolumeShelveTestJSON-1141396775 None] Acquiring lock "cinder-fb0d1c47-7f21-41f9-bdcc-592888fbbf36-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:21:55 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-77fca2c0-0089-4841-afab-e22f28c20521 tempest-AttachVolumeShelveTestJSON-1141396775 None] Lock "cinder-fb0d1c47-7f21-41f9-bdcc-592888fbbf36-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:21:55 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-77fca2c0-0089-4841-afab-e22f28c20521 tempest-AttachVolumeShelveTestJSON-1141396775 None] Acquiring lock "cinder-quobyte-fb0d1c47-7f21-41f9-bdcc-592888fbbf36" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:21:56 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-77fca2c0-0089-4841-afab-e22f28c20521 tempest-AttachVolumeShelveTestJSON-1141396775 None] Lock "cinder-quobyte-fb0d1c47-7f21-41f9-bdcc-592888fbbf36" acquired by "delete_volume" :: waited 0.034s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:21:56 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[9097d7f4-b4a0-4864-9be1-2087c75f0138]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:21:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-77fca2c0-0089-4841-afab-e22f28c20521 tempest-AttachVolumeShelveTestJSON-1141396775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-fb0d1c47-7f21-41f9-bdcc-592888fbbf36 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:21:56 devstack sudo[98667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-fb0d1c47-7f21-41f9-bdcc-592888fbbf36 Aug 05 10:21:56 devstack sudo[98667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:21:56 devstack sudo[98667]: pam_unix(sudo:session): session closed for user root Aug 05 10:21:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-77fca2c0-0089-4841-afab-e22f28c20521 tempest-AttachVolumeShelveTestJSON-1141396775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-fb0d1c47-7f21-41f9-bdcc-592888fbbf36" returned: 0 in 0.568s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:21:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-77fca2c0-0089-4841-afab-e22f28c20521 tempest-AttachVolumeShelveTestJSON-1141396775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-fb0d1c47-7f21-41f9-bdcc-592888fbbf36 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:21:56 devstack sudo[98672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-fb0d1c47-7f21-41f9-bdcc-592888fbbf36 Aug 05 10:21:56 devstack sudo[98672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:21:56 devstack sudo[98672]: pam_unix(sudo:session): session closed for user root Aug 05 10:21:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-77fca2c0-0089-4841-afab-e22f28c20521 tempest-AttachVolumeShelveTestJSON-1141396775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-fb0d1c47-7f21-41f9-bdcc-592888fbbf36" returned: 0 in 0.374s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:21:57 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-77fca2c0-0089-4841-afab-e22f28c20521 tempest-AttachVolumeShelveTestJSON-1141396775 None] Lock "cinder-quobyte-fb0d1c47-7f21-41f9-bdcc-592888fbbf36" released by "delete_volume" :: held 1.008s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:21:57 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-77fca2c0-0089-4841-afab-e22f28c20521 tempest-AttachVolumeShelveTestJSON-1141396775 None] Created reservations ['57160d94-6a87-4555-b8e7-533cc30d88ef', '5fc0ab9d-0fb5-4e30-aa4c-2cd58d8a03f8', '4182d610-9054-4259-979e-2f5a1106d6bd', '56d5b477-c4cd-4873-ae22-e176e0e936f9'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:21:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-77fca2c0-0089-4841-afab-e22f28c20521 tempest-AttachVolumeShelveTestJSON-1141396775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:21:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-77fca2c0-0089-4841-afab-e22f28c20521 tempest-AttachVolumeShelveTestJSON-1141396775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:21:57 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-77fca2c0-0089-4841-afab-e22f28c20521 tempest-AttachVolumeShelveTestJSON-1141396775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:21:57 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-77fca2c0-0089-4841-afab-e22f28c20521 tempest-AttachVolumeShelveTestJSON-1141396775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:21:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-77fca2c0-0089-4841-afab-e22f28c20521 tempest-AttachVolumeShelveTestJSON-1141396775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:21:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-77fca2c0-0089-4841-afab-e22f28c20521 tempest-AttachVolumeShelveTestJSON-1141396775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:21:57 devstack sudo[98675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:21:57 devstack sudo[98675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:21:57 devstack sudo[98675]: pam_unix(sudo:session): session closed for user root Aug 05 10:21:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-77fca2c0-0089-4841-afab-e22f28c20521 tempest-AttachVolumeShelveTestJSON-1141396775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.369s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:21:57 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-77fca2c0-0089-4841-afab-e22f28c20521 tempest-AttachVolumeShelveTestJSON-1141396775 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:21:57 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-77fca2c0-0089-4841-afab-e22f28c20521 tempest-AttachVolumeShelveTestJSON-1141396775 None] Deleted volume successfully. Aug 05 10:21:57 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-77fca2c0-0089-4841-afab-e22f28c20521 tempest-AttachVolumeShelveTestJSON-1141396775 None] Lock "cinder-fb0d1c47-7f21-41f9-bdcc-592888fbbf36-delete_volume" released by "delete_volume" :: held 1.730s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:22:05 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee040508-aa8a-49ba-880b-b90c5679476d tempest-VolumesListAdminTestJSON-2061557699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:22:05 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ee040508-aa8a-49ba-880b-b90c5679476d tempest-VolumesListAdminTestJSON-2061557699 None] Flow 'volume_create_manager' (ac04ca49-a313-438e-974b-a11e562aea8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:22:05 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ee040508-aa8a-49ba-880b-b90c5679476d tempest-VolumesListAdminTestJSON-2061557699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f767db3e-d66e-489c-89dd-1cbbfc294e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:22:05 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ee040508-aa8a-49ba-880b-b90c5679476d tempest-VolumesListAdminTestJSON-2061557699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f767db3e-d66e-489c-89dd-1cbbfc294e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:22:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1200052354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7081b18e-2680-440d-b0e1-b0cb25e77547,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40e6cc8ed8704dacbb9f588ae044ac55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:22:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:22:06Z,use_quota=True,user_id='05d7e5b093624137a6c1a578c363fb32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:22:05 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ee040508-aa8a-49ba-880b-b90c5679476d tempest-VolumesListAdminTestJSON-2061557699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43dd2e97-a52a-4d02-b122-95ee52408c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:22:05 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ee040508-aa8a-49ba-880b-b90c5679476d tempest-VolumesListAdminTestJSON-2061557699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43dd2e97-a52a-4d02-b122-95ee52408c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:22:05 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ee040508-aa8a-49ba-880b-b90c5679476d tempest-VolumesListAdminTestJSON-2061557699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (321da34a-653e-4974-ac10-8155da21a132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:22:05 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ee040508-aa8a-49ba-880b-b90c5679476d tempest-VolumesListAdminTestJSON-2061557699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (321da34a-653e-4974-ac10-8155da21a132) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7081b18e-2680-440d-b0e1-b0cb25e77547', 'volume_name': 'volume-7081b18e-2680-440d-b0e1-b0cb25e77547', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:22:05 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ee040508-aa8a-49ba-880b-b90c5679476d tempest-VolumesListAdminTestJSON-2061557699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a98a2ef7-8404-4ec0-a475-4241c26d41a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:22:05 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ee040508-aa8a-49ba-880b-b90c5679476d tempest-VolumesListAdminTestJSON-2061557699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a98a2ef7-8404-4ec0-a475-4241c26d41a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:22:05 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ee040508-aa8a-49ba-880b-b90c5679476d tempest-VolumesListAdminTestJSON-2061557699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a836bd8d-bc67-4353-b88c-3b86e5abca1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:22:05 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-ee040508-aa8a-49ba-880b-b90c5679476d tempest-VolumesListAdminTestJSON-2061557699 None] Volume 7081b18e-2680-440d-b0e1-b0cb25e77547: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7081b18e-2680-440d-b0e1-b0cb25e77547', 'volume_size': 1} Aug 05 10:22:05 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-ee040508-aa8a-49ba-880b-b90c5679476d tempest-VolumesListAdminTestJSON-2061557699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:22:05 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-ee040508-aa8a-49ba-880b-b90c5679476d tempest-VolumesListAdminTestJSON-2061557699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:22:05 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-ee040508-aa8a-49ba-880b-b90c5679476d tempest-VolumesListAdminTestJSON-2061557699 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:22:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1200052354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7081b18e-2680-440d-b0e1-b0cb25e77547,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40e6cc8ed8704dacbb9f588ae044ac55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:22:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:22:06Z,use_quota=True,user_id='05d7e5b093624137a6c1a578c363fb32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:22:05 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-ee040508-aa8a-49ba-880b-b90c5679476d tempest-VolumesListAdminTestJSON-2061557699 None] Creating volume 7081b18e-2680-440d-b0e1-b0cb25e77547 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:22:05 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-ee040508-aa8a-49ba-880b-b90c5679476d tempest-VolumesListAdminTestJSON-2061557699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:22:05 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-ee040508-aa8a-49ba-880b-b90c5679476d tempest-VolumesListAdminTestJSON-2061557699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:22:05 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-ee040508-aa8a-49ba-880b-b90c5679476d tempest-VolumesListAdminTestJSON-2061557699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:22:05 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-ee040508-aa8a-49ba-880b-b90c5679476d tempest-VolumesListAdminTestJSON-2061557699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:22:05 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-ee040508-aa8a-49ba-880b-b90c5679476d tempest-VolumesListAdminTestJSON-2061557699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:22:05 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-ee040508-aa8a-49ba-880b-b90c5679476d tempest-VolumesListAdminTestJSON-2061557699 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:22:05 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-ee040508-aa8a-49ba-880b-b90c5679476d tempest-VolumesListAdminTestJSON-2061557699 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:22:05 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ee040508-aa8a-49ba-880b-b90c5679476d tempest-VolumesListAdminTestJSON-2061557699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7081b18e-2680-440d-b0e1-b0cb25e77547 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:22:05 devstack sudo[98682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7081b18e-2680-440d-b0e1-b0cb25e77547 1073741824 Aug 05 10:22:05 devstack sudo[98682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:22:06 devstack sudo[98682]: pam_unix(sudo:session): session closed for user root Aug 05 10:22:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ee040508-aa8a-49ba-880b-b90c5679476d tempest-VolumesListAdminTestJSON-2061557699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7081b18e-2680-440d-b0e1-b0cb25e77547 1073741824" returned: 0 in 0.703s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:22:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ee040508-aa8a-49ba-880b-b90c5679476d tempest-VolumesListAdminTestJSON-2061557699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7081b18e-2680-440d-b0e1-b0cb25e77547 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:22:06 devstack sudo[98688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7081b18e-2680-440d-b0e1-b0cb25e77547 Aug 05 10:22:06 devstack sudo[98688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:22:06 devstack sudo[98688]: pam_unix(sudo:session): session closed for user root Aug 05 10:22:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ee040508-aa8a-49ba-880b-b90c5679476d tempest-VolumesListAdminTestJSON-2061557699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7081b18e-2680-440d-b0e1-b0cb25e77547" returned: 0 in 0.289s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:22:06 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-ee040508-aa8a-49ba-880b-b90c5679476d tempest-VolumesListAdminTestJSON-2061557699 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:22:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-ee040508-aa8a-49ba-880b-b90c5679476d tempest-VolumesListAdminTestJSON-2061557699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:22:06 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ee040508-aa8a-49ba-880b-b90c5679476d tempest-VolumesListAdminTestJSON-2061557699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a836bd8d-bc67-4353-b88c-3b86e5abca1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7081b18e-2680-440d-b0e1-b0cb25e77547', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:22:06 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ee040508-aa8a-49ba-880b-b90c5679476d tempest-VolumesListAdminTestJSON-2061557699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70a73cb7-f2a7-4374-8be5-974d39adfd15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:22:06 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-ee040508-aa8a-49ba-880b-b90c5679476d tempest-VolumesListAdminTestJSON-2061557699 None] Volume volume-7081b18e-2680-440d-b0e1-b0cb25e77547 (7081b18e-2680-440d-b0e1-b0cb25e77547): created successfully Aug 05 10:22:06 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ee040508-aa8a-49ba-880b-b90c5679476d tempest-VolumesListAdminTestJSON-2061557699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70a73cb7-f2a7-4374-8be5-974d39adfd15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:22:06 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ee040508-aa8a-49ba-880b-b90c5679476d tempest-VolumesListAdminTestJSON-2061557699 None] Flow 'volume_create_manager' (ac04ca49-a313-438e-974b-a11e562aea8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:22:06 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-ee040508-aa8a-49ba-880b-b90c5679476d tempest-VolumesListAdminTestJSON-2061557699 None] Created volume successfully. Aug 05 10:22:08 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-698484c8-8581-495d-a375-068332595220 tempest-VolumesListAdminTestJSON-2061557699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:22:08 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-698484c8-8581-495d-a375-068332595220 tempest-VolumesListAdminTestJSON-2061557699 None] Flow 'volume_create_manager' (e8a9cad4-682e-4900-8390-2a624688a4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:22:08 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-698484c8-8581-495d-a375-068332595220 tempest-VolumesListAdminTestJSON-2061557699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64b9f1b5-e1c0-48df-99f6-8d295d9070dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:22:08 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-698484c8-8581-495d-a375-068332595220 tempest-VolumesListAdminTestJSON-2061557699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64b9f1b5-e1c0-48df-99f6-8d295d9070dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-652889704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e35af5f-d5fc-4ac9-89bd-34711975fb2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40e6cc8ed8704dacbb9f588ae044ac55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:22:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:22:08Z,use_quota=True,user_id='05d7e5b093624137a6c1a578c363fb32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:22:08 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-698484c8-8581-495d-a375-068332595220 tempest-VolumesListAdminTestJSON-2061557699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c77cad32-1154-460d-9c8e-3e8c811c9fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:22:08 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-698484c8-8581-495d-a375-068332595220 tempest-VolumesListAdminTestJSON-2061557699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c77cad32-1154-460d-9c8e-3e8c811c9fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:22:08 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-698484c8-8581-495d-a375-068332595220 tempest-VolumesListAdminTestJSON-2061557699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53a80511-a3b9-4aca-a313-5ce3aaaa8b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:22:08 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-698484c8-8581-495d-a375-068332595220 tempest-VolumesListAdminTestJSON-2061557699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53a80511-a3b9-4aca-a313-5ce3aaaa8b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e35af5f-d5fc-4ac9-89bd-34711975fb2d', 'volume_name': 'volume-4e35af5f-d5fc-4ac9-89bd-34711975fb2d', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:22:08 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-698484c8-8581-495d-a375-068332595220 tempest-VolumesListAdminTestJSON-2061557699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b87586f5-e1e0-4a5a-aa25-47d914364a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:22:08 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-698484c8-8581-495d-a375-068332595220 tempest-VolumesListAdminTestJSON-2061557699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b87586f5-e1e0-4a5a-aa25-47d914364a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:22:08 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-698484c8-8581-495d-a375-068332595220 tempest-VolumesListAdminTestJSON-2061557699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0df5bc0-e3f8-4f42-9025-e3d4239f8cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:22:08 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-698484c8-8581-495d-a375-068332595220 tempest-VolumesListAdminTestJSON-2061557699 None] Volume 4e35af5f-d5fc-4ac9-89bd-34711975fb2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e35af5f-d5fc-4ac9-89bd-34711975fb2d', 'volume_size': 1} Aug 05 10:22:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-698484c8-8581-495d-a375-068332595220 tempest-VolumesListAdminTestJSON-2061557699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:22:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-698484c8-8581-495d-a375-068332595220 tempest-VolumesListAdminTestJSON-2061557699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:22:08 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-698484c8-8581-495d-a375-068332595220 tempest-VolumesListAdminTestJSON-2061557699 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-652889704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e35af5f-d5fc-4ac9-89bd-34711975fb2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40e6cc8ed8704dacbb9f588ae044ac55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:22:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:22:08Z,use_quota=True,user_id='05d7e5b093624137a6c1a578c363fb32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:22:08 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-698484c8-8581-495d-a375-068332595220 tempest-VolumesListAdminTestJSON-2061557699 None] Creating volume 4e35af5f-d5fc-4ac9-89bd-34711975fb2d {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:22:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-698484c8-8581-495d-a375-068332595220 tempest-VolumesListAdminTestJSON-2061557699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:22:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-698484c8-8581-495d-a375-068332595220 tempest-VolumesListAdminTestJSON-2061557699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:22:08 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-698484c8-8581-495d-a375-068332595220 tempest-VolumesListAdminTestJSON-2061557699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:22:08 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-698484c8-8581-495d-a375-068332595220 tempest-VolumesListAdminTestJSON-2061557699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:22:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-698484c8-8581-495d-a375-068332595220 tempest-VolumesListAdminTestJSON-2061557699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:22:08 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-698484c8-8581-495d-a375-068332595220 tempest-VolumesListAdminTestJSON-2061557699 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:22:08 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-698484c8-8581-495d-a375-068332595220 tempest-VolumesListAdminTestJSON-2061557699 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:22:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-698484c8-8581-495d-a375-068332595220 tempest-VolumesListAdminTestJSON-2061557699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-4e35af5f-d5fc-4ac9-89bd-34711975fb2d 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:22:08 devstack sudo[98697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-4e35af5f-d5fc-4ac9-89bd-34711975fb2d 1073741824 Aug 05 10:22:08 devstack sudo[98697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:22:09 devstack sudo[98697]: pam_unix(sudo:session): session closed for user root Aug 05 10:22:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-698484c8-8581-495d-a375-068332595220 tempest-VolumesListAdminTestJSON-2061557699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-4e35af5f-d5fc-4ac9-89bd-34711975fb2d 1073741824" returned: 0 in 0.607s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:22:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-698484c8-8581-495d-a375-068332595220 tempest-VolumesListAdminTestJSON-2061557699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-4e35af5f-d5fc-4ac9-89bd-34711975fb2d {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:22:09 devstack sudo[98703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-4e35af5f-d5fc-4ac9-89bd-34711975fb2d Aug 05 10:22:09 devstack sudo[98703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:22:09 devstack sudo[98703]: pam_unix(sudo:session): session closed for user root Aug 05 10:22:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-698484c8-8581-495d-a375-068332595220 tempest-VolumesListAdminTestJSON-2061557699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-4e35af5f-d5fc-4ac9-89bd-34711975fb2d" returned: 0 in 0.333s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:22:09 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-698484c8-8581-495d-a375-068332595220 tempest-VolumesListAdminTestJSON-2061557699 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:22:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-698484c8-8581-495d-a375-068332595220 tempest-VolumesListAdminTestJSON-2061557699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:22:09 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-698484c8-8581-495d-a375-068332595220 tempest-VolumesListAdminTestJSON-2061557699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0df5bc0-e3f8-4f42-9025-e3d4239f8cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e35af5f-d5fc-4ac9-89bd-34711975fb2d', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:22:09 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-698484c8-8581-495d-a375-068332595220 tempest-VolumesListAdminTestJSON-2061557699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb808af0-ef33-46e8-8dc6-be79d871e2b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:22:09 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-698484c8-8581-495d-a375-068332595220 tempest-VolumesListAdminTestJSON-2061557699 None] Volume volume-4e35af5f-d5fc-4ac9-89bd-34711975fb2d (4e35af5f-d5fc-4ac9-89bd-34711975fb2d): created successfully Aug 05 10:22:09 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-698484c8-8581-495d-a375-068332595220 tempest-VolumesListAdminTestJSON-2061557699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb808af0-ef33-46e8-8dc6-be79d871e2b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:22:09 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-698484c8-8581-495d-a375-068332595220 tempest-VolumesListAdminTestJSON-2061557699 None] Flow 'volume_create_manager' (e8a9cad4-682e-4900-8390-2a624688a4bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:22:09 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-698484c8-8581-495d-a375-068332595220 tempest-VolumesListAdminTestJSON-2061557699 None] Created volume successfully. Aug 05 10:22:09 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [req-84a9bc70-1765-4df9-9122-816a0f9326d4 req-9a53f9c0-0b3c-4371-a10d-4a39db13f81a tempest-VolumesSnapshotsTestJSON-1809912492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:22:09 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [req-84a9bc70-1765-4df9-9122-816a0f9326d4 req-9a53f9c0-0b3c-4371-a10d-4a39db13f81a tempest-VolumesSnapshotsTestJSON-1809912492 None] Flow 'volume_create_manager' (cf5b342e-944c-46aa-9584-c5403476bfd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:22:09 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [req-84a9bc70-1765-4df9-9122-816a0f9326d4 req-9a53f9c0-0b3c-4371-a10d-4a39db13f81a tempest-VolumesSnapshotsTestJSON-1809912492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f1d94bf-2126-449c-a012-de3683dc3124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:22:09 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [req-84a9bc70-1765-4df9-9122-816a0f9326d4 req-9a53f9c0-0b3c-4371-a10d-4a39db13f81a tempest-VolumesSnapshotsTestJSON-1809912492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f1d94bf-2126-449c-a012-de3683dc3124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:22:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-968076854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bbd5876-7e12-48cd-bcc1-30cd221915d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bb803d5fee74bb0a59ba17c95d2873d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:22:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:22:10Z,use_quota=True,user_id='7bcd69b8e2394c389b7448bed2f5ee8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:22:09 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [req-84a9bc70-1765-4df9-9122-816a0f9326d4 req-9a53f9c0-0b3c-4371-a10d-4a39db13f81a tempest-VolumesSnapshotsTestJSON-1809912492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a22b8c37-4360-49fc-b137-eb687291e48b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:22:09 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [req-84a9bc70-1765-4df9-9122-816a0f9326d4 req-9a53f9c0-0b3c-4371-a10d-4a39db13f81a tempest-VolumesSnapshotsTestJSON-1809912492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a22b8c37-4360-49fc-b137-eb687291e48b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:22:09 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [req-84a9bc70-1765-4df9-9122-816a0f9326d4 req-9a53f9c0-0b3c-4371-a10d-4a39db13f81a tempest-VolumesSnapshotsTestJSON-1809912492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90a88184-979a-4f8b-aedc-5c1be11f4161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:22:09 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [req-84a9bc70-1765-4df9-9122-816a0f9326d4 req-9a53f9c0-0b3c-4371-a10d-4a39db13f81a tempest-VolumesSnapshotsTestJSON-1809912492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90a88184-979a-4f8b-aedc-5c1be11f4161) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bbd5876-7e12-48cd-bcc1-30cd221915d8', 'volume_name': 'volume-1bbd5876-7e12-48cd-bcc1-30cd221915d8', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:22:09 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [req-84a9bc70-1765-4df9-9122-816a0f9326d4 req-9a53f9c0-0b3c-4371-a10d-4a39db13f81a tempest-VolumesSnapshotsTestJSON-1809912492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (877f4352-bf53-4566-b6c8-17c3788527c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:22:09 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [req-84a9bc70-1765-4df9-9122-816a0f9326d4 req-9a53f9c0-0b3c-4371-a10d-4a39db13f81a tempest-VolumesSnapshotsTestJSON-1809912492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (877f4352-bf53-4566-b6c8-17c3788527c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:22:09 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [req-84a9bc70-1765-4df9-9122-816a0f9326d4 req-9a53f9c0-0b3c-4371-a10d-4a39db13f81a tempest-VolumesSnapshotsTestJSON-1809912492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (233ddc87-885c-4095-8c2e-e975350fe305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:22:09 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [req-84a9bc70-1765-4df9-9122-816a0f9326d4 req-9a53f9c0-0b3c-4371-a10d-4a39db13f81a tempest-VolumesSnapshotsTestJSON-1809912492 None] Volume 1bbd5876-7e12-48cd-bcc1-30cd221915d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bbd5876-7e12-48cd-bcc1-30cd221915d8', 'volume_size': 1} Aug 05 10:22:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-84a9bc70-1765-4df9-9122-816a0f9326d4 req-9a53f9c0-0b3c-4371-a10d-4a39db13f81a tempest-VolumesSnapshotsTestJSON-1809912492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:22:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-84a9bc70-1765-4df9-9122-816a0f9326d4 req-9a53f9c0-0b3c-4371-a10d-4a39db13f81a tempest-VolumesSnapshotsTestJSON-1809912492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:22:09 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [req-84a9bc70-1765-4df9-9122-816a0f9326d4 req-9a53f9c0-0b3c-4371-a10d-4a39db13f81a tempest-VolumesSnapshotsTestJSON-1809912492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:22:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-968076854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bbd5876-7e12-48cd-bcc1-30cd221915d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bb803d5fee74bb0a59ba17c95d2873d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:22:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:22:10Z,use_quota=True,user_id='7bcd69b8e2394c389b7448bed2f5ee8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:22:09 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [req-84a9bc70-1765-4df9-9122-816a0f9326d4 req-9a53f9c0-0b3c-4371-a10d-4a39db13f81a tempest-VolumesSnapshotsTestJSON-1809912492 None] Creating volume 1bbd5876-7e12-48cd-bcc1-30cd221915d8 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:22:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-84a9bc70-1765-4df9-9122-816a0f9326d4 req-9a53f9c0-0b3c-4371-a10d-4a39db13f81a tempest-VolumesSnapshotsTestJSON-1809912492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:22:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-84a9bc70-1765-4df9-9122-816a0f9326d4 req-9a53f9c0-0b3c-4371-a10d-4a39db13f81a tempest-VolumesSnapshotsTestJSON-1809912492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:22:09 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [req-84a9bc70-1765-4df9-9122-816a0f9326d4 req-9a53f9c0-0b3c-4371-a10d-4a39db13f81a tempest-VolumesSnapshotsTestJSON-1809912492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:22:09 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [req-84a9bc70-1765-4df9-9122-816a0f9326d4 req-9a53f9c0-0b3c-4371-a10d-4a39db13f81a tempest-VolumesSnapshotsTestJSON-1809912492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:22:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-84a9bc70-1765-4df9-9122-816a0f9326d4 req-9a53f9c0-0b3c-4371-a10d-4a39db13f81a tempest-VolumesSnapshotsTestJSON-1809912492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:22:09 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [req-84a9bc70-1765-4df9-9122-816a0f9326d4 req-9a53f9c0-0b3c-4371-a10d-4a39db13f81a tempest-VolumesSnapshotsTestJSON-1809912492 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:22:09 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [req-84a9bc70-1765-4df9-9122-816a0f9326d4 req-9a53f9c0-0b3c-4371-a10d-4a39db13f81a tempest-VolumesSnapshotsTestJSON-1809912492 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:22:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [req-84a9bc70-1765-4df9-9122-816a0f9326d4 req-9a53f9c0-0b3c-4371-a10d-4a39db13f81a tempest-VolumesSnapshotsTestJSON-1809912492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1bbd5876-7e12-48cd-bcc1-30cd221915d8 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:22:10 devstack sudo[98706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1bbd5876-7e12-48cd-bcc1-30cd221915d8 1073741824 Aug 05 10:22:10 devstack sudo[98706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:22:10 devstack sudo[98706]: pam_unix(sudo:session): session closed for user root Aug 05 10:22:10 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [req-84a9bc70-1765-4df9-9122-816a0f9326d4 req-9a53f9c0-0b3c-4371-a10d-4a39db13f81a tempest-VolumesSnapshotsTestJSON-1809912492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1bbd5876-7e12-48cd-bcc1-30cd221915d8 1073741824" returned: 0 in 0.509s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:22:10 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [req-84a9bc70-1765-4df9-9122-816a0f9326d4 req-9a53f9c0-0b3c-4371-a10d-4a39db13f81a tempest-VolumesSnapshotsTestJSON-1809912492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1bbd5876-7e12-48cd-bcc1-30cd221915d8 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:22:10 devstack sudo[98712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1bbd5876-7e12-48cd-bcc1-30cd221915d8 Aug 05 10:22:10 devstack sudo[98712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:22:10 devstack sudo[98712]: pam_unix(sudo:session): session closed for user root Aug 05 10:22:10 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [req-84a9bc70-1765-4df9-9122-816a0f9326d4 req-9a53f9c0-0b3c-4371-a10d-4a39db13f81a tempest-VolumesSnapshotsTestJSON-1809912492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1bbd5876-7e12-48cd-bcc1-30cd221915d8" returned: 0 in 0.291s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:22:10 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [req-84a9bc70-1765-4df9-9122-816a0f9326d4 req-9a53f9c0-0b3c-4371-a10d-4a39db13f81a tempest-VolumesSnapshotsTestJSON-1809912492 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:22:10 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-84a9bc70-1765-4df9-9122-816a0f9326d4 req-9a53f9c0-0b3c-4371-a10d-4a39db13f81a tempest-VolumesSnapshotsTestJSON-1809912492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:22:10 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [req-84a9bc70-1765-4df9-9122-816a0f9326d4 req-9a53f9c0-0b3c-4371-a10d-4a39db13f81a tempest-VolumesSnapshotsTestJSON-1809912492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (233ddc87-885c-4095-8c2e-e975350fe305) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bbd5876-7e12-48cd-bcc1-30cd221915d8', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:22:10 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [req-84a9bc70-1765-4df9-9122-816a0f9326d4 req-9a53f9c0-0b3c-4371-a10d-4a39db13f81a tempest-VolumesSnapshotsTestJSON-1809912492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49e01055-152c-4f60-aece-957f8d401eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:22:10 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [req-84a9bc70-1765-4df9-9122-816a0f9326d4 req-9a53f9c0-0b3c-4371-a10d-4a39db13f81a tempest-VolumesSnapshotsTestJSON-1809912492 None] Volume volume-1bbd5876-7e12-48cd-bcc1-30cd221915d8 (1bbd5876-7e12-48cd-bcc1-30cd221915d8): created successfully Aug 05 10:22:10 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [req-84a9bc70-1765-4df9-9122-816a0f9326d4 req-9a53f9c0-0b3c-4371-a10d-4a39db13f81a tempest-VolumesSnapshotsTestJSON-1809912492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49e01055-152c-4f60-aece-957f8d401eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:22:10 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [req-84a9bc70-1765-4df9-9122-816a0f9326d4 req-9a53f9c0-0b3c-4371-a10d-4a39db13f81a tempest-VolumesSnapshotsTestJSON-1809912492 None] Flow 'volume_create_manager' (cf5b342e-944c-46aa-9584-c5403476bfd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:22:10 devstack cinder-volume[88613]: INFO cinder.volume.manager [req-84a9bc70-1765-4df9-9122-816a0f9326d4 req-9a53f9c0-0b3c-4371-a10d-4a39db13f81a tempest-VolumesSnapshotsTestJSON-1809912492 None] Created volume successfully. Aug 05 10:22:11 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6b35cdd-cfc8-4a54-bcd5-74f12caaeb15 tempest-VolumesListAdminTestJSON-2061557699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:22:11 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d6b35cdd-cfc8-4a54-bcd5-74f12caaeb15 tempest-VolumesListAdminTestJSON-2061557699 None] Flow 'volume_create_manager' (e4f61a97-06c6-47f8-ae35-eaf3485e8d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:22:11 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d6b35cdd-cfc8-4a54-bcd5-74f12caaeb15 tempest-VolumesListAdminTestJSON-2061557699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20eb5a52-fe43-4d6a-b8ff-d2599c5788f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:22:11 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d6b35cdd-cfc8-4a54-bcd5-74f12caaeb15 tempest-VolumesListAdminTestJSON-2061557699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20eb5a52-fe43-4d6a-b8ff-d2599c5788f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:22:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1091811226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c458701-29fb-4e62-8f72-55a0c9e3b01e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40e6cc8ed8704dacbb9f588ae044ac55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:22:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:22:11Z,use_quota=True,user_id='05d7e5b093624137a6c1a578c363fb32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:22:11 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d6b35cdd-cfc8-4a54-bcd5-74f12caaeb15 tempest-VolumesListAdminTestJSON-2061557699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5c3f082-6793-4bc8-9888-e001a2c88a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:22:11 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d6b35cdd-cfc8-4a54-bcd5-74f12caaeb15 tempest-VolumesListAdminTestJSON-2061557699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5c3f082-6793-4bc8-9888-e001a2c88a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:22:11 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d6b35cdd-cfc8-4a54-bcd5-74f12caaeb15 tempest-VolumesListAdminTestJSON-2061557699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef732b15-f3a9-4bdc-b2dd-0bfacfb8c328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:22:11 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d6b35cdd-cfc8-4a54-bcd5-74f12caaeb15 tempest-VolumesListAdminTestJSON-2061557699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef732b15-f3a9-4bdc-b2dd-0bfacfb8c328) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c458701-29fb-4e62-8f72-55a0c9e3b01e', 'volume_name': 'volume-1c458701-29fb-4e62-8f72-55a0c9e3b01e', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:22:11 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d6b35cdd-cfc8-4a54-bcd5-74f12caaeb15 tempest-VolumesListAdminTestJSON-2061557699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c42951d-bcf8-43cc-b857-24552a5b3447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:22:11 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d6b35cdd-cfc8-4a54-bcd5-74f12caaeb15 tempest-VolumesListAdminTestJSON-2061557699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c42951d-bcf8-43cc-b857-24552a5b3447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:22:11 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d6b35cdd-cfc8-4a54-bcd5-74f12caaeb15 tempest-VolumesListAdminTestJSON-2061557699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (125ffc71-79df-4ec2-9897-7e1593816457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:22:11 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-d6b35cdd-cfc8-4a54-bcd5-74f12caaeb15 tempest-VolumesListAdminTestJSON-2061557699 None] Volume 1c458701-29fb-4e62-8f72-55a0c9e3b01e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c458701-29fb-4e62-8f72-55a0c9e3b01e', 'volume_size': 1} Aug 05 10:22:11 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-d6b35cdd-cfc8-4a54-bcd5-74f12caaeb15 tempest-VolumesListAdminTestJSON-2061557699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:22:11 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-d6b35cdd-cfc8-4a54-bcd5-74f12caaeb15 tempest-VolumesListAdminTestJSON-2061557699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:22:11 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-d6b35cdd-cfc8-4a54-bcd5-74f12caaeb15 tempest-VolumesListAdminTestJSON-2061557699 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:22:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1091811226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c458701-29fb-4e62-8f72-55a0c9e3b01e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40e6cc8ed8704dacbb9f588ae044ac55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:22:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:22:11Z,use_quota=True,user_id='05d7e5b093624137a6c1a578c363fb32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:22:11 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-d6b35cdd-cfc8-4a54-bcd5-74f12caaeb15 tempest-VolumesListAdminTestJSON-2061557699 None] Creating volume 1c458701-29fb-4e62-8f72-55a0c9e3b01e {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:22:11 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-d6b35cdd-cfc8-4a54-bcd5-74f12caaeb15 tempest-VolumesListAdminTestJSON-2061557699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:22:11 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-d6b35cdd-cfc8-4a54-bcd5-74f12caaeb15 tempest-VolumesListAdminTestJSON-2061557699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:22:11 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-d6b35cdd-cfc8-4a54-bcd5-74f12caaeb15 tempest-VolumesListAdminTestJSON-2061557699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:22:11 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-d6b35cdd-cfc8-4a54-bcd5-74f12caaeb15 tempest-VolumesListAdminTestJSON-2061557699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:22:11 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-d6b35cdd-cfc8-4a54-bcd5-74f12caaeb15 tempest-VolumesListAdminTestJSON-2061557699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:22:11 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-d6b35cdd-cfc8-4a54-bcd5-74f12caaeb15 tempest-VolumesListAdminTestJSON-2061557699 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:22:11 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-d6b35cdd-cfc8-4a54-bcd5-74f12caaeb15 tempest-VolumesListAdminTestJSON-2061557699 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:22:11 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d6b35cdd-cfc8-4a54-bcd5-74f12caaeb15 tempest-VolumesListAdminTestJSON-2061557699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1c458701-29fb-4e62-8f72-55a0c9e3b01e 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:22:11 devstack sudo[98715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1c458701-29fb-4e62-8f72-55a0c9e3b01e 1073741824 Aug 05 10:22:11 devstack sudo[98715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:22:11 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-22f59acb-6f4e-4973-b9ab-ef75d41bc522 req-2a836683-2cec-4610-9bd8-5becfb5e1e7b tempest-VolumesSnapshotsTestJSON-1809912492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:22:12 devstack sudo[98715]: pam_unix(sudo:session): session closed for user root Aug 05 10:22:12 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d6b35cdd-cfc8-4a54-bcd5-74f12caaeb15 tempest-VolumesListAdminTestJSON-2061557699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1c458701-29fb-4e62-8f72-55a0c9e3b01e 1073741824" returned: 0 in 0.680s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:22:12 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d6b35cdd-cfc8-4a54-bcd5-74f12caaeb15 tempest-VolumesListAdminTestJSON-2061557699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1c458701-29fb-4e62-8f72-55a0c9e3b01e {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:22:12 devstack sudo[98721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1c458701-29fb-4e62-8f72-55a0c9e3b01e Aug 05 10:22:12 devstack sudo[98721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:22:12 devstack sudo[98721]: pam_unix(sudo:session): session closed for user root Aug 05 10:22:12 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d6b35cdd-cfc8-4a54-bcd5-74f12caaeb15 tempest-VolumesListAdminTestJSON-2061557699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1c458701-29fb-4e62-8f72-55a0c9e3b01e" returned: 0 in 0.299s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:22:12 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-d6b35cdd-cfc8-4a54-bcd5-74f12caaeb15 tempest-VolumesListAdminTestJSON-2061557699 None] <== create_volume: return (1046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:22:12 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-d6b35cdd-cfc8-4a54-bcd5-74f12caaeb15 tempest-VolumesListAdminTestJSON-2061557699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:22:12 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-22f59acb-6f4e-4973-b9ab-ef75d41bc522 req-2a836683-2cec-4610-9bd8-5becfb5e1e7b tempest-VolumesSnapshotsTestJSON-1809912492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.719s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:22:12 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d6b35cdd-cfc8-4a54-bcd5-74f12caaeb15 tempest-VolumesListAdminTestJSON-2061557699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (125ffc71-79df-4ec2-9897-7e1593816457) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c458701-29fb-4e62-8f72-55a0c9e3b01e', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:22:12 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d6b35cdd-cfc8-4a54-bcd5-74f12caaeb15 tempest-VolumesListAdminTestJSON-2061557699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58bbee66-90bb-45d5-ae6f-956243a5a598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:22:12 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [req-22f59acb-6f4e-4973-b9ab-ef75d41bc522 req-2a836683-2cec-4610-9bd8-5becfb5e1e7b tempest-VolumesSnapshotsTestJSON-1809912492 None] Creating offline snapshot dbd49d08-c7f6-4f56-9c94-9f4311120f7c of volume 1bbd5876-7e12-48cd-bcc1-30cd221915d8 {{(pid=88613) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:22:12 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-d6b35cdd-cfc8-4a54-bcd5-74f12caaeb15 tempest-VolumesListAdminTestJSON-2061557699 None] Volume volume-1c458701-29fb-4e62-8f72-55a0c9e3b01e (1c458701-29fb-4e62-8f72-55a0c9e3b01e): created successfully Aug 05 10:22:12 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d6b35cdd-cfc8-4a54-bcd5-74f12caaeb15 tempest-VolumesListAdminTestJSON-2061557699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58bbee66-90bb-45d5-ae6f-956243a5a598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:22:12 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d6b35cdd-cfc8-4a54-bcd5-74f12caaeb15 tempest-VolumesListAdminTestJSON-2061557699 None] Flow 'volume_create_manager' (e4f61a97-06c6-47f8-ae35-eaf3485e8d8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:22:12 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[b444db37-8b21-4d48-8e57-3401c233837b]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:22:12 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [req-22f59acb-6f4e-4973-b9ab-ef75d41bc522 req-2a836683-2cec-4610-9bd8-5becfb5e1e7b tempest-VolumesSnapshotsTestJSON-1809912492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1bbd5876-7e12-48cd-bcc1-30cd221915d8 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:22:12 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-d6b35cdd-cfc8-4a54-bcd5-74f12caaeb15 tempest-VolumesListAdminTestJSON-2061557699 None] Created volume successfully. Aug 05 10:22:12 devstack sudo[98724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1bbd5876-7e12-48cd-bcc1-30cd221915d8 Aug 05 10:22:12 devstack sudo[98724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:22:12 devstack sudo[98724]: pam_unix(sudo:session): session closed for user root Aug 05 10:22:12 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [req-22f59acb-6f4e-4973-b9ab-ef75d41bc522 req-2a836683-2cec-4610-9bd8-5becfb5e1e7b tempest-VolumesSnapshotsTestJSON-1809912492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1bbd5876-7e12-48cd-bcc1-30cd221915d8" returned: 0 in 0.406s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:22:12 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [req-22f59acb-6f4e-4973-b9ab-ef75d41bc522 req-2a836683-2cec-4610-9bd8-5becfb5e1e7b tempest-VolumesSnapshotsTestJSON-1809912492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1bbd5876-7e12-48cd-bcc1-30cd221915d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1bbd5876-7e12-48cd-bcc1-30cd221915d8.dbd49d08-c7f6-4f56-9c94-9f4311120f7c 1G {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:22:12 devstack sudo[98730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1bbd5876-7e12-48cd-bcc1-30cd221915d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1bbd5876-7e12-48cd-bcc1-30cd221915d8.dbd49d08-c7f6-4f56-9c94-9f4311120f7c 1G Aug 05 10:22:12 devstack sudo[98730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:22:13 devstack sudo[98730]: pam_unix(sudo:session): session closed for user root Aug 05 10:22:13 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [req-22f59acb-6f4e-4973-b9ab-ef75d41bc522 req-2a836683-2cec-4610-9bd8-5becfb5e1e7b tempest-VolumesSnapshotsTestJSON-1809912492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1bbd5876-7e12-48cd-bcc1-30cd221915d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1bbd5876-7e12-48cd-bcc1-30cd221915d8.dbd49d08-c7f6-4f56-9c94-9f4311120f7c 1G" returned: 0 in 0.680s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:22:13 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [req-22f59acb-6f4e-4973-b9ab-ef75d41bc522 req-2a836683-2cec-4610-9bd8-5becfb5e1e7b tempest-VolumesSnapshotsTestJSON-1809912492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1bbd5876-7e12-48cd-bcc1-30cd221915d8 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1bbd5876-7e12-48cd-bcc1-30cd221915d8.dbd49d08-c7f6-4f56-9c94-9f4311120f7c {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:22:13 devstack sudo[98737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1bbd5876-7e12-48cd-bcc1-30cd221915d8 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1bbd5876-7e12-48cd-bcc1-30cd221915d8.dbd49d08-c7f6-4f56-9c94-9f4311120f7c Aug 05 10:22:13 devstack sudo[98737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:22:14 devstack sudo[98737]: pam_unix(sudo:session): session closed for user root Aug 05 10:22:14 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [req-22f59acb-6f4e-4973-b9ab-ef75d41bc522 req-2a836683-2cec-4610-9bd8-5becfb5e1e7b tempest-VolumesSnapshotsTestJSON-1809912492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1bbd5876-7e12-48cd-bcc1-30cd221915d8 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1bbd5876-7e12-48cd-bcc1-30cd221915d8.dbd49d08-c7f6-4f56-9c94-9f4311120f7c" returned: 0 in 0.469s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:22:14 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [req-22f59acb-6f4e-4973-b9ab-ef75d41bc522 req-2a836683-2cec-4610-9bd8-5becfb5e1e7b tempest-VolumesSnapshotsTestJSON-1809912492 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1bbd5876-7e12-48cd-bcc1-30cd221915d8.dbd49d08-c7f6-4f56-9c94-9f4311120f7c is being set with open permissions: ugo+rw Aug 05 10:22:14 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [req-22f59acb-6f4e-4973-b9ab-ef75d41bc522 req-2a836683-2cec-4610-9bd8-5becfb5e1e7b tempest-VolumesSnapshotsTestJSON-1809912492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1bbd5876-7e12-48cd-bcc1-30cd221915d8.dbd49d08-c7f6-4f56-9c94-9f4311120f7c {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:22:14 devstack sudo[98743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1bbd5876-7e12-48cd-bcc1-30cd221915d8.dbd49d08-c7f6-4f56-9c94-9f4311120f7c Aug 05 10:22:14 devstack sudo[98743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:22:14 devstack sudo[98743]: pam_unix(sudo:session): session closed for user root Aug 05 10:22:14 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [req-22f59acb-6f4e-4973-b9ab-ef75d41bc522 req-2a836683-2cec-4610-9bd8-5becfb5e1e7b tempest-VolumesSnapshotsTestJSON-1809912492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1bbd5876-7e12-48cd-bcc1-30cd221915d8.dbd49d08-c7f6-4f56-9c94-9f4311120f7c" returned: 0 in 0.334s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:22:14 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [req-22f59acb-6f4e-4973-b9ab-ef75d41bc522 req-2a836683-2cec-4610-9bd8-5becfb5e1e7b tempest-VolumesSnapshotsTestJSON-1809912492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1bbd5876-7e12-48cd-bcc1-30cd221915d8.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:22:14 devstack sudo[98747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1bbd5876-7e12-48cd-bcc1-30cd221915d8.info Aug 05 10:22:14 devstack sudo[98747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:22:14 devstack sudo[98747]: pam_unix(sudo:session): session closed for user root Aug 05 10:22:14 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [req-22f59acb-6f4e-4973-b9ab-ef75d41bc522 req-2a836683-2cec-4610-9bd8-5becfb5e1e7b tempest-VolumesSnapshotsTestJSON-1809912492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1bbd5876-7e12-48cd-bcc1-30cd221915d8.info" returned: 0 in 0.332s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:22:14 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [req-22f59acb-6f4e-4973-b9ab-ef75d41bc522 req-2a836683-2cec-4610-9bd8-5becfb5e1e7b tempest-VolumesSnapshotsTestJSON-1809912492 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1bbd5876-7e12-48cd-bcc1-30cd221915d8.info is being set with open permissions: ugo+rw Aug 05 10:22:14 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [req-22f59acb-6f4e-4973-b9ab-ef75d41bc522 req-2a836683-2cec-4610-9bd8-5becfb5e1e7b tempest-VolumesSnapshotsTestJSON-1809912492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1bbd5876-7e12-48cd-bcc1-30cd221915d8.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:22:14 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-575ee3d2-e311-4201-8c4e-d9030eb32579 tempest-VolumesListAdminTestJSON-28853318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:22:14 devstack sudo[98750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1bbd5876-7e12-48cd-bcc1-30cd221915d8.info Aug 05 10:22:14 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-575ee3d2-e311-4201-8c4e-d9030eb32579 tempest-VolumesListAdminTestJSON-28853318 None] Flow 'volume_create_manager' (527c05a9-2d57-49fe-8532-7fdb5edf4f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:22:14 devstack sudo[98750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:22:14 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-575ee3d2-e311-4201-8c4e-d9030eb32579 tempest-VolumesListAdminTestJSON-28853318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd32c1ff-9e3f-48fd-b1b8-01f815cc7d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:22:14 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-575ee3d2-e311-4201-8c4e-d9030eb32579 tempest-VolumesListAdminTestJSON-28853318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd32c1ff-9e3f-48fd-b1b8-01f815cc7d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:22:14Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=134f1538-b82b-4718-b7be-da7964f45e41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f880c64b1ff4326b0a833cfa9387a46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:22:15Z,use_quota=True,user_id='339ab4c312c8407f81362b5abe0d785c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:22:14 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-575ee3d2-e311-4201-8c4e-d9030eb32579 tempest-VolumesListAdminTestJSON-28853318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (788debc8-abfe-4426-92c5-314b460eb282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:22:14 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-575ee3d2-e311-4201-8c4e-d9030eb32579 tempest-VolumesListAdminTestJSON-28853318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (788debc8-abfe-4426-92c5-314b460eb282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:22:14 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-575ee3d2-e311-4201-8c4e-d9030eb32579 tempest-VolumesListAdminTestJSON-28853318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29abd930-1241-483c-ab83-6fe3d9042501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:22:14 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-575ee3d2-e311-4201-8c4e-d9030eb32579 tempest-VolumesListAdminTestJSON-28853318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29abd930-1241-483c-ab83-6fe3d9042501) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '134f1538-b82b-4718-b7be-da7964f45e41', 'volume_name': 'volume-134f1538-b82b-4718-b7be-da7964f45e41', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:22:14 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-575ee3d2-e311-4201-8c4e-d9030eb32579 tempest-VolumesListAdminTestJSON-28853318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (427d16fe-56fb-4d4f-9682-6e5065d23466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:22:14 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-575ee3d2-e311-4201-8c4e-d9030eb32579 tempest-VolumesListAdminTestJSON-28853318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (427d16fe-56fb-4d4f-9682-6e5065d23466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:22:14 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-575ee3d2-e311-4201-8c4e-d9030eb32579 tempest-VolumesListAdminTestJSON-28853318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (917f7d33-0ca0-475c-a8d2-fb1f44bc9792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:22:14 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-575ee3d2-e311-4201-8c4e-d9030eb32579 tempest-VolumesListAdminTestJSON-28853318 None] Volume 134f1538-b82b-4718-b7be-da7964f45e41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-134f1538-b82b-4718-b7be-da7964f45e41', 'volume_size': 1} Aug 05 10:22:14 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-575ee3d2-e311-4201-8c4e-d9030eb32579 tempest-VolumesListAdminTestJSON-28853318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:22:15 devstack sudo[98750]: pam_unix(sudo:session): session closed for user root Aug 05 10:22:15 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [req-22f59acb-6f4e-4973-b9ab-ef75d41bc522 req-2a836683-2cec-4610-9bd8-5becfb5e1e7b tempest-VolumesSnapshotsTestJSON-1809912492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1bbd5876-7e12-48cd-bcc1-30cd221915d8.info" returned: 0 in 0.358s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:22:15 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-22f59acb-6f4e-4973-b9ab-ef75d41bc522 req-2a836683-2cec-4610-9bd8-5becfb5e1e7b tempest-VolumesSnapshotsTestJSON-1809912492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.744s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:22:15 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-575ee3d2-e311-4201-8c4e-d9030eb32579 tempest-VolumesListAdminTestJSON-28853318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.276s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:22:15 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-575ee3d2-e311-4201-8c4e-d9030eb32579 tempest-VolumesListAdminTestJSON-28853318 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:22:14Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=134f1538-b82b-4718-b7be-da7964f45e41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f880c64b1ff4326b0a833cfa9387a46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:22:15Z,use_quota=True,user_id='339ab4c312c8407f81362b5abe0d785c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:22:15 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-575ee3d2-e311-4201-8c4e-d9030eb32579 tempest-VolumesListAdminTestJSON-28853318 None] Creating volume 134f1538-b82b-4718-b7be-da7964f45e41 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:22:15 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-575ee3d2-e311-4201-8c4e-d9030eb32579 tempest-VolumesListAdminTestJSON-28853318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:22:15 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-575ee3d2-e311-4201-8c4e-d9030eb32579 tempest-VolumesListAdminTestJSON-28853318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:22:15 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-575ee3d2-e311-4201-8c4e-d9030eb32579 tempest-VolumesListAdminTestJSON-28853318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:22:15 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-575ee3d2-e311-4201-8c4e-d9030eb32579 tempest-VolumesListAdminTestJSON-28853318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:22:15 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-575ee3d2-e311-4201-8c4e-d9030eb32579 tempest-VolumesListAdminTestJSON-28853318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:22:15 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-575ee3d2-e311-4201-8c4e-d9030eb32579 tempest-VolumesListAdminTestJSON-28853318 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:22:15 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-575ee3d2-e311-4201-8c4e-d9030eb32579 tempest-VolumesListAdminTestJSON-28853318 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:22:15 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-575ee3d2-e311-4201-8c4e-d9030eb32579 tempest-VolumesListAdminTestJSON-28853318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-134f1538-b82b-4718-b7be-da7964f45e41 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:22:15 devstack sudo[98753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-134f1538-b82b-4718-b7be-da7964f45e41 1073741824 Aug 05 10:22:15 devstack sudo[98753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:22:15 devstack cinder-volume[88613]: INFO cinder.volume.manager [req-22f59acb-6f4e-4973-b9ab-ef75d41bc522 req-2a836683-2cec-4610-9bd8-5becfb5e1e7b tempest-VolumesSnapshotsTestJSON-1809912492 None] Create snapshot completed successfully Aug 05 10:22:15 devstack sudo[98753]: pam_unix(sudo:session): session closed for user root Aug 05 10:22:15 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-575ee3d2-e311-4201-8c4e-d9030eb32579 tempest-VolumesListAdminTestJSON-28853318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-134f1538-b82b-4718-b7be-da7964f45e41 1073741824" returned: 0 in 0.597s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:22:15 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-575ee3d2-e311-4201-8c4e-d9030eb32579 tempest-VolumesListAdminTestJSON-28853318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-134f1538-b82b-4718-b7be-da7964f45e41 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:22:15 devstack sudo[98758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-134f1538-b82b-4718-b7be-da7964f45e41 Aug 05 10:22:15 devstack sudo[98758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:22:16 devstack sudo[98758]: pam_unix(sudo:session): session closed for user root Aug 05 10:22:16 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-575ee3d2-e311-4201-8c4e-d9030eb32579 tempest-VolumesListAdminTestJSON-28853318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-134f1538-b82b-4718-b7be-da7964f45e41" returned: 0 in 0.301s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:22:16 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-575ee3d2-e311-4201-8c4e-d9030eb32579 tempest-VolumesListAdminTestJSON-28853318 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:22:16 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-575ee3d2-e311-4201-8c4e-d9030eb32579 tempest-VolumesListAdminTestJSON-28853318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:22:16 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-575ee3d2-e311-4201-8c4e-d9030eb32579 tempest-VolumesListAdminTestJSON-28853318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (917f7d33-0ca0-475c-a8d2-fb1f44bc9792) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-134f1538-b82b-4718-b7be-da7964f45e41', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:22:16 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-575ee3d2-e311-4201-8c4e-d9030eb32579 tempest-VolumesListAdminTestJSON-28853318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe252aeb-0d9d-4c88-967d-37e9020b5d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:22:16 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-575ee3d2-e311-4201-8c4e-d9030eb32579 tempest-VolumesListAdminTestJSON-28853318 None] Volume volume-134f1538-b82b-4718-b7be-da7964f45e41 (134f1538-b82b-4718-b7be-da7964f45e41): created successfully Aug 05 10:22:16 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-575ee3d2-e311-4201-8c4e-d9030eb32579 tempest-VolumesListAdminTestJSON-28853318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe252aeb-0d9d-4c88-967d-37e9020b5d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:22:16 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-575ee3d2-e311-4201-8c4e-d9030eb32579 tempest-VolumesListAdminTestJSON-28853318 None] Flow 'volume_create_manager' (527c05a9-2d57-49fe-8532-7fdb5edf4f46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:22:16 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-575ee3d2-e311-4201-8c4e-d9030eb32579 tempest-VolumesListAdminTestJSON-28853318 None] Created volume successfully. Aug 05 10:22:16 devstack cinder-volume[88613]: DEBUG cinder.coordination [req-7f28f261-e49b-4266-b436-a03e3fad71e0 req-1386b200-ac80-4c34-a88d-09f2454d4bfa tempest-VolumesSnapshotsTestJSON-1809912492 None] Acquiring lock "cinder-dbd49d08-c7f6-4f56-9c94-9f4311120f7c-delete_snapshot" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:22:16 devstack cinder-volume[88613]: DEBUG cinder.coordination [req-7f28f261-e49b-4266-b436-a03e3fad71e0 req-1386b200-ac80-4c34-a88d-09f2454d4bfa tempest-VolumesSnapshotsTestJSON-1809912492 None] Lock "cinder-dbd49d08-c7f6-4f56-9c94-9f4311120f7c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:22:16 devstack cinder-volume[88613]: DEBUG cinder.coordination [req-7f28f261-e49b-4266-b436-a03e3fad71e0 req-1386b200-ac80-4c34-a88d-09f2454d4bfa tempest-VolumesSnapshotsTestJSON-1809912492 None] Acquiring lock "cinder-quobyte-1bbd5876-7e12-48cd-bcc1-30cd221915d8" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:22:16 devstack cinder-volume[88613]: DEBUG cinder.coordination [req-7f28f261-e49b-4266-b436-a03e3fad71e0 req-1386b200-ac80-4c34-a88d-09f2454d4bfa tempest-VolumesSnapshotsTestJSON-1809912492 None] Lock "cinder-quobyte-1bbd5876-7e12-48cd-bcc1-30cd221915d8" acquired by "delete_snapshot" :: waited 0.056s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:22:16 devstack cinder-volume[88613]: DEBUG cinder.coordination [req-7f28f261-e49b-4266-b436-a03e3fad71e0 req-1386b200-ac80-4c34-a88d-09f2454d4bfa tempest-VolumesSnapshotsTestJSON-1809912492 None] Acquiring lock "cinder-quobyte-dbd49d08-c7f6-4f56-9c94-9f4311120f7c" by "_delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:22:16 devstack cinder-volume[88613]: DEBUG cinder.coordination [req-7f28f261-e49b-4266-b436-a03e3fad71e0 req-1386b200-ac80-4c34-a88d-09f2454d4bfa tempest-VolumesSnapshotsTestJSON-1809912492 None] Lock "cinder-quobyte-dbd49d08-c7f6-4f56-9c94-9f4311120f7c" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:22:16 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [req-7f28f261-e49b-4266-b436-a03e3fad71e0 req-1386b200-ac80-4c34-a88d-09f2454d4bfa tempest-VolumesSnapshotsTestJSON-1809912492 None] Deleting offline snapshot dbd49d08-c7f6-4f56-9c94-9f4311120f7c of volume 1bbd5876-7e12-48cd-bcc1-30cd221915d8 {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:22:16 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [req-7f28f261-e49b-4266-b436-a03e3fad71e0 req-1386b200-ac80-4c34-a88d-09f2454d4bfa tempest-VolumesSnapshotsTestJSON-1809912492 None] snapshot_file for this snap is: volume-1bbd5876-7e12-48cd-bcc1-30cd221915d8.dbd49d08-c7f6-4f56-9c94-9f4311120f7c {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:22:16 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[f71f6c88-b4c2-4fac-aca5-20d220d6987f]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:22:16 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [req-7f28f261-e49b-4266-b436-a03e3fad71e0 req-1386b200-ac80-4c34-a88d-09f2454d4bfa tempest-VolumesSnapshotsTestJSON-1809912492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1bbd5876-7e12-48cd-bcc1-30cd221915d8.dbd49d08-c7f6-4f56-9c94-9f4311120f7c {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:22:16 devstack sudo[98763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1bbd5876-7e12-48cd-bcc1-30cd221915d8.dbd49d08-c7f6-4f56-9c94-9f4311120f7c Aug 05 10:22:16 devstack sudo[98763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:22:16 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-9d6e7dff-89a4-4d60-afff-04c82ec76342 tempest-VolumesListAdminTestJSON-28853318 None] Acquiring lock "cinder-134f1538-b82b-4718-b7be-da7964f45e41-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:22:16 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-9d6e7dff-89a4-4d60-afff-04c82ec76342 tempest-VolumesListAdminTestJSON-28853318 None] Lock "cinder-134f1538-b82b-4718-b7be-da7964f45e41-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:22:17 devstack sudo[98763]: pam_unix(sudo:session): session closed for user root Aug 05 10:22:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [req-7f28f261-e49b-4266-b436-a03e3fad71e0 req-1386b200-ac80-4c34-a88d-09f2454d4bfa tempest-VolumesSnapshotsTestJSON-1809912492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1bbd5876-7e12-48cd-bcc1-30cd221915d8.dbd49d08-c7f6-4f56-9c94-9f4311120f7c" returned: 0 in 0.492s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:22:17 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [req-7f28f261-e49b-4266-b436-a03e3fad71e0 req-1386b200-ac80-4c34-a88d-09f2454d4bfa tempest-VolumesSnapshotsTestJSON-1809912492 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1bbd5876-7e12-48cd-bcc1-30cd221915d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88613) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:22:17 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-9d6e7dff-89a4-4d60-afff-04c82ec76342 tempest-VolumesListAdminTestJSON-28853318 None] Acquiring lock "cinder-quobyte-134f1538-b82b-4718-b7be-da7964f45e41" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:22:17 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[2def8869-e0e0-49c7-8e4f-5cb4e0125cfd]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:22:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [req-7f28f261-e49b-4266-b436-a03e3fad71e0 req-1386b200-ac80-4c34-a88d-09f2454d4bfa tempest-VolumesSnapshotsTestJSON-1809912492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1bbd5876-7e12-48cd-bcc1-30cd221915d8 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:22:17 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-9d6e7dff-89a4-4d60-afff-04c82ec76342 tempest-VolumesListAdminTestJSON-28853318 None] Lock "cinder-quobyte-134f1538-b82b-4718-b7be-da7964f45e41" acquired by "delete_volume" :: waited 0.041s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:22:17 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-f8001c00-1994-4f96-a684-9ebc11ed8122 tempest-VolumesListAdminTestJSON-2061557699 None] Acquiring lock "cinder-1c458701-29fb-4e62-8f72-55a0c9e3b01e-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:22:17 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb02082-f2bc-4e17-8855-d5bf4b881fe9]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:22:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9d6e7dff-89a4-4d60-afff-04c82ec76342 tempest-VolumesListAdminTestJSON-28853318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-134f1538-b82b-4718-b7be-da7964f45e41 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:22:17 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-f8001c00-1994-4f96-a684-9ebc11ed8122 tempest-VolumesListAdminTestJSON-2061557699 None] Lock "cinder-1c458701-29fb-4e62-8f72-55a0c9e3b01e-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:22:17 devstack sudo[98773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1bbd5876-7e12-48cd-bcc1-30cd221915d8 Aug 05 10:22:17 devstack sudo[98773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:22:17 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-f8001c00-1994-4f96-a684-9ebc11ed8122 tempest-VolumesListAdminTestJSON-2061557699 None] Acquiring lock "cinder-quobyte-1c458701-29fb-4e62-8f72-55a0c9e3b01e" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:22:17 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-f8001c00-1994-4f96-a684-9ebc11ed8122 tempest-VolumesListAdminTestJSON-2061557699 None] Lock "cinder-quobyte-1c458701-29fb-4e62-8f72-55a0c9e3b01e" acquired by "delete_volume" :: waited 0.043s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:22:17 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee68a9d-73ba-428c-b14a-e93669dce2eb]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:22:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f8001c00-1994-4f96-a684-9ebc11ed8122 tempest-VolumesListAdminTestJSON-2061557699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1c458701-29fb-4e62-8f72-55a0c9e3b01e {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:22:17 devstack sudo[98774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-134f1538-b82b-4718-b7be-da7964f45e41 Aug 05 10:22:17 devstack sudo[98774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:22:17 devstack sudo[98776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1c458701-29fb-4e62-8f72-55a0c9e3b01e Aug 05 10:22:17 devstack sudo[98776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:22:17 devstack sudo[98773]: pam_unix(sudo:session): session closed for user root Aug 05 10:22:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [req-7f28f261-e49b-4266-b436-a03e3fad71e0 req-1386b200-ac80-4c34-a88d-09f2454d4bfa tempest-VolumesSnapshotsTestJSON-1809912492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1bbd5876-7e12-48cd-bcc1-30cd221915d8" returned: 0 in 0.668s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:22:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [req-7f28f261-e49b-4266-b436-a03e3fad71e0 req-1386b200-ac80-4c34-a88d-09f2454d4bfa tempest-VolumesSnapshotsTestJSON-1809912492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1bbd5876-7e12-48cd-bcc1-30cd221915d8.dbd49d08-c7f6-4f56-9c94-9f4311120f7c {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:22:17 devstack sudo[98782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1bbd5876-7e12-48cd-bcc1-30cd221915d8.dbd49d08-c7f6-4f56-9c94-9f4311120f7c Aug 05 10:22:17 devstack sudo[98782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:22:17 devstack sudo[98774]: pam_unix(sudo:session): session closed for user root Aug 05 10:22:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9d6e7dff-89a4-4d60-afff-04c82ec76342 tempest-VolumesListAdminTestJSON-28853318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-134f1538-b82b-4718-b7be-da7964f45e41" returned: 0 in 0.758s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:22:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9d6e7dff-89a4-4d60-afff-04c82ec76342 tempest-VolumesListAdminTestJSON-28853318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-134f1538-b82b-4718-b7be-da7964f45e41 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:22:18 devstack sudo[98790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-134f1538-b82b-4718-b7be-da7964f45e41 Aug 05 10:22:18 devstack sudo[98790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:22:18 devstack sudo[98776]: pam_unix(sudo:session): session closed for user root Aug 05 10:22:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f8001c00-1994-4f96-a684-9ebc11ed8122 tempest-VolumesListAdminTestJSON-2061557699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1c458701-29fb-4e62-8f72-55a0c9e3b01e" returned: 0 in 0.666s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:22:18 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-86b67e18-04b6-470c-8c82-b76c057bc88e tempest-TestServerVolumeAttachmentScenario-18472656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:22:18 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-86b67e18-04b6-470c-8c82-b76c057bc88e tempest-TestServerVolumeAttachmentScenario-18472656 None] Flow 'volume_create_manager' (a56ee078-ba70-4036-a5fd-c64806ee33e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:22:18 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-86b67e18-04b6-470c-8c82-b76c057bc88e tempest-TestServerVolumeAttachmentScenario-18472656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20cd62f7-3f1e-4f9a-9fd3-679885977bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:22:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f8001c00-1994-4f96-a684-9ebc11ed8122 tempest-VolumesListAdminTestJSON-2061557699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1c458701-29fb-4e62-8f72-55a0c9e3b01e {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:22:18 devstack sudo[98794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1c458701-29fb-4e62-8f72-55a0c9e3b01e Aug 05 10:22:18 devstack sudo[98794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:22:18 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-86b67e18-04b6-470c-8c82-b76c057bc88e tempest-TestServerVolumeAttachmentScenario-18472656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20cd62f7-3f1e-4f9a-9fd3-679885977bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:22:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-266033152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ac49342-aa81-4663-9939-d798f6deb6b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10cb20001c1a47daaf2692e9e1c47569',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:22:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:22:18Z,use_quota=True,user_id='e64bc7d4847948018eab87206d8dfc52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:22:18 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-86b67e18-04b6-470c-8c82-b76c057bc88e tempest-TestServerVolumeAttachmentScenario-18472656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b99228b-5cb1-4693-bdfa-8b031ce9d70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:22:18 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-86b67e18-04b6-470c-8c82-b76c057bc88e tempest-TestServerVolumeAttachmentScenario-18472656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b99228b-5cb1-4693-bdfa-8b031ce9d70d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:22:18 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-86b67e18-04b6-470c-8c82-b76c057bc88e tempest-TestServerVolumeAttachmentScenario-18472656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9075b152-4af6-496e-a6a2-11509c101951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:22:18 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-86b67e18-04b6-470c-8c82-b76c057bc88e tempest-TestServerVolumeAttachmentScenario-18472656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9075b152-4af6-496e-a6a2-11509c101951) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ac49342-aa81-4663-9939-d798f6deb6b0', 'volume_name': 'volume-3ac49342-aa81-4663-9939-d798f6deb6b0', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:22:18 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-86b67e18-04b6-470c-8c82-b76c057bc88e tempest-TestServerVolumeAttachmentScenario-18472656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f6ecd38-a52c-4588-92cf-3c71be1267e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:22:18 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-86b67e18-04b6-470c-8c82-b76c057bc88e tempest-TestServerVolumeAttachmentScenario-18472656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f6ecd38-a52c-4588-92cf-3c71be1267e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:22:18 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-86b67e18-04b6-470c-8c82-b76c057bc88e tempest-TestServerVolumeAttachmentScenario-18472656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5b855b7-be4c-45d7-9731-d29cb648d255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:22:18 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-86b67e18-04b6-470c-8c82-b76c057bc88e tempest-TestServerVolumeAttachmentScenario-18472656 None] Volume 3ac49342-aa81-4663-9939-d798f6deb6b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ac49342-aa81-4663-9939-d798f6deb6b0', 'volume_size': 1} Aug 05 10:22:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-86b67e18-04b6-470c-8c82-b76c057bc88e tempest-TestServerVolumeAttachmentScenario-18472656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:22:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-86b67e18-04b6-470c-8c82-b76c057bc88e tempest-TestServerVolumeAttachmentScenario-18472656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:22:18 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-86b67e18-04b6-470c-8c82-b76c057bc88e tempest-TestServerVolumeAttachmentScenario-18472656 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:22:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-266033152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ac49342-aa81-4663-9939-d798f6deb6b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10cb20001c1a47daaf2692e9e1c47569',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:22:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:22:18Z,use_quota=True,user_id='e64bc7d4847948018eab87206d8dfc52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:22:18 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-86b67e18-04b6-470c-8c82-b76c057bc88e tempest-TestServerVolumeAttachmentScenario-18472656 None] Creating volume 3ac49342-aa81-4663-9939-d798f6deb6b0 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:22:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-86b67e18-04b6-470c-8c82-b76c057bc88e tempest-TestServerVolumeAttachmentScenario-18472656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:22:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-86b67e18-04b6-470c-8c82-b76c057bc88e tempest-TestServerVolumeAttachmentScenario-18472656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:22:18 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-86b67e18-04b6-470c-8c82-b76c057bc88e tempest-TestServerVolumeAttachmentScenario-18472656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:22:18 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-86b67e18-04b6-470c-8c82-b76c057bc88e tempest-TestServerVolumeAttachmentScenario-18472656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:22:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-86b67e18-04b6-470c-8c82-b76c057bc88e tempest-TestServerVolumeAttachmentScenario-18472656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:22:18 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-86b67e18-04b6-470c-8c82-b76c057bc88e tempest-TestServerVolumeAttachmentScenario-18472656 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:22:18 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-86b67e18-04b6-470c-8c82-b76c057bc88e tempest-TestServerVolumeAttachmentScenario-18472656 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:22:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-86b67e18-04b6-470c-8c82-b76c057bc88e tempest-TestServerVolumeAttachmentScenario-18472656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3ac49342-aa81-4663-9939-d798f6deb6b0 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:22:18 devstack sudo[98797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3ac49342-aa81-4663-9939-d798f6deb6b0 1073741824 Aug 05 10:22:18 devstack sudo[98797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:22:18 devstack sudo[98782]: pam_unix(sudo:session): session closed for user root Aug 05 10:22:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [req-7f28f261-e49b-4266-b436-a03e3fad71e0 req-1386b200-ac80-4c34-a88d-09f2454d4bfa tempest-VolumesSnapshotsTestJSON-1809912492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1bbd5876-7e12-48cd-bcc1-30cd221915d8.dbd49d08-c7f6-4f56-9c94-9f4311120f7c" returned: 0 in 0.775s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:22:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [req-7f28f261-e49b-4266-b436-a03e3fad71e0 req-1386b200-ac80-4c34-a88d-09f2454d4bfa tempest-VolumesSnapshotsTestJSON-1809912492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1bbd5876-7e12-48cd-bcc1-30cd221915d8.dbd49d08-c7f6-4f56-9c94-9f4311120f7c {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:22:18 devstack sudo[98790]: pam_unix(sudo:session): session closed for user root Aug 05 10:22:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9d6e7dff-89a4-4d60-afff-04c82ec76342 tempest-VolumesListAdminTestJSON-28853318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-134f1538-b82b-4718-b7be-da7964f45e41" returned: 0 in 0.595s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:22:18 devstack sudo[98794]: pam_unix(sudo:session): session closed for user root Aug 05 10:22:18 devstack sudo[98801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1bbd5876-7e12-48cd-bcc1-30cd221915d8.dbd49d08-c7f6-4f56-9c94-9f4311120f7c Aug 05 10:22:18 devstack sudo[98801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:22:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f8001c00-1994-4f96-a684-9ebc11ed8122 tempest-VolumesListAdminTestJSON-2061557699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1c458701-29fb-4e62-8f72-55a0c9e3b01e" returned: 0 in 0.461s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:22:18 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-9d6e7dff-89a4-4d60-afff-04c82ec76342 tempest-VolumesListAdminTestJSON-28853318 None] Lock "cinder-quobyte-134f1538-b82b-4718-b7be-da7964f45e41" released by "delete_volume" :: held 1.500s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:22:18 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-f8001c00-1994-4f96-a684-9ebc11ed8122 tempest-VolumesListAdminTestJSON-2061557699 None] Lock "cinder-quobyte-1c458701-29fb-4e62-8f72-55a0c9e3b01e" released by "delete_volume" :: held 1.288s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:22:18 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-60867dbd-1d8b-40e5-b376-bfd0dde5be5d tempest-TestServerVolumeAttachmentScenario-18472656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:22:18 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-60867dbd-1d8b-40e5-b376-bfd0dde5be5d tempest-TestServerVolumeAttachmentScenario-18472656 None] Flow 'volume_create_manager' (4d8c5384-0979-407f-bffa-c0740d771924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:22:18 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-60867dbd-1d8b-40e5-b376-bfd0dde5be5d tempest-TestServerVolumeAttachmentScenario-18472656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6e09d55-6ac3-4e5a-887a-11bb643253b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:22:18 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-9d6e7dff-89a4-4d60-afff-04c82ec76342 tempest-VolumesListAdminTestJSON-28853318 None] Created reservations ['1fae1086-89c7-48f7-bb1e-ab30c31f529d', '600a0192-91a9-4a87-91da-717655089e73', '74daa823-36f5-42f0-bc1a-1572090262fa', 'e0431609-7d5d-45d3-9d64-1a7fc472c468'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:22:18 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-f8001c00-1994-4f96-a684-9ebc11ed8122 tempest-VolumesListAdminTestJSON-2061557699 None] Created reservations ['ad4e26b9-142c-4545-94ba-af2768c51ee6', '95a3c468-78dc-4aa3-ab32-b6ebcb6a3877', '27f3c0fd-90c0-4794-a2e0-528b2b2642a7', '7dbdbcef-e446-42b5-acc9-9f33d179ba42'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:22:18 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-60867dbd-1d8b-40e5-b376-bfd0dde5be5d tempest-TestServerVolumeAttachmentScenario-18472656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6e09d55-6ac3-4e5a-887a-11bb643253b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:22:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-476741383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7a3359b-2c8e-4495-a87b-42cc222a17dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10cb20001c1a47daaf2692e9e1c47569',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:22:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:22:19Z,use_quota=True,user_id='e64bc7d4847948018eab87206d8dfc52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:22:18 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-60867dbd-1d8b-40e5-b376-bfd0dde5be5d tempest-TestServerVolumeAttachmentScenario-18472656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13c2a71a-3dc5-4858-a499-ff6c4c40c405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:22:18 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-60867dbd-1d8b-40e5-b376-bfd0dde5be5d tempest-TestServerVolumeAttachmentScenario-18472656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13c2a71a-3dc5-4858-a499-ff6c4c40c405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:22:18 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-60867dbd-1d8b-40e5-b376-bfd0dde5be5d tempest-TestServerVolumeAttachmentScenario-18472656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44a00563-2c51-48f3-9b4b-cd0eb09ffc24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:22:18 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-60867dbd-1d8b-40e5-b376-bfd0dde5be5d tempest-TestServerVolumeAttachmentScenario-18472656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44a00563-2c51-48f3-9b4b-cd0eb09ffc24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7a3359b-2c8e-4495-a87b-42cc222a17dc', 'volume_name': 'volume-b7a3359b-2c8e-4495-a87b-42cc222a17dc', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:22:18 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-60867dbd-1d8b-40e5-b376-bfd0dde5be5d tempest-TestServerVolumeAttachmentScenario-18472656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83b0eeeb-fbd8-4df8-8376-54d59e34ab6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:22:18 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-60867dbd-1d8b-40e5-b376-bfd0dde5be5d tempest-TestServerVolumeAttachmentScenario-18472656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83b0eeeb-fbd8-4df8-8376-54d59e34ab6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:22:18 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-60867dbd-1d8b-40e5-b376-bfd0dde5be5d tempest-TestServerVolumeAttachmentScenario-18472656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f818a555-8215-4c87-8088-f78cd9ecd59a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:22:18 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-60867dbd-1d8b-40e5-b376-bfd0dde5be5d tempest-TestServerVolumeAttachmentScenario-18472656 None] Volume b7a3359b-2c8e-4495-a87b-42cc222a17dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7a3359b-2c8e-4495-a87b-42cc222a17dc', 'volume_size': 1} Aug 05 10:22:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-60867dbd-1d8b-40e5-b376-bfd0dde5be5d tempest-TestServerVolumeAttachmentScenario-18472656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:22:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-9d6e7dff-89a4-4d60-afff-04c82ec76342 tempest-VolumesListAdminTestJSON-28853318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:22:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-9d6e7dff-89a4-4d60-afff-04c82ec76342 tempest-VolumesListAdminTestJSON-28853318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:22:19 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-9d6e7dff-89a4-4d60-afff-04c82ec76342 tempest-VolumesListAdminTestJSON-28853318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:22:19 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-9d6e7dff-89a4-4d60-afff-04c82ec76342 tempest-VolumesListAdminTestJSON-28853318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:22:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-9d6e7dff-89a4-4d60-afff-04c82ec76342 tempest-VolumesListAdminTestJSON-28853318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:22:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9d6e7dff-89a4-4d60-afff-04c82ec76342 tempest-VolumesListAdminTestJSON-28853318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:22:19 devstack sudo[98801]: pam_unix(sudo:session): session closed for user root Aug 05 10:22:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [req-7f28f261-e49b-4266-b436-a03e3fad71e0 req-1386b200-ac80-4c34-a88d-09f2454d4bfa tempest-VolumesSnapshotsTestJSON-1809912492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1bbd5876-7e12-48cd-bcc1-30cd221915d8.dbd49d08-c7f6-4f56-9c94-9f4311120f7c" returned: 0 in 0.516s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:22:19 devstack sudo[98808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:22:19 devstack sudo[98808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:22:19 devstack sudo[98797]: pam_unix(sudo:session): session closed for user root Aug 05 10:22:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-86b67e18-04b6-470c-8c82-b76c057bc88e tempest-TestServerVolumeAttachmentScenario-18472656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3ac49342-aa81-4663-9939-d798f6deb6b0 1073741824" returned: 0 in 0.825s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:22:19 devstack cinder-volume[88613]: DEBUG cinder.coordination [req-7f28f261-e49b-4266-b436-a03e3fad71e0 req-1386b200-ac80-4c34-a88d-09f2454d4bfa tempest-VolumesSnapshotsTestJSON-1809912492 None] Lock "cinder-quobyte-dbd49d08-c7f6-4f56-9c94-9f4311120f7c" released by "_delete_snapshot" :: held 2.673s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:22:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-f8001c00-1994-4f96-a684-9ebc11ed8122 tempest-VolumesListAdminTestJSON-2061557699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:22:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-f8001c00-1994-4f96-a684-9ebc11ed8122 tempest-VolumesListAdminTestJSON-2061557699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:22:19 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-f8001c00-1994-4f96-a684-9ebc11ed8122 tempest-VolumesListAdminTestJSON-2061557699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:22:19 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-f8001c00-1994-4f96-a684-9ebc11ed8122 tempest-VolumesListAdminTestJSON-2061557699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:22:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-f8001c00-1994-4f96-a684-9ebc11ed8122 tempest-VolumesListAdminTestJSON-2061557699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:22:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f8001c00-1994-4f96-a684-9ebc11ed8122 tempest-VolumesListAdminTestJSON-2061557699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:22:19 devstack cinder-volume[88613]: DEBUG cinder.coordination [req-7f28f261-e49b-4266-b436-a03e3fad71e0 req-1386b200-ac80-4c34-a88d-09f2454d4bfa tempest-VolumesSnapshotsTestJSON-1809912492 None] Lock "cinder-quobyte-1bbd5876-7e12-48cd-bcc1-30cd221915d8" released by "delete_snapshot" :: held 2.754s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:22:19 devstack sudo[98810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:22:19 devstack sudo[98810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:22:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-86b67e18-04b6-470c-8c82-b76c057bc88e tempest-TestServerVolumeAttachmentScenario-18472656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3ac49342-aa81-4663-9939-d798f6deb6b0 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:22:19 devstack sudo[98812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3ac49342-aa81-4663-9939-d798f6deb6b0 Aug 05 10:22:19 devstack sudo[98812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:22:19 devstack cinder-volume[88613]: DEBUG cinder.quota [req-7f28f261-e49b-4266-b436-a03e3fad71e0 req-1386b200-ac80-4c34-a88d-09f2454d4bfa tempest-VolumesSnapshotsTestJSON-1809912492 None] Created reservations ['e9944514-6311-4833-b0d9-b540ae3ce409', '5d230e55-72f3-4f61-b1f4-70c0c663464a', 'e173775d-1796-424d-80b2-bb9df75582c1', 'f4cffd19-fedd-4da8-99eb-609e8d271911'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:22:19 devstack sudo[98808]: pam_unix(sudo:session): session closed for user root Aug 05 10:22:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9d6e7dff-89a4-4d60-afff-04c82ec76342 tempest-VolumesListAdminTestJSON-28853318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.364s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:22:19 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-9d6e7dff-89a4-4d60-afff-04c82ec76342 tempest-VolumesListAdminTestJSON-28853318 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:22:19 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-9d6e7dff-89a4-4d60-afff-04c82ec76342 tempest-VolumesListAdminTestJSON-28853318 None] Deleted volume successfully. Aug 05 10:22:19 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-9d6e7dff-89a4-4d60-afff-04c82ec76342 tempest-VolumesListAdminTestJSON-28853318 None] Lock "cinder-134f1538-b82b-4718-b7be-da7964f45e41-delete_volume" released by "delete_volume" :: held 2.455s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:22:19 devstack cinder-volume[88613]: INFO cinder.volume.manager [req-7f28f261-e49b-4266-b436-a03e3fad71e0 req-1386b200-ac80-4c34-a88d-09f2454d4bfa tempest-VolumesSnapshotsTestJSON-1809912492 None] Delete snapshot completed successfully. Aug 05 10:22:19 devstack cinder-volume[88613]: DEBUG cinder.coordination [req-7f28f261-e49b-4266-b436-a03e3fad71e0 req-1386b200-ac80-4c34-a88d-09f2454d4bfa tempest-VolumesSnapshotsTestJSON-1809912492 None] Lock "cinder-dbd49d08-c7f6-4f56-9c94-9f4311120f7c-delete_snapshot" released by "delete_snapshot" :: held 3.121s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:22:19 devstack sudo[98810]: pam_unix(sudo:session): session closed for user root Aug 05 10:22:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f8001c00-1994-4f96-a684-9ebc11ed8122 tempest-VolumesListAdminTestJSON-2061557699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.425s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:22:19 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-f8001c00-1994-4f96-a684-9ebc11ed8122 tempest-VolumesListAdminTestJSON-2061557699 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:22:19 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-f8001c00-1994-4f96-a684-9ebc11ed8122 tempest-VolumesListAdminTestJSON-2061557699 None] Deleted volume successfully. Aug 05 10:22:19 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-f8001c00-1994-4f96-a684-9ebc11ed8122 tempest-VolumesListAdminTestJSON-2061557699 None] Lock "cinder-1c458701-29fb-4e62-8f72-55a0c9e3b01e-delete_volume" released by "delete_volume" :: held 2.424s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:22:19 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-3d1d11e5-0417-4a79-8667-16a608c92209 tempest-VolumesListAdminTestJSON-2061557699 None] Acquiring lock "cinder-4e35af5f-d5fc-4ac9-89bd-34711975fb2d-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:22:19 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-3d1d11e5-0417-4a79-8667-16a608c92209 tempest-VolumesListAdminTestJSON-2061557699 None] Lock "cinder-4e35af5f-d5fc-4ac9-89bd-34711975fb2d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:22:19 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-3d1d11e5-0417-4a79-8667-16a608c92209 tempest-VolumesListAdminTestJSON-2061557699 None] Acquiring lock "cinder-quobyte-4e35af5f-d5fc-4ac9-89bd-34711975fb2d" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:22:19 devstack sudo[98812]: pam_unix(sudo:session): session closed for user root Aug 05 10:22:19 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-3d1d11e5-0417-4a79-8667-16a608c92209 tempest-VolumesListAdminTestJSON-2061557699 None] Lock "cinder-quobyte-4e35af5f-d5fc-4ac9-89bd-34711975fb2d" acquired by "delete_volume" :: waited 0.021s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:22:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-86b67e18-04b6-470c-8c82-b76c057bc88e tempest-TestServerVolumeAttachmentScenario-18472656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3ac49342-aa81-4663-9939-d798f6deb6b0" returned: 0 in 0.581s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:22:19 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-86b67e18-04b6-470c-8c82-b76c057bc88e tempest-TestServerVolumeAttachmentScenario-18472656 None] <== create_volume: return (1540ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:22:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-86b67e18-04b6-470c-8c82-b76c057bc88e tempest-TestServerVolumeAttachmentScenario-18472656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.544s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:22:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-60867dbd-1d8b-40e5-b376-bfd0dde5be5d tempest-TestServerVolumeAttachmentScenario-18472656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.915s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:22:19 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-60867dbd-1d8b-40e5-b376-bfd0dde5be5d tempest-TestServerVolumeAttachmentScenario-18472656 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:22:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-476741383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7a3359b-2c8e-4495-a87b-42cc222a17dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10cb20001c1a47daaf2692e9e1c47569',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:22:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:22:19Z,use_quota=True,user_id='e64bc7d4847948018eab87206d8dfc52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:22:19 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-60867dbd-1d8b-40e5-b376-bfd0dde5be5d tempest-TestServerVolumeAttachmentScenario-18472656 None] Creating volume b7a3359b-2c8e-4495-a87b-42cc222a17dc {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:22:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-60867dbd-1d8b-40e5-b376-bfd0dde5be5d tempest-TestServerVolumeAttachmentScenario-18472656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:22:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-60867dbd-1d8b-40e5-b376-bfd0dde5be5d tempest-TestServerVolumeAttachmentScenario-18472656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:22:19 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-60867dbd-1d8b-40e5-b376-bfd0dde5be5d tempest-TestServerVolumeAttachmentScenario-18472656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:22:19 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-60867dbd-1d8b-40e5-b376-bfd0dde5be5d tempest-TestServerVolumeAttachmentScenario-18472656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:22:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-60867dbd-1d8b-40e5-b376-bfd0dde5be5d tempest-TestServerVolumeAttachmentScenario-18472656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:22:19 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-60867dbd-1d8b-40e5-b376-bfd0dde5be5d tempest-TestServerVolumeAttachmentScenario-18472656 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:22:19 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-60867dbd-1d8b-40e5-b376-bfd0dde5be5d tempest-TestServerVolumeAttachmentScenario-18472656 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:22:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-60867dbd-1d8b-40e5-b376-bfd0dde5be5d tempest-TestServerVolumeAttachmentScenario-18472656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-b7a3359b-2c8e-4495-a87b-42cc222a17dc 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:22:19 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[7faf67ff-86a4-4bee-a9de-18ac3599ab92]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:22:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3d1d11e5-0417-4a79-8667-16a608c92209 tempest-VolumesListAdminTestJSON-2061557699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-4e35af5f-d5fc-4ac9-89bd-34711975fb2d {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:22:19 devstack sudo[98817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-b7a3359b-2c8e-4495-a87b-42cc222a17dc 1073741824 Aug 05 10:22:19 devstack sudo[98817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:22:19 devstack cinder-volume[88613]: DEBUG cinder.coordination [req-055a7f19-9674-4ce8-8930-fdcd9ecd82c8 req-2961ff3a-ab6d-404b-bbb3-3ee10a511139 tempest-VolumesSnapshotsTestJSON-1809912492 None] Acquiring lock "cinder-1bbd5876-7e12-48cd-bcc1-30cd221915d8-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:22:19 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-86b67e18-04b6-470c-8c82-b76c057bc88e tempest-TestServerVolumeAttachmentScenario-18472656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5b855b7-be4c-45d7-9731-d29cb648d255) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ac49342-aa81-4663-9939-d798f6deb6b0', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:22:19 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-86b67e18-04b6-470c-8c82-b76c057bc88e tempest-TestServerVolumeAttachmentScenario-18472656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cb0ae3f-0bec-412b-9959-3d2d89cc750d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:22:20 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-86b67e18-04b6-470c-8c82-b76c057bc88e tempest-TestServerVolumeAttachmentScenario-18472656 None] Volume volume-3ac49342-aa81-4663-9939-d798f6deb6b0 (3ac49342-aa81-4663-9939-d798f6deb6b0): created successfully Aug 05 10:22:20 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-86b67e18-04b6-470c-8c82-b76c057bc88e tempest-TestServerVolumeAttachmentScenario-18472656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cb0ae3f-0bec-412b-9959-3d2d89cc750d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:22:20 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-86b67e18-04b6-470c-8c82-b76c057bc88e tempest-TestServerVolumeAttachmentScenario-18472656 None] Flow 'volume_create_manager' (a56ee078-ba70-4036-a5fd-c64806ee33e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:22:20 devstack cinder-volume[88613]: DEBUG cinder.coordination [req-055a7f19-9674-4ce8-8930-fdcd9ecd82c8 req-2961ff3a-ab6d-404b-bbb3-3ee10a511139 tempest-VolumesSnapshotsTestJSON-1809912492 None] Lock "cinder-1bbd5876-7e12-48cd-bcc1-30cd221915d8-delete_volume" acquired by "delete_volume" :: waited 0.122s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:22:20 devstack sudo[98818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-4e35af5f-d5fc-4ac9-89bd-34711975fb2d Aug 05 10:22:20 devstack sudo[98818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:22:20 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-86b67e18-04b6-470c-8c82-b76c057bc88e tempest-TestServerVolumeAttachmentScenario-18472656 None] Created volume successfully. Aug 05 10:22:20 devstack cinder-volume[88613]: DEBUG cinder.coordination [req-055a7f19-9674-4ce8-8930-fdcd9ecd82c8 req-2961ff3a-ab6d-404b-bbb3-3ee10a511139 tempest-VolumesSnapshotsTestJSON-1809912492 None] Acquiring lock "cinder-quobyte-1bbd5876-7e12-48cd-bcc1-30cd221915d8" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:22:20 devstack cinder-volume[88613]: DEBUG cinder.coordination [req-055a7f19-9674-4ce8-8930-fdcd9ecd82c8 req-2961ff3a-ab6d-404b-bbb3-3ee10a511139 tempest-VolumesSnapshotsTestJSON-1809912492 None] Lock "cinder-quobyte-1bbd5876-7e12-48cd-bcc1-30cd221915d8" acquired by "delete_volume" :: waited 0.021s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:22:20 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[901958e5-db8f-43f4-aa0a-9941e8cfc51d]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:22:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [req-055a7f19-9674-4ce8-8930-fdcd9ecd82c8 req-2961ff3a-ab6d-404b-bbb3-3ee10a511139 tempest-VolumesSnapshotsTestJSON-1809912492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1bbd5876-7e12-48cd-bcc1-30cd221915d8 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:22:20 devstack sudo[98821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1bbd5876-7e12-48cd-bcc1-30cd221915d8 Aug 05 10:22:20 devstack sudo[98821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:22:20 devstack sudo[98818]: pam_unix(sudo:session): session closed for user root Aug 05 10:22:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3d1d11e5-0417-4a79-8667-16a608c92209 tempest-VolumesListAdminTestJSON-2061557699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-4e35af5f-d5fc-4ac9-89bd-34711975fb2d" returned: 0 in 0.584s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:22:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3d1d11e5-0417-4a79-8667-16a608c92209 tempest-VolumesListAdminTestJSON-2061557699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-4e35af5f-d5fc-4ac9-89bd-34711975fb2d {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:22:20 devstack sudo[98830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-4e35af5f-d5fc-4ac9-89bd-34711975fb2d Aug 05 10:22:20 devstack sudo[98830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:22:20 devstack sudo[98817]: pam_unix(sudo:session): session closed for user root Aug 05 10:22:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-60867dbd-1d8b-40e5-b376-bfd0dde5be5d tempest-TestServerVolumeAttachmentScenario-18472656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-b7a3359b-2c8e-4495-a87b-42cc222a17dc 1073741824" returned: 0 in 0.784s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:22:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-60867dbd-1d8b-40e5-b376-bfd0dde5be5d tempest-TestServerVolumeAttachmentScenario-18472656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-b7a3359b-2c8e-4495-a87b-42cc222a17dc {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:22:20 devstack sudo[98834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-b7a3359b-2c8e-4495-a87b-42cc222a17dc Aug 05 10:22:20 devstack sudo[98834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:22:20 devstack sudo[98821]: pam_unix(sudo:session): session closed for user root Aug 05 10:22:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [req-055a7f19-9674-4ce8-8930-fdcd9ecd82c8 req-2961ff3a-ab6d-404b-bbb3-3ee10a511139 tempest-VolumesSnapshotsTestJSON-1809912492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1bbd5876-7e12-48cd-bcc1-30cd221915d8" returned: 0 in 0.588s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:22:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [req-055a7f19-9674-4ce8-8930-fdcd9ecd82c8 req-2961ff3a-ab6d-404b-bbb3-3ee10a511139 tempest-VolumesSnapshotsTestJSON-1809912492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1bbd5876-7e12-48cd-bcc1-30cd221915d8 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:22:20 devstack sudo[98830]: pam_unix(sudo:session): session closed for user root Aug 05 10:22:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3d1d11e5-0417-4a79-8667-16a608c92209 tempest-VolumesListAdminTestJSON-2061557699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-4e35af5f-d5fc-4ac9-89bd-34711975fb2d" returned: 0 in 0.363s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:22:20 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-3d1d11e5-0417-4a79-8667-16a608c92209 tempest-VolumesListAdminTestJSON-2061557699 None] Lock "cinder-quobyte-4e35af5f-d5fc-4ac9-89bd-34711975fb2d" released by "delete_volume" :: held 1.045s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:22:20 devstack sudo[98839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1bbd5876-7e12-48cd-bcc1-30cd221915d8 Aug 05 10:22:20 devstack sudo[98839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:22:20 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-3d1d11e5-0417-4a79-8667-16a608c92209 tempest-VolumesListAdminTestJSON-2061557699 None] Created reservations ['3b0eda45-e56f-44fe-97e7-4db303c8958f', '73b1201b-6687-492d-b2a8-d724ac921ced', '6d36edf9-04c5-4766-93e4-7e85160355d5', 'd3b0708b-ad90-4409-87fd-7ee51eaa4598'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:22:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-3d1d11e5-0417-4a79-8667-16a608c92209 tempest-VolumesListAdminTestJSON-2061557699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:22:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-3d1d11e5-0417-4a79-8667-16a608c92209 tempest-VolumesListAdminTestJSON-2061557699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:22:21 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-3d1d11e5-0417-4a79-8667-16a608c92209 tempest-VolumesListAdminTestJSON-2061557699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:22:21 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-3d1d11e5-0417-4a79-8667-16a608c92209 tempest-VolumesListAdminTestJSON-2061557699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:22:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-3d1d11e5-0417-4a79-8667-16a608c92209 tempest-VolumesListAdminTestJSON-2061557699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:22:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3d1d11e5-0417-4a79-8667-16a608c92209 tempest-VolumesListAdminTestJSON-2061557699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:22:21 devstack sudo[98842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:22:21 devstack sudo[98842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:22:21 devstack sudo[98834]: pam_unix(sudo:session): session closed for user root Aug 05 10:22:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-60867dbd-1d8b-40e5-b376-bfd0dde5be5d tempest-TestServerVolumeAttachmentScenario-18472656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-b7a3359b-2c8e-4495-a87b-42cc222a17dc" returned: 0 in 0.452s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:22:21 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-60867dbd-1d8b-40e5-b376-bfd0dde5be5d tempest-TestServerVolumeAttachmentScenario-18472656 None] <== create_volume: return (1304ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:22:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-60867dbd-1d8b-40e5-b376-bfd0dde5be5d tempest-TestServerVolumeAttachmentScenario-18472656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.308s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:22:21 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-60867dbd-1d8b-40e5-b376-bfd0dde5be5d tempest-TestServerVolumeAttachmentScenario-18472656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f818a555-8215-4c87-8088-f78cd9ecd59a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7a3359b-2c8e-4495-a87b-42cc222a17dc', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:22:21 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-60867dbd-1d8b-40e5-b376-bfd0dde5be5d tempest-TestServerVolumeAttachmentScenario-18472656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afe3d22c-f6a9-49cd-97c4-b273d7697fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:22:21 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-60867dbd-1d8b-40e5-b376-bfd0dde5be5d tempest-TestServerVolumeAttachmentScenario-18472656 None] Volume volume-b7a3359b-2c8e-4495-a87b-42cc222a17dc (b7a3359b-2c8e-4495-a87b-42cc222a17dc): created successfully Aug 05 10:22:21 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-60867dbd-1d8b-40e5-b376-bfd0dde5be5d tempest-TestServerVolumeAttachmentScenario-18472656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afe3d22c-f6a9-49cd-97c4-b273d7697fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:22:21 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-60867dbd-1d8b-40e5-b376-bfd0dde5be5d tempest-TestServerVolumeAttachmentScenario-18472656 None] Flow 'volume_create_manager' (4d8c5384-0979-407f-bffa-c0740d771924) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:22:21 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-60867dbd-1d8b-40e5-b376-bfd0dde5be5d tempest-TestServerVolumeAttachmentScenario-18472656 None] Created volume successfully. Aug 05 10:22:21 devstack sudo[98839]: pam_unix(sudo:session): session closed for user root Aug 05 10:22:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [req-055a7f19-9674-4ce8-8930-fdcd9ecd82c8 req-2961ff3a-ab6d-404b-bbb3-3ee10a511139 tempest-VolumesSnapshotsTestJSON-1809912492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1bbd5876-7e12-48cd-bcc1-30cd221915d8" returned: 0 in 0.444s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:22:21 devstack cinder-volume[88613]: DEBUG cinder.coordination [req-055a7f19-9674-4ce8-8930-fdcd9ecd82c8 req-2961ff3a-ab6d-404b-bbb3-3ee10a511139 tempest-VolumesSnapshotsTestJSON-1809912492 None] Lock "cinder-quobyte-1bbd5876-7e12-48cd-bcc1-30cd221915d8" released by "delete_volume" :: held 1.120s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:22:21 devstack cinder-volume[88613]: DEBUG cinder.quota [req-055a7f19-9674-4ce8-8930-fdcd9ecd82c8 req-2961ff3a-ab6d-404b-bbb3-3ee10a511139 tempest-VolumesSnapshotsTestJSON-1809912492 None] Created reservations ['52fb2276-26bc-44b4-baaf-f98725f2fd80', '5af6ea32-d0fe-4273-91bf-7ffd7659b131', '806bf1a8-8e01-4385-be0b-69485e967954', '0ecd51bc-40fb-477d-8ffb-187073de2ae5'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:22:21 devstack sudo[98842]: pam_unix(sudo:session): session closed for user root Aug 05 10:22:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3d1d11e5-0417-4a79-8667-16a608c92209 tempest-VolumesListAdminTestJSON-2061557699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.318s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:22:21 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-3d1d11e5-0417-4a79-8667-16a608c92209 tempest-VolumesListAdminTestJSON-2061557699 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:22:21 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-3d1d11e5-0417-4a79-8667-16a608c92209 tempest-VolumesListAdminTestJSON-2061557699 None] Deleted volume successfully. Aug 05 10:22:21 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-3d1d11e5-0417-4a79-8667-16a608c92209 tempest-VolumesListAdminTestJSON-2061557699 None] Lock "cinder-4e35af5f-d5fc-4ac9-89bd-34711975fb2d-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:22:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-055a7f19-9674-4ce8-8930-fdcd9ecd82c8 req-2961ff3a-ab6d-404b-bbb3-3ee10a511139 tempest-VolumesSnapshotsTestJSON-1809912492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:22:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-055a7f19-9674-4ce8-8930-fdcd9ecd82c8 req-2961ff3a-ab6d-404b-bbb3-3ee10a511139 tempest-VolumesSnapshotsTestJSON-1809912492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:22:21 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [req-055a7f19-9674-4ce8-8930-fdcd9ecd82c8 req-2961ff3a-ab6d-404b-bbb3-3ee10a511139 tempest-VolumesSnapshotsTestJSON-1809912492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:22:21 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [req-055a7f19-9674-4ce8-8930-fdcd9ecd82c8 req-2961ff3a-ab6d-404b-bbb3-3ee10a511139 tempest-VolumesSnapshotsTestJSON-1809912492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:22:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-055a7f19-9674-4ce8-8930-fdcd9ecd82c8 req-2961ff3a-ab6d-404b-bbb3-3ee10a511139 tempest-VolumesSnapshotsTestJSON-1809912492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:22:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [req-055a7f19-9674-4ce8-8930-fdcd9ecd82c8 req-2961ff3a-ab6d-404b-bbb3-3ee10a511139 tempest-VolumesSnapshotsTestJSON-1809912492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:22:21 devstack sudo[98846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:22:21 devstack sudo[98846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:22:21 devstack sudo[98846]: pam_unix(sudo:session): session closed for user root Aug 05 10:22:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [req-055a7f19-9674-4ce8-8930-fdcd9ecd82c8 req-2961ff3a-ab6d-404b-bbb3-3ee10a511139 tempest-VolumesSnapshotsTestJSON-1809912492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.274s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:22:21 devstack cinder-volume[88613]: DEBUG cinder.manager [req-055a7f19-9674-4ce8-8930-fdcd9ecd82c8 req-2961ff3a-ab6d-404b-bbb3-3ee10a511139 tempest-VolumesSnapshotsTestJSON-1809912492 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:22:21 devstack cinder-volume[88613]: INFO cinder.volume.manager [req-055a7f19-9674-4ce8-8930-fdcd9ecd82c8 req-2961ff3a-ab6d-404b-bbb3-3ee10a511139 tempest-VolumesSnapshotsTestJSON-1809912492 None] Deleted volume successfully. Aug 05 10:22:21 devstack cinder-volume[88613]: DEBUG oslo_service.periodic_task [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88613) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:22:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:22:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:22:21 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:22:21 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:22:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:22:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:22:21 devstack sudo[98849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:22:21 devstack sudo[98849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:22:21 devstack cinder-volume[88613]: DEBUG cinder.coordination [req-055a7f19-9674-4ce8-8930-fdcd9ecd82c8 req-2961ff3a-ab6d-404b-bbb3-3ee10a511139 tempest-VolumesSnapshotsTestJSON-1809912492 None] Lock "cinder-1bbd5876-7e12-48cd-bcc1-30cd221915d8-delete_volume" released by "delete_volume" :: held 1.764s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:22:22 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-1b94ea40-cb2f-48b3-8953-9bd06430417a tempest-VolumesListAdminTestJSON-2061557699 None] Acquiring lock "cinder-7081b18e-2680-440d-b0e1-b0cb25e77547-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:22:22 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-1b94ea40-cb2f-48b3-8953-9bd06430417a tempest-VolumesListAdminTestJSON-2061557699 None] Lock "cinder-7081b18e-2680-440d-b0e1-b0cb25e77547-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:22:22 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-1b94ea40-cb2f-48b3-8953-9bd06430417a tempest-VolumesListAdminTestJSON-2061557699 None] Acquiring lock "cinder-quobyte-7081b18e-2680-440d-b0e1-b0cb25e77547" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:22:22 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-1b94ea40-cb2f-48b3-8953-9bd06430417a tempest-VolumesListAdminTestJSON-2061557699 None] Lock "cinder-quobyte-7081b18e-2680-440d-b0e1-b0cb25e77547" acquired by "delete_volume" :: waited 0.029s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:22:22 devstack sudo[98849]: pam_unix(sudo:session): session closed for user root Aug 05 10:22:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.439s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:22:22 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:22:22 devstack cinder-volume[88613]: DEBUG oslo_service.periodic_task [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Running periodic task VolumeManager._thread_info {{(pid=88613) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:22:22 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] thread count: 28 {{(pid=88613) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 10:22:22 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] thread info: [<_MainThread(MainThread, started 126173666128000)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88613) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 10:22:22 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[21038e8c-9b39-4c0d-9593-44d8eda596bd]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:22:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1b94ea40-cb2f-48b3-8953-9bd06430417a tempest-VolumesListAdminTestJSON-2061557699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7081b18e-2680-440d-b0e1-b0cb25e77547 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:22:22 devstack sudo[98852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7081b18e-2680-440d-b0e1-b0cb25e77547 Aug 05 10:22:22 devstack sudo[98852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:22:22 devstack sudo[98852]: pam_unix(sudo:session): session closed for user root Aug 05 10:22:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1b94ea40-cb2f-48b3-8953-9bd06430417a tempest-VolumesListAdminTestJSON-2061557699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7081b18e-2680-440d-b0e1-b0cb25e77547" returned: 0 in 0.505s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:22:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1b94ea40-cb2f-48b3-8953-9bd06430417a tempest-VolumesListAdminTestJSON-2061557699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7081b18e-2680-440d-b0e1-b0cb25e77547 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:22:22 devstack sudo[98857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7081b18e-2680-440d-b0e1-b0cb25e77547 Aug 05 10:22:22 devstack sudo[98857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:22:23 devstack sudo[98857]: pam_unix(sudo:session): session closed for user root Aug 05 10:22:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1b94ea40-cb2f-48b3-8953-9bd06430417a tempest-VolumesListAdminTestJSON-2061557699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7081b18e-2680-440d-b0e1-b0cb25e77547" returned: 0 in 0.412s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:22:23 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-1b94ea40-cb2f-48b3-8953-9bd06430417a tempest-VolumesListAdminTestJSON-2061557699 None] Lock "cinder-quobyte-7081b18e-2680-440d-b0e1-b0cb25e77547" released by "delete_volume" :: held 1.014s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:22:23 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-1b94ea40-cb2f-48b3-8953-9bd06430417a tempest-VolumesListAdminTestJSON-2061557699 None] Created reservations ['232785c0-fac3-46b3-a3a2-786cbca841dd', 'b1ade697-d16c-42c7-a59b-d16c82bbd4dd', '81f288c8-a07c-41d1-9dd0-c155a4fa5b9a', '16109757-256d-432f-b9d7-e9d514a8733f'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:22:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-1b94ea40-cb2f-48b3-8953-9bd06430417a tempest-VolumesListAdminTestJSON-2061557699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:22:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-1b94ea40-cb2f-48b3-8953-9bd06430417a tempest-VolumesListAdminTestJSON-2061557699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:22:23 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-1b94ea40-cb2f-48b3-8953-9bd06430417a tempest-VolumesListAdminTestJSON-2061557699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:22:23 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-1b94ea40-cb2f-48b3-8953-9bd06430417a tempest-VolumesListAdminTestJSON-2061557699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:22:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-1b94ea40-cb2f-48b3-8953-9bd06430417a tempest-VolumesListAdminTestJSON-2061557699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:22:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1b94ea40-cb2f-48b3-8953-9bd06430417a tempest-VolumesListAdminTestJSON-2061557699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:22:23 devstack sudo[98860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:22:23 devstack sudo[98860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:22:23 devstack sudo[98860]: pam_unix(sudo:session): session closed for user root Aug 05 10:22:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1b94ea40-cb2f-48b3-8953-9bd06430417a tempest-VolumesListAdminTestJSON-2061557699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.380s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:22:23 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-1b94ea40-cb2f-48b3-8953-9bd06430417a tempest-VolumesListAdminTestJSON-2061557699 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:22:23 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-1b94ea40-cb2f-48b3-8953-9bd06430417a tempest-VolumesListAdminTestJSON-2061557699 None] Deleted volume successfully. Aug 05 10:22:23 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-1b94ea40-cb2f-48b3-8953-9bd06430417a tempest-VolumesListAdminTestJSON-2061557699 None] Lock "cinder-7081b18e-2680-440d-b0e1-b0cb25e77547-delete_volume" released by "delete_volume" :: held 1.773s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:22:28 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-59702cfc-4b0a-4ab2-a571-dacaf835c302 tempest-BackendsCapabilitiesAdminTestsJSON-868322627 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7257652282715, 'free_capacity_gb': 1775.7257652282715, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88613) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 05 10:22:28 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-66c4e517-20f4-453b-bd87-3386b2b3bf22 tempest-BackendsCapabilitiesAdminTestsJSON-868322627 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7257652282715, 'free_capacity_gb': 1775.7257652282715, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88613) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 05 10:22:34 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d7fab92-fee3-473d-98ac-6741bce75a8f tempest-VolumesImageMetadata-991663896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:22:34 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2d7fab92-fee3-473d-98ac-6741bce75a8f tempest-VolumesImageMetadata-991663896 None] Flow 'volume_create_manager' (dea76089-d455-4b1f-b825-c470140badab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:22:34 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2d7fab92-fee3-473d-98ac-6741bce75a8f tempest-VolumesImageMetadata-991663896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3b3e680-c892-4dde-b5ef-a2ec42400704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:22:34 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2d7fab92-fee3-473d-98ac-6741bce75a8f tempest-VolumesImageMetadata-991663896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3b3e680-c892-4dde-b5ef-a2ec42400704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:22:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-211807997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a553def-b937-4a8b-b09e-00464811f9d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2c5784ff4454844bde5a9a0ed2ab3e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:22:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:22:35Z,use_quota=True,user_id='e0ed635e6cd94cbf9cf65f302cb763d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:22:34 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2d7fab92-fee3-473d-98ac-6741bce75a8f tempest-VolumesImageMetadata-991663896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00c35d13-e904-4101-be7f-fb04963c2519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:22:34 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2d7fab92-fee3-473d-98ac-6741bce75a8f tempest-VolumesImageMetadata-991663896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00c35d13-e904-4101-be7f-fb04963c2519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:22:34 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2d7fab92-fee3-473d-98ac-6741bce75a8f tempest-VolumesImageMetadata-991663896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b765ed3-0851-422b-b51e-3561a0c91158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:22:34 devstack cinder-volume[88613]: DEBUG cinder.image.glance [None req-2d7fab92-fee3-473d-98ac-6741bce75a8f tempest-VolumesImageMetadata-991663896 None] Creating Keystone auth plugin from conf {{(pid=88613) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 05 10:22:36 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2d7fab92-fee3-473d-98ac-6741bce75a8f tempest-VolumesImageMetadata-991663896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b765ed3-0851-422b-b51e-3561a0c91158) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8a553def-b937-4a8b-b09e-00464811f9d2', 'volume_name': 'volume-8a553def-b937-4a8b-b09e-00464811f9d2', 'volume_size': 1, 'image_id': '89278436-b56f-45f7-8c42-c9afd7bd7453', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/89278436-b56f-45f7-8c42-c9afd7bd7453', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '654c7af809d145caaadc8738d3dc3df2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '89278436-b56f-45f7-8c42-c9afd7bd7453', 'created_at': datetime.datetime(2026, 8, 5, 8, 7, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 8, 7, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/89278436-b56f-45f7-8c42-c9afd7bd7453/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:22:36 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2d7fab92-fee3-473d-98ac-6741bce75a8f tempest-VolumesImageMetadata-991663896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (231f9147-5ba9-4ca6-aa96-cf2bd6a8fbe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:22:36 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2d7fab92-fee3-473d-98ac-6741bce75a8f tempest-VolumesImageMetadata-991663896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (231f9147-5ba9-4ca6-aa96-cf2bd6a8fbe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:22:36 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2d7fab92-fee3-473d-98ac-6741bce75a8f tempest-VolumesImageMetadata-991663896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ff9107d-b62a-4c5f-b1e3-5ac8cfd69dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:22:36 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-2d7fab92-fee3-473d-98ac-6741bce75a8f tempest-VolumesImageMetadata-991663896 None] Volume 8a553def-b937-4a8b-b09e-00464811f9d2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8a553def-b937-4a8b-b09e-00464811f9d2', 'volume_size': 1, 'image_id': '89278436-b56f-45f7-8c42-c9afd7bd7453', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/89278436-b56f-45f7-8c42-c9afd7bd7453', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '654c7af809d145caaadc8738d3dc3df2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '89278436-b56f-45f7-8c42-c9afd7bd7453', 'created_at': datetime.datetime(2026, 8, 5, 8, 7, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 8, 7, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/89278436-b56f-45f7-8c42-c9afd7bd7453/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 05 10:22:36 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d7fab92-fee3-473d-98ac-6741bce75a8f tempest-VolumesImageMetadata-991663896 None] Trying to clone 8a553def-b937-4a8b-b09e-00464811f9d2 from image 89278436-b56f-45f7-8c42-c9afd7bd7453 at location (None, [{'url': 'file:///opt/stack/data/glance/images/89278436-b56f-45f7-8c42-c9afd7bd7453', 'metadata': {}}]). {{(pid=88613) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 05 10:22:37 devstack cinder-volume[88613]: DEBUG cinder.image.image_utils [None req-2d7fab92-fee3-473d-98ac-6741bce75a8f tempest-VolumesImageMetadata-991663896 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_89278436-b56f-45f7-8c42-c9afd7bd7453_q_hj9cfhdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88613) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 05 10:22:37 devstack cinder-volume[88613]: INFO cinder.image.image_utils [None req-2d7fab92-fee3-473d-98ac-6741bce75a8f tempest-VolumesImageMetadata-991663896 None] Image download 20.69 MB at 20.69 MB/s Aug 05 10:22:37 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[87bbb794-a1dc-4e98-9a76-12e8b28909fa]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:22:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2d7fab92-fee3-473d-98ac-6741bce75a8f tempest-VolumesImageMetadata-991663896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89278436-b56f-45f7-8c42-c9afd7bd7453_q_hj9cfhdevstack@QuobyteHD {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:22:37 devstack sudo[98959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89278436-b56f-45f7-8c42-c9afd7bd7453_q_hj9cfhdevstack@QuobyteHD Aug 05 10:22:37 devstack sudo[98959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:22:37 devstack sudo[98959]: pam_unix(sudo:session): session closed for user root Aug 05 10:22:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2d7fab92-fee3-473d-98ac-6741bce75a8f tempest-VolumesImageMetadata-991663896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89278436-b56f-45f7-8c42-c9afd7bd7453_q_hj9cfhdevstack@QuobyteHD" returned: 0 in 0.433s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:22:37 devstack cinder-volume[88613]: DEBUG cinder.image.image_utils [None req-2d7fab92-fee3-473d-98ac-6741bce75a8f tempest-VolumesImageMetadata-991663896 None] Temporary image 89278436-b56f-45f7-8c42-c9afd7bd7453 is fetched for user e0ed635e6cd94cbf9cf65f302cb763d6. {{(pid=88613) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 05 10:22:38 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[d30e299f-5fef-41ce-bb37-d7ad3b2b6d37]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:22:38 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2d7fab92-fee3-473d-98ac-6741bce75a8f tempest-VolumesImageMetadata-991663896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89278436-b56f-45f7-8c42-c9afd7bd7453_q_hj9cfhdevstack@QuobyteHD {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:22:38 devstack sudo[98975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89278436-b56f-45f7-8c42-c9afd7bd7453_q_hj9cfhdevstack@QuobyteHD Aug 05 10:22:38 devstack sudo[98975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:22:38 devstack sudo[98975]: pam_unix(sudo:session): session closed for user root Aug 05 10:22:38 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2d7fab92-fee3-473d-98ac-6741bce75a8f tempest-VolumesImageMetadata-991663896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89278436-b56f-45f7-8c42-c9afd7bd7453_q_hj9cfhdevstack@QuobyteHD" returned: 0 in 0.597s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:22:38 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2d7fab92-fee3-473d-98ac-6741bce75a8f tempest-VolumesImageMetadata-991663896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:22:38 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2d7fab92-fee3-473d-98ac-6741bce75a8f tempest-VolumesImageMetadata-991663896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:22:38 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-2d7fab92-fee3-473d-98ac-6741bce75a8f tempest-VolumesImageMetadata-991663896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:22:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-211807997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a553def-b937-4a8b-b09e-00464811f9d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2c5784ff4454844bde5a9a0ed2ab3e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:22:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:22:35Z,use_quota=True,user_id='e0ed635e6cd94cbf9cf65f302cb763d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:22:38 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-2d7fab92-fee3-473d-98ac-6741bce75a8f tempest-VolumesImageMetadata-991663896 None] Creating volume 8a553def-b937-4a8b-b09e-00464811f9d2 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:22:38 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2d7fab92-fee3-473d-98ac-6741bce75a8f tempest-VolumesImageMetadata-991663896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:22:38 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2d7fab92-fee3-473d-98ac-6741bce75a8f tempest-VolumesImageMetadata-991663896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:22:38 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-2d7fab92-fee3-473d-98ac-6741bce75a8f tempest-VolumesImageMetadata-991663896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:22:38 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-2d7fab92-fee3-473d-98ac-6741bce75a8f tempest-VolumesImageMetadata-991663896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:22:38 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2d7fab92-fee3-473d-98ac-6741bce75a8f tempest-VolumesImageMetadata-991663896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:22:38 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-2d7fab92-fee3-473d-98ac-6741bce75a8f tempest-VolumesImageMetadata-991663896 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:22:38 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-2d7fab92-fee3-473d-98ac-6741bce75a8f tempest-VolumesImageMetadata-991663896 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:22:38 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2d7fab92-fee3-473d-98ac-6741bce75a8f tempest-VolumesImageMetadata-991663896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8a553def-b937-4a8b-b09e-00464811f9d2 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:22:38 devstack sudo[98981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8a553def-b937-4a8b-b09e-00464811f9d2 1073741824 Aug 05 10:22:38 devstack sudo[98981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:22:39 devstack sudo[98981]: pam_unix(sudo:session): session closed for user root Aug 05 10:22:39 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2d7fab92-fee3-473d-98ac-6741bce75a8f tempest-VolumesImageMetadata-991663896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8a553def-b937-4a8b-b09e-00464811f9d2 1073741824" returned: 0 in 0.930s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:22:39 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2d7fab92-fee3-473d-98ac-6741bce75a8f tempest-VolumesImageMetadata-991663896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8a553def-b937-4a8b-b09e-00464811f9d2 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:22:39 devstack sudo[98988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8a553def-b937-4a8b-b09e-00464811f9d2 Aug 05 10:22:39 devstack sudo[98988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:22:40 devstack sudo[98988]: pam_unix(sudo:session): session closed for user root Aug 05 10:22:40 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2d7fab92-fee3-473d-98ac-6741bce75a8f tempest-VolumesImageMetadata-991663896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8a553def-b937-4a8b-b09e-00464811f9d2" returned: 0 in 0.567s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:22:40 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-2d7fab92-fee3-473d-98ac-6741bce75a8f tempest-VolumesImageMetadata-991663896 None] <== create_volume: return (1559ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:22:40 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2d7fab92-fee3-473d-98ac-6741bce75a8f tempest-VolumesImageMetadata-991663896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.564s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:22:40 devstack cinder-volume[88613]: DEBUG cinder.volume.volume_utils [None req-2d7fab92-fee3-473d-98ac-6741bce75a8f tempest-VolumesImageMetadata-991663896 None] Attempting download of 89278436-b56f-45f7-8c42-c9afd7bd7453 ((None, [{'url': 'file:///opt/stack/data/glance/images/89278436-b56f-45f7-8c42-c9afd7bd7453', 'metadata': {}}])) to volume 8a553def-b937-4a8b-b09e-00464811f9d2. {{(pid=88613) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 05 10:22:40 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bdc70a9-1f0f-4d34-bb79-ffd1d0971ce1]: (4, 'raw') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:22:40 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2d7fab92-fee3-473d-98ac-6741bce75a8f tempest-VolumesImageMetadata-991663896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_89278436-b56f-45f7-8c42-c9afd7bd7453_pidj9fqe {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:22:40 devstack sudo[98994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_89278436-b56f-45f7-8c42-c9afd7bd7453_pidj9fqe Aug 05 10:22:40 devstack sudo[98994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:22:40 devstack sudo[98994]: pam_unix(sudo:session): session closed for user root Aug 05 10:22:40 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2d7fab92-fee3-473d-98ac-6741bce75a8f tempest-VolumesImageMetadata-991663896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_89278436-b56f-45f7-8c42-c9afd7bd7453_pidj9fqe" returned: 0 in 0.499s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:22:40 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2d7fab92-fee3-473d-98ac-6741bce75a8f tempest-VolumesImageMetadata-991663896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_89278436-b56f-45f7-8c42-c9afd7bd7453_pidj9fqe {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:22:41 devstack sudo[98998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_89278436-b56f-45f7-8c42-c9afd7bd7453_pidj9fqe Aug 05 10:22:41 devstack sudo[98998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:22:41 devstack sudo[98998]: pam_unix(sudo:session): session closed for user root Aug 05 10:22:41 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2d7fab92-fee3-473d-98ac-6741bce75a8f tempest-VolumesImageMetadata-991663896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_89278436-b56f-45f7-8c42-c9afd7bd7453_pidj9fqe" returned: 1 in 0.705s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:22:41 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2d7fab92-fee3-473d-98ac-6741bce75a8f tempest-VolumesImageMetadata-991663896 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_89278436-b56f-45f7-8c42-c9afd7bd7453_pidj9fqe' failed. Not Retrying. {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 10:22:41 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[e84eb725-d698-4552-b85f-9de76f3ed0a1]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:22:41 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2d7fab92-fee3-473d-98ac-6741bce75a8f tempest-VolumesImageMetadata-991663896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89278436-b56f-45f7-8c42-c9afd7bd7453_q_hj9cfhdevstack@QuobyteHD {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:22:41 devstack sudo[99002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89278436-b56f-45f7-8c42-c9afd7bd7453_q_hj9cfhdevstack@QuobyteHD Aug 05 10:22:41 devstack sudo[99002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:22:42 devstack sudo[99002]: pam_unix(sudo:session): session closed for user root Aug 05 10:22:42 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2d7fab92-fee3-473d-98ac-6741bce75a8f tempest-VolumesImageMetadata-991663896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89278436-b56f-45f7-8c42-c9afd7bd7453_q_hj9cfhdevstack@QuobyteHD" returned: 0 in 0.549s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:22:42 devstack cinder-volume[88613]: DEBUG cinder.image.image_utils [None req-2d7fab92-fee3-473d-98ac-6741bce75a8f tempest-VolumesImageMetadata-991663896 None] 89278436-b56f-45f7-8c42-c9afd7bd7453 was qcow2, converting to qcow2 {{(pid=88613) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 05 10:22:42 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2d7fab92-fee3-473d-98ac-6741bce75a8f tempest-VolumesImageMetadata-991663896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_89278436-b56f-45f7-8c42-c9afd7bd7453_q_hj9cfhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8a553def-b937-4a8b-b09e-00464811f9d2 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:22:42 devstack sudo[99008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_89278436-b56f-45f7-8c42-c9afd7bd7453_q_hj9cfhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8a553def-b937-4a8b-b09e-00464811f9d2 Aug 05 10:22:42 devstack sudo[99008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:22:44 devstack sudo[99008]: pam_unix(sudo:session): session closed for user root Aug 05 10:22:45 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2d7fab92-fee3-473d-98ac-6741bce75a8f tempest-VolumesImageMetadata-991663896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_89278436-b56f-45f7-8c42-c9afd7bd7453_q_hj9cfhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8a553def-b937-4a8b-b09e-00464811f9d2" returned: 0 in 2.833s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:22:45 devstack cinder-volume[88613]: DEBUG cinder.image.image_utils [None req-2d7fab92-fee3-473d-98ac-6741bce75a8f tempest-VolumesImageMetadata-991663896 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_89278436-b56f-45f7-8c42-c9afd7bd7453_q_hj9cfhdevstack@QuobyteHD, size 112.00 MB, duration 2.84 sec, destination /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8a553def-b937-4a8b-b09e-00464811f9d2 {{(pid=88613) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 10:22:45 devstack cinder-volume[88613]: INFO cinder.image.image_utils [None req-2d7fab92-fee3-473d-98ac-6741bce75a8f tempest-VolumesImageMetadata-991663896 None] Converted 112.00 MB image at 39.50 MB/s Aug 05 10:22:45 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2d7fab92-fee3-473d-98ac-6741bce75a8f tempest-VolumesImageMetadata-991663896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8a553def-b937-4a8b-b09e-00464811f9d2 1G {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:22:45 devstack sudo[99036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8a553def-b937-4a8b-b09e-00464811f9d2 1G Aug 05 10:22:45 devstack sudo[99036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:22:45 devstack sudo[99036]: pam_unix(sudo:session): session closed for user root Aug 05 10:22:45 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2d7fab92-fee3-473d-98ac-6741bce75a8f tempest-VolumesImageMetadata-991663896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8a553def-b937-4a8b-b09e-00464811f9d2 1G" returned: 0 in 0.536s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:22:45 devstack cinder-volume[88613]: DEBUG cinder.volume.volume_utils [None req-2d7fab92-fee3-473d-98ac-6741bce75a8f tempest-VolumesImageMetadata-991663896 None] Downloaded image 89278436-b56f-45f7-8c42-c9afd7bd7453 ((None, [{'url': 'file:///opt/stack/data/glance/images/89278436-b56f-45f7-8c42-c9afd7bd7453', 'metadata': {}}])) to volume 8a553def-b937-4a8b-b09e-00464811f9d2 successfully. {{(pid=88613) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 05 10:22:45 devstack cinder-volume[88613]: DEBUG cinder.image.image_utils [None req-2d7fab92-fee3-473d-98ac-6741bce75a8f tempest-VolumesImageMetadata-991663896 None] Temporary image 89278436-b56f-45f7-8c42-c9afd7bd7453 for user e0ed635e6cd94cbf9cf65f302cb763d6 is deleted. {{(pid=88613) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 05 10:22:45 devstack cinder-volume[88613]: DEBUG cinder.volume.volume_utils [None req-2d7fab92-fee3-473d-98ac-6741bce75a8f tempest-VolumesImageMetadata-991663896 None] Marking volume 8a553def-b937-4a8b-b09e-00464811f9d2 as bootable. {{(pid=88613) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 05 10:22:45 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d7fab92-fee3-473d-98ac-6741bce75a8f tempest-VolumesImageMetadata-991663896 None] Copying metadata from image 89278436-b56f-45f7-8c42-c9afd7bd7453 to 8a553def-b937-4a8b-b09e-00464811f9d2. {{(pid=88613) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 05 10:22:45 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d7fab92-fee3-473d-98ac-6741bce75a8f tempest-VolumesImageMetadata-991663896 None] Creating volume glance metadata for volume 8a553def-b937-4a8b-b09e-00464811f9d2 backed by image 89278436-b56f-45f7-8c42-c9afd7bd7453 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '89278436-b56f-45f7-8c42-c9afd7bd7453', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88613) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 05 10:22:45 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2d7fab92-fee3-473d-98ac-6741bce75a8f tempest-VolumesImageMetadata-991663896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ff9107d-b62a-4c5f-b1e3-5ac8cfd69dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a553def-b937-4a8b-b09e-00464811f9d2', 'volume_size': 1, 'image_id': '89278436-b56f-45f7-8c42-c9afd7bd7453', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/89278436-b56f-45f7-8c42-c9afd7bd7453', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '654c7af809d145caaadc8738d3dc3df2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '89278436-b56f-45f7-8c42-c9afd7bd7453', 'created_at': datetime.datetime(2026, 8, 5, 8, 7, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 8, 7, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/89278436-b56f-45f7-8c42-c9afd7bd7453/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:22:45 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2d7fab92-fee3-473d-98ac-6741bce75a8f tempest-VolumesImageMetadata-991663896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9df9640d-5820-424b-b7ca-14bcb4dc4b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:22:45 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-2d7fab92-fee3-473d-98ac-6741bce75a8f tempest-VolumesImageMetadata-991663896 None] Volume volume-8a553def-b937-4a8b-b09e-00464811f9d2 (8a553def-b937-4a8b-b09e-00464811f9d2): created successfully Aug 05 10:22:45 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2d7fab92-fee3-473d-98ac-6741bce75a8f tempest-VolumesImageMetadata-991663896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9df9640d-5820-424b-b7ca-14bcb4dc4b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:22:45 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2d7fab92-fee3-473d-98ac-6741bce75a8f tempest-VolumesImageMetadata-991663896 None] Flow 'volume_create_manager' (dea76089-d455-4b1f-b825-c470140badab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:22:45 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-2d7fab92-fee3-473d-98ac-6741bce75a8f tempest-VolumesImageMetadata-991663896 None] Created volume successfully. Aug 05 10:22:46 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-eec2e176-10aa-4f20-b7fa-0a516d5e45e8 tempest-VolumesImageMetadata-991663896 None] Acquiring lock "cinder-8a553def-b937-4a8b-b09e-00464811f9d2-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:22:46 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-eec2e176-10aa-4f20-b7fa-0a516d5e45e8 tempest-VolumesImageMetadata-991663896 None] Lock "cinder-8a553def-b937-4a8b-b09e-00464811f9d2-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:22:46 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-eec2e176-10aa-4f20-b7fa-0a516d5e45e8 tempest-VolumesImageMetadata-991663896 None] Acquiring lock "cinder-quobyte-8a553def-b937-4a8b-b09e-00464811f9d2" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:22:46 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-eec2e176-10aa-4f20-b7fa-0a516d5e45e8 tempest-VolumesImageMetadata-991663896 None] Lock "cinder-quobyte-8a553def-b937-4a8b-b09e-00464811f9d2" acquired by "delete_volume" :: waited 0.019s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:22:46 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[956548b2-3d9c-4318-a0d9-b0635f3a0cf8]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:22:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-eec2e176-10aa-4f20-b7fa-0a516d5e45e8 tempest-VolumesImageMetadata-991663896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8a553def-b937-4a8b-b09e-00464811f9d2 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:22:47 devstack sudo[99042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8a553def-b937-4a8b-b09e-00464811f9d2 Aug 05 10:22:47 devstack sudo[99042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:22:48 devstack sudo[99042]: pam_unix(sudo:session): session closed for user root Aug 05 10:22:48 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-eec2e176-10aa-4f20-b7fa-0a516d5e45e8 tempest-VolumesImageMetadata-991663896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8a553def-b937-4a8b-b09e-00464811f9d2" returned: 0 in 1.315s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:22:48 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-eec2e176-10aa-4f20-b7fa-0a516d5e45e8 tempest-VolumesImageMetadata-991663896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8a553def-b937-4a8b-b09e-00464811f9d2 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:22:48 devstack sudo[99101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8a553def-b937-4a8b-b09e-00464811f9d2 Aug 05 10:22:48 devstack sudo[99101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:22:48 devstack sudo[99101]: pam_unix(sudo:session): session closed for user root Aug 05 10:22:48 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-eec2e176-10aa-4f20-b7fa-0a516d5e45e8 tempest-VolumesImageMetadata-991663896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8a553def-b937-4a8b-b09e-00464811f9d2" returned: 0 in 0.472s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:22:48 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-eec2e176-10aa-4f20-b7fa-0a516d5e45e8 tempest-VolumesImageMetadata-991663896 None] Lock "cinder-quobyte-8a553def-b937-4a8b-b09e-00464811f9d2" released by "delete_volume" :: held 1.867s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:22:48 devstack cinder-volume[88613]: DEBUG dbcounter [-] [88613] Writing DB stats cinder:SELECT=67,cinder:INSERT=19,cinder:UPDATE=88,cinder:DELETE=6 {{(pid=88613) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:22:48 devstack cinder-volume[88613]: DEBUG dbcounter [-] [88613] Writing DB stats cinder:SELECT=65,cinder:UPDATE=75,cinder:INSERT=31,cinder:DELETE=9 {{(pid=88613) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:22:48 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-eec2e176-10aa-4f20-b7fa-0a516d5e45e8 tempest-VolumesImageMetadata-991663896 None] Created reservations ['02366d10-b1af-4cdd-aea2-37c64becc7d2', '3c710de8-0fbc-4131-99f3-e76f59a54178', 'f77c16fe-d7b5-4696-adc4-4bfa8a35efdc', 'dd5fda43-86c2-4d98-9f65-98b43fd9f091'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:22:48 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-eec2e176-10aa-4f20-b7fa-0a516d5e45e8 tempest-VolumesImageMetadata-991663896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:22:48 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-eec2e176-10aa-4f20-b7fa-0a516d5e45e8 tempest-VolumesImageMetadata-991663896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:22:48 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-eec2e176-10aa-4f20-b7fa-0a516d5e45e8 tempest-VolumesImageMetadata-991663896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:22:48 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-eec2e176-10aa-4f20-b7fa-0a516d5e45e8 tempest-VolumesImageMetadata-991663896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:22:48 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-eec2e176-10aa-4f20-b7fa-0a516d5e45e8 tempest-VolumesImageMetadata-991663896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:22:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-eec2e176-10aa-4f20-b7fa-0a516d5e45e8 tempest-VolumesImageMetadata-991663896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:22:49 devstack sudo[99122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:22:49 devstack sudo[99122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:22:49 devstack sudo[99122]: pam_unix(sudo:session): session closed for user root Aug 05 10:22:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-eec2e176-10aa-4f20-b7fa-0a516d5e45e8 tempest-VolumesImageMetadata-991663896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.387s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:22:49 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-eec2e176-10aa-4f20-b7fa-0a516d5e45e8 tempest-VolumesImageMetadata-991663896 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:22:49 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-eec2e176-10aa-4f20-b7fa-0a516d5e45e8 tempest-VolumesImageMetadata-991663896 None] Deleted volume successfully. Aug 05 10:22:49 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-eec2e176-10aa-4f20-b7fa-0a516d5e45e8 tempest-VolumesImageMetadata-991663896 None] Lock "cinder-8a553def-b937-4a8b-b09e-00464811f9d2-delete_volume" released by "delete_volume" :: held 2.685s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:22:53 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-4475c20a-05dc-4766-9875-9e02f71f065c tempest-VolumesActionsTest-1281671309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:22:53 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-4475c20a-05dc-4766-9875-9e02f71f065c tempest-VolumesActionsTest-1281671309 None] Flow 'volume_create_manager' (268717d2-7791-4452-a2d4-802f8aa05e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:22:53 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-4475c20a-05dc-4766-9875-9e02f71f065c tempest-VolumesActionsTest-1281671309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c56c118-d45f-4bdf-a807-d6764f9863e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:22:53 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-4475c20a-05dc-4766-9875-9e02f71f065c tempest-VolumesActionsTest-1281671309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c56c118-d45f-4bdf-a807-d6764f9863e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:22:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-790288066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29ea44d6-c77e-4dd6-91d2-ad731671fef8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59d84c17dc794fb7b0527b1d35296590',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:22:53Z,use_quota=True,user_id='31056132f57d464587cf0bbc4d7d7cf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:22:53 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-4475c20a-05dc-4766-9875-9e02f71f065c tempest-VolumesActionsTest-1281671309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5be7498-0e5c-479b-a4b3-518faefbc436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:22:53 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-4475c20a-05dc-4766-9875-9e02f71f065c tempest-VolumesActionsTest-1281671309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5be7498-0e5c-479b-a4b3-518faefbc436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:22:53 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-4475c20a-05dc-4766-9875-9e02f71f065c tempest-VolumesActionsTest-1281671309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94e1002d-2ccc-4445-8c5c-63ddfb2e3060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:22:53 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-4475c20a-05dc-4766-9875-9e02f71f065c tempest-VolumesActionsTest-1281671309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94e1002d-2ccc-4445-8c5c-63ddfb2e3060) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29ea44d6-c77e-4dd6-91d2-ad731671fef8', 'volume_name': 'volume-29ea44d6-c77e-4dd6-91d2-ad731671fef8', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:22:53 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-4475c20a-05dc-4766-9875-9e02f71f065c tempest-VolumesActionsTest-1281671309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dab9a28e-9a3d-42e7-9adb-29e083ed3d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:22:53 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-4475c20a-05dc-4766-9875-9e02f71f065c tempest-VolumesActionsTest-1281671309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dab9a28e-9a3d-42e7-9adb-29e083ed3d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:22:53 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-4475c20a-05dc-4766-9875-9e02f71f065c tempest-VolumesActionsTest-1281671309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (580f8277-ec46-4bfd-a587-cc3cfa958627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:22:53 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-4475c20a-05dc-4766-9875-9e02f71f065c tempest-VolumesActionsTest-1281671309 None] Volume 29ea44d6-c77e-4dd6-91d2-ad731671fef8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29ea44d6-c77e-4dd6-91d2-ad731671fef8', 'volume_size': 1} Aug 05 10:22:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-4475c20a-05dc-4766-9875-9e02f71f065c tempest-VolumesActionsTest-1281671309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:22:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-4475c20a-05dc-4766-9875-9e02f71f065c tempest-VolumesActionsTest-1281671309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:22:53 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-4475c20a-05dc-4766-9875-9e02f71f065c tempest-VolumesActionsTest-1281671309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:22:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-790288066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29ea44d6-c77e-4dd6-91d2-ad731671fef8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59d84c17dc794fb7b0527b1d35296590',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:22:53Z,use_quota=True,user_id='31056132f57d464587cf0bbc4d7d7cf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:22:53 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-4475c20a-05dc-4766-9875-9e02f71f065c tempest-VolumesActionsTest-1281671309 None] Creating volume 29ea44d6-c77e-4dd6-91d2-ad731671fef8 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:22:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-4475c20a-05dc-4766-9875-9e02f71f065c tempest-VolumesActionsTest-1281671309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:22:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-4475c20a-05dc-4766-9875-9e02f71f065c tempest-VolumesActionsTest-1281671309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:22:53 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-4475c20a-05dc-4766-9875-9e02f71f065c tempest-VolumesActionsTest-1281671309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:22:53 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-4475c20a-05dc-4766-9875-9e02f71f065c tempest-VolumesActionsTest-1281671309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:22:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-4475c20a-05dc-4766-9875-9e02f71f065c tempest-VolumesActionsTest-1281671309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:22:53 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-4475c20a-05dc-4766-9875-9e02f71f065c tempest-VolumesActionsTest-1281671309 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:22:53 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-4475c20a-05dc-4766-9875-9e02f71f065c tempest-VolumesActionsTest-1281671309 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:22:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4475c20a-05dc-4766-9875-9e02f71f065c tempest-VolumesActionsTest-1281671309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-29ea44d6-c77e-4dd6-91d2-ad731671fef8 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:22:53 devstack sudo[99202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-29ea44d6-c77e-4dd6-91d2-ad731671fef8 1073741824 Aug 05 10:22:53 devstack sudo[99202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:22:54 devstack sudo[99202]: pam_unix(sudo:session): session closed for user root Aug 05 10:22:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4475c20a-05dc-4766-9875-9e02f71f065c tempest-VolumesActionsTest-1281671309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-29ea44d6-c77e-4dd6-91d2-ad731671fef8 1073741824" returned: 0 in 0.603s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:22:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4475c20a-05dc-4766-9875-9e02f71f065c tempest-VolumesActionsTest-1281671309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-29ea44d6-c77e-4dd6-91d2-ad731671fef8 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:22:54 devstack sudo[99211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-29ea44d6-c77e-4dd6-91d2-ad731671fef8 Aug 05 10:22:54 devstack sudo[99211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:22:54 devstack sudo[99211]: pam_unix(sudo:session): session closed for user root Aug 05 10:22:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4475c20a-05dc-4766-9875-9e02f71f065c tempest-VolumesActionsTest-1281671309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-29ea44d6-c77e-4dd6-91d2-ad731671fef8" returned: 0 in 0.367s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:22:54 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-4475c20a-05dc-4766-9875-9e02f71f065c tempest-VolumesActionsTest-1281671309 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:22:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-4475c20a-05dc-4766-9875-9e02f71f065c tempest-VolumesActionsTest-1281671309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:22:54 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-4475c20a-05dc-4766-9875-9e02f71f065c tempest-VolumesActionsTest-1281671309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (580f8277-ec46-4bfd-a587-cc3cfa958627) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29ea44d6-c77e-4dd6-91d2-ad731671fef8', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:22:54 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-4475c20a-05dc-4766-9875-9e02f71f065c tempest-VolumesActionsTest-1281671309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d0e1fae-c6b8-41e6-b7ba-bdae73c85ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:22:54 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-4475c20a-05dc-4766-9875-9e02f71f065c tempest-VolumesActionsTest-1281671309 None] Volume volume-29ea44d6-c77e-4dd6-91d2-ad731671fef8 (29ea44d6-c77e-4dd6-91d2-ad731671fef8): created successfully Aug 05 10:22:54 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-4475c20a-05dc-4766-9875-9e02f71f065c tempest-VolumesActionsTest-1281671309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d0e1fae-c6b8-41e6-b7ba-bdae73c85ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:22:54 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-4475c20a-05dc-4766-9875-9e02f71f065c tempest-VolumesActionsTest-1281671309 None] Flow 'volume_create_manager' (268717d2-7791-4452-a2d4-802f8aa05e8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:22:54 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-4475c20a-05dc-4766-9875-9e02f71f065c tempest-VolumesActionsTest-1281671309 None] Created volume successfully. Aug 05 10:22:55 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e2515692-1e20-4d28-8916-9fe26daffc17 tempest-VolumesActionsTest-1281671309 None] Acquiring lock "cinder-29ea44d6-c77e-4dd6-91d2-ad731671fef8" by "attach_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:22:55 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e2515692-1e20-4d28-8916-9fe26daffc17 tempest-VolumesActionsTest-1281671309 None] Lock "cinder-29ea44d6-c77e-4dd6-91d2-ad731671fef8" acquired by "attach_volume" :: waited 0.030s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:22:55 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-e2515692-1e20-4d28-8916-9fe26daffc17 tempest-VolumesActionsTest-1281671309 None] Attaching volume 29ea44d6-c77e-4dd6-91d2-ad731671fef8 to instance 2c645936-53c4-4579-87bc-7e20e0c8b6a1 at mountpoint /dev/vdb on host None. Aug 05 10:22:55 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-e2515692-1e20-4d28-8916-9fe26daffc17 tempest-VolumesActionsTest-1281671309 None] Attach volume completed successfully. Aug 05 10:22:55 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e2515692-1e20-4d28-8916-9fe26daffc17 tempest-VolumesActionsTest-1281671309 None] Lock "cinder-29ea44d6-c77e-4dd6-91d2-ad731671fef8" released by "attach_volume" :: held 0.125s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:22:56 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b62bfcb-1e02-43ef-a73b-106e08c36ec6 tempest-AbsoluteLimitsTests-221391342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:22:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1b62bfcb-1e02-43ef-a73b-106e08c36ec6 tempest-AbsoluteLimitsTests-221391342 None] Flow 'volume_create_manager' (b0183185-2289-4a00-89b1-d3133e5c0d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:22:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1b62bfcb-1e02-43ef-a73b-106e08c36ec6 tempest-AbsoluteLimitsTests-221391342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25807f6b-35d5-4b26-bb25-c3b39c3a9c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:22:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1b62bfcb-1e02-43ef-a73b-106e08c36ec6 tempest-AbsoluteLimitsTests-221391342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25807f6b-35d5-4b26-bb25-c3b39c3a9c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:22:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1696834406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b713b34-5c8c-4492-a915-521bbef747ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a5a596d1535451c8d1aed7cf5a8250d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:22:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:22:56Z,use_quota=True,user_id='551002ca950349deb61e8befe71bf39f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:22:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1b62bfcb-1e02-43ef-a73b-106e08c36ec6 tempest-AbsoluteLimitsTests-221391342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48764e7f-7a87-4a2f-a9d0-051cdc11ab8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:22:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1b62bfcb-1e02-43ef-a73b-106e08c36ec6 tempest-AbsoluteLimitsTests-221391342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48764e7f-7a87-4a2f-a9d0-051cdc11ab8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:22:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1b62bfcb-1e02-43ef-a73b-106e08c36ec6 tempest-AbsoluteLimitsTests-221391342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09bde7af-536f-4707-87c8-cd87fe2597ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:22:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1b62bfcb-1e02-43ef-a73b-106e08c36ec6 tempest-AbsoluteLimitsTests-221391342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09bde7af-536f-4707-87c8-cd87fe2597ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b713b34-5c8c-4492-a915-521bbef747ec', 'volume_name': 'volume-9b713b34-5c8c-4492-a915-521bbef747ec', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:22:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1b62bfcb-1e02-43ef-a73b-106e08c36ec6 tempest-AbsoluteLimitsTests-221391342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9c53ac2-884c-4fae-9a5a-032785ad7d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:22:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1b62bfcb-1e02-43ef-a73b-106e08c36ec6 tempest-AbsoluteLimitsTests-221391342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9c53ac2-884c-4fae-9a5a-032785ad7d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:22:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1b62bfcb-1e02-43ef-a73b-106e08c36ec6 tempest-AbsoluteLimitsTests-221391342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c450fc5-5d5b-4812-8bcd-22f3b936eb45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:22:56 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-1b62bfcb-1e02-43ef-a73b-106e08c36ec6 tempest-AbsoluteLimitsTests-221391342 None] Volume 9b713b34-5c8c-4492-a915-521bbef747ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b713b34-5c8c-4492-a915-521bbef747ec', 'volume_size': 1} Aug 05 10:22:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-1b62bfcb-1e02-43ef-a73b-106e08c36ec6 tempest-AbsoluteLimitsTests-221391342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:22:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-1b62bfcb-1e02-43ef-a73b-106e08c36ec6 tempest-AbsoluteLimitsTests-221391342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:22:56 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-1b62bfcb-1e02-43ef-a73b-106e08c36ec6 tempest-AbsoluteLimitsTests-221391342 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:22:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1696834406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b713b34-5c8c-4492-a915-521bbef747ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a5a596d1535451c8d1aed7cf5a8250d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:22:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:22:56Z,use_quota=True,user_id='551002ca950349deb61e8befe71bf39f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:22:56 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-1b62bfcb-1e02-43ef-a73b-106e08c36ec6 tempest-AbsoluteLimitsTests-221391342 None] Creating volume 9b713b34-5c8c-4492-a915-521bbef747ec {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:22:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-1b62bfcb-1e02-43ef-a73b-106e08c36ec6 tempest-AbsoluteLimitsTests-221391342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:22:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-1b62bfcb-1e02-43ef-a73b-106e08c36ec6 tempest-AbsoluteLimitsTests-221391342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:22:56 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-1b62bfcb-1e02-43ef-a73b-106e08c36ec6 tempest-AbsoluteLimitsTests-221391342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:22:56 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-1b62bfcb-1e02-43ef-a73b-106e08c36ec6 tempest-AbsoluteLimitsTests-221391342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:22:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-1b62bfcb-1e02-43ef-a73b-106e08c36ec6 tempest-AbsoluteLimitsTests-221391342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:22:56 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-1b62bfcb-1e02-43ef-a73b-106e08c36ec6 tempest-AbsoluteLimitsTests-221391342 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:22:56 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-1b62bfcb-1e02-43ef-a73b-106e08c36ec6 tempest-AbsoluteLimitsTests-221391342 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:22:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1b62bfcb-1e02-43ef-a73b-106e08c36ec6 tempest-AbsoluteLimitsTests-221391342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9b713b34-5c8c-4492-a915-521bbef747ec 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:22:56 devstack sudo[99214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9b713b34-5c8c-4492-a915-521bbef747ec 1073741824 Aug 05 10:22:56 devstack sudo[99214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:22:56 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-e1e35cc9-f8bc-41cf-98b6-803c50679d89 tempest-VolumesActionsTest-2123852216 None] Terminate volume connection completed successfully. Aug 05 10:22:56 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e1e35cc9-f8bc-41cf-98b6-803c50679d89 tempest-VolumesActionsTest-2123852216 None] Acquiring lock "cinder-29ea44d6-c77e-4dd6-91d2-ad731671fef8-detach_volume" by "detach_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:22:56 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e1e35cc9-f8bc-41cf-98b6-803c50679d89 tempest-VolumesActionsTest-2123852216 None] Lock "cinder-29ea44d6-c77e-4dd6-91d2-ad731671fef8-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:22:56 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-e1e35cc9-f8bc-41cf-98b6-803c50679d89 tempest-VolumesActionsTest-2123852216 None] Detaching volume 29ea44d6-c77e-4dd6-91d2-ad731671fef8 from instance 2c645936-53c4-4579-87bc-7e20e0c8b6a1. Aug 05 10:22:56 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-e1e35cc9-f8bc-41cf-98b6-803c50679d89 tempest-VolumesActionsTest-2123852216 None] Detach volume completed successfully. Aug 05 10:22:56 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e1e35cc9-f8bc-41cf-98b6-803c50679d89 tempest-VolumesActionsTest-2123852216 None] Lock "cinder-29ea44d6-c77e-4dd6-91d2-ad731671fef8-detach_volume" released by "detach_volume" :: held 0.112s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:22:57 devstack sudo[99214]: pam_unix(sudo:session): session closed for user root Aug 05 10:22:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1b62bfcb-1e02-43ef-a73b-106e08c36ec6 tempest-AbsoluteLimitsTests-221391342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9b713b34-5c8c-4492-a915-521bbef747ec 1073741824" returned: 0 in 0.626s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:22:57 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-4fe30049-105f-4dbe-8e1d-3dfcb068ed07 tempest-VolumesActionsTest-1281671309 None] Acquiring lock "cinder-29ea44d6-c77e-4dd6-91d2-ad731671fef8-detach_volume" by "detach_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:22:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1b62bfcb-1e02-43ef-a73b-106e08c36ec6 tempest-AbsoluteLimitsTests-221391342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9b713b34-5c8c-4492-a915-521bbef747ec {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:22:57 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-4fe30049-105f-4dbe-8e1d-3dfcb068ed07 tempest-VolumesActionsTest-1281671309 None] Lock "cinder-29ea44d6-c77e-4dd6-91d2-ad731671fef8-detach_volume" acquired by "detach_volume" :: waited 0.059s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:22:57 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-4fe30049-105f-4dbe-8e1d-3dfcb068ed07 tempest-VolumesActionsTest-1281671309 None] Volume detach called, but volume not attached. Aug 05 10:22:57 devstack sudo[99220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9b713b34-5c8c-4492-a915-521bbef747ec Aug 05 10:22:57 devstack sudo[99220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:22:57 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-4fe30049-105f-4dbe-8e1d-3dfcb068ed07 tempest-VolumesActionsTest-1281671309 None] Lock "cinder-29ea44d6-c77e-4dd6-91d2-ad731671fef8-detach_volume" released by "detach_volume" :: held 0.033s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:22:57 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-9a262702-1efd-45a9-b830-afa9dd83ee7c tempest-VolumesActionsTest-1281671309 None] Acquiring lock "cinder-29ea44d6-c77e-4dd6-91d2-ad731671fef8-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:22:57 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-9a262702-1efd-45a9-b830-afa9dd83ee7c tempest-VolumesActionsTest-1281671309 None] Lock "cinder-29ea44d6-c77e-4dd6-91d2-ad731671fef8-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:22:57 devstack sudo[99220]: pam_unix(sudo:session): session closed for user root Aug 05 10:22:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1b62bfcb-1e02-43ef-a73b-106e08c36ec6 tempest-AbsoluteLimitsTests-221391342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9b713b34-5c8c-4492-a915-521bbef747ec" returned: 0 in 0.458s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:22:57 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-1b62bfcb-1e02-43ef-a73b-106e08c36ec6 tempest-AbsoluteLimitsTests-221391342 None] <== create_volume: return (1146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:22:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-1b62bfcb-1e02-43ef-a73b-106e08c36ec6 tempest-AbsoluteLimitsTests-221391342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.150s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:22:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1b62bfcb-1e02-43ef-a73b-106e08c36ec6 tempest-AbsoluteLimitsTests-221391342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c450fc5-5d5b-4812-8bcd-22f3b936eb45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b713b34-5c8c-4492-a915-521bbef747ec', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:22:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1b62bfcb-1e02-43ef-a73b-106e08c36ec6 tempest-AbsoluteLimitsTests-221391342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00f5dca3-418f-41f5-bddc-f5ffbc00ae40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:22:57 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-9a262702-1efd-45a9-b830-afa9dd83ee7c tempest-VolumesActionsTest-1281671309 None] Acquiring lock "cinder-quobyte-29ea44d6-c77e-4dd6-91d2-ad731671fef8" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:22:57 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-1b62bfcb-1e02-43ef-a73b-106e08c36ec6 tempest-AbsoluteLimitsTests-221391342 None] Volume volume-9b713b34-5c8c-4492-a915-521bbef747ec (9b713b34-5c8c-4492-a915-521bbef747ec): created successfully Aug 05 10:22:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1b62bfcb-1e02-43ef-a73b-106e08c36ec6 tempest-AbsoluteLimitsTests-221391342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00f5dca3-418f-41f5-bddc-f5ffbc00ae40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:22:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1b62bfcb-1e02-43ef-a73b-106e08c36ec6 tempest-AbsoluteLimitsTests-221391342 None] Flow 'volume_create_manager' (b0183185-2289-4a00-89b1-d3133e5c0d92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:22:57 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-9a262702-1efd-45a9-b830-afa9dd83ee7c tempest-VolumesActionsTest-1281671309 None] Lock "cinder-quobyte-29ea44d6-c77e-4dd6-91d2-ad731671fef8" acquired by "delete_volume" :: waited 0.032s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:22:57 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-1b62bfcb-1e02-43ef-a73b-106e08c36ec6 tempest-AbsoluteLimitsTests-221391342 None] Created volume successfully. Aug 05 10:22:57 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe8a0cf-e85b-4116-8607-25c2850bcfaa]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:22:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9a262702-1efd-45a9-b830-afa9dd83ee7c tempest-VolumesActionsTest-1281671309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-29ea44d6-c77e-4dd6-91d2-ad731671fef8 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:22:57 devstack sudo[99223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-29ea44d6-c77e-4dd6-91d2-ad731671fef8 Aug 05 10:22:57 devstack sudo[99223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:22:58 devstack sudo[99223]: pam_unix(sudo:session): session closed for user root Aug 05 10:22:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9a262702-1efd-45a9-b830-afa9dd83ee7c tempest-VolumesActionsTest-1281671309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-29ea44d6-c77e-4dd6-91d2-ad731671fef8" returned: 0 in 0.437s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:22:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9a262702-1efd-45a9-b830-afa9dd83ee7c tempest-VolumesActionsTest-1281671309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-29ea44d6-c77e-4dd6-91d2-ad731671fef8 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:22:58 devstack sudo[99228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-29ea44d6-c77e-4dd6-91d2-ad731671fef8 Aug 05 10:22:58 devstack sudo[99228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:22:58 devstack sudo[99228]: pam_unix(sudo:session): session closed for user root Aug 05 10:22:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9a262702-1efd-45a9-b830-afa9dd83ee7c tempest-VolumesActionsTest-1281671309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-29ea44d6-c77e-4dd6-91d2-ad731671fef8" returned: 0 in 0.481s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:22:58 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-9a262702-1efd-45a9-b830-afa9dd83ee7c tempest-VolumesActionsTest-1281671309 None] Lock "cinder-quobyte-29ea44d6-c77e-4dd6-91d2-ad731671fef8" released by "delete_volume" :: held 1.006s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:22:58 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-a772002d-c845-4b1e-a8e4-f2df423f98e9 tempest-SnapshotMetadataTestJSON-1253752257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:22:58 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a772002d-c845-4b1e-a8e4-f2df423f98e9 tempest-SnapshotMetadataTestJSON-1253752257 None] Flow 'volume_create_manager' (cff30690-504d-4c61-9436-5e31451576f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:22:58 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a772002d-c845-4b1e-a8e4-f2df423f98e9 tempest-SnapshotMetadataTestJSON-1253752257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9d23474-ba95-4e06-bbdb-b69b33ff5e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:22:58 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-79034593-a1a7-45f9-b032-cda0a092bb44 tempest-AbsoluteLimitsTests-221391342 None] Acquiring lock "cinder-9b713b34-5c8c-4492-a915-521bbef747ec-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:22:58 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-79034593-a1a7-45f9-b032-cda0a092bb44 tempest-AbsoluteLimitsTests-221391342 None] Lock "cinder-9b713b34-5c8c-4492-a915-521bbef747ec-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:22:58 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a772002d-c845-4b1e-a8e4-f2df423f98e9 tempest-SnapshotMetadataTestJSON-1253752257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9d23474-ba95-4e06-bbdb-b69b33ff5e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:22:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-989050435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d296207-9c9d-4a98-8c83-6d465c2e8ccf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4261679c30db452099822507c9b9802a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:22:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:22:59Z,use_quota=True,user_id='3b8ce69c2670447d927d97b616dc3324',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:22:58 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a772002d-c845-4b1e-a8e4-f2df423f98e9 tempest-SnapshotMetadataTestJSON-1253752257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd0125e1-7cfe-4f95-a6f2-2f7e97493b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:22:58 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a772002d-c845-4b1e-a8e4-f2df423f98e9 tempest-SnapshotMetadataTestJSON-1253752257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd0125e1-7cfe-4f95-a6f2-2f7e97493b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:22:58 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a772002d-c845-4b1e-a8e4-f2df423f98e9 tempest-SnapshotMetadataTestJSON-1253752257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f73c0f6b-5f00-4d19-9a98-c7a42ba364cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:22:58 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a772002d-c845-4b1e-a8e4-f2df423f98e9 tempest-SnapshotMetadataTestJSON-1253752257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f73c0f6b-5f00-4d19-9a98-c7a42ba364cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d296207-9c9d-4a98-8c83-6d465c2e8ccf', 'volume_name': 'volume-0d296207-9c9d-4a98-8c83-6d465c2e8ccf', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:22:58 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a772002d-c845-4b1e-a8e4-f2df423f98e9 tempest-SnapshotMetadataTestJSON-1253752257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1434d66a-c8e9-40e1-be81-5834e26d48fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:22:58 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a772002d-c845-4b1e-a8e4-f2df423f98e9 tempest-SnapshotMetadataTestJSON-1253752257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1434d66a-c8e9-40e1-be81-5834e26d48fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:22:58 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a772002d-c845-4b1e-a8e4-f2df423f98e9 tempest-SnapshotMetadataTestJSON-1253752257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5adaf179-a201-4d08-9365-27ebb37e6fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:22:58 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-a772002d-c845-4b1e-a8e4-f2df423f98e9 tempest-SnapshotMetadataTestJSON-1253752257 None] Volume 0d296207-9c9d-4a98-8c83-6d465c2e8ccf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d296207-9c9d-4a98-8c83-6d465c2e8ccf', 'volume_size': 1} Aug 05 10:22:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a772002d-c845-4b1e-a8e4-f2df423f98e9 tempest-SnapshotMetadataTestJSON-1253752257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:22:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a772002d-c845-4b1e-a8e4-f2df423f98e9 tempest-SnapshotMetadataTestJSON-1253752257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:22:58 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-a772002d-c845-4b1e-a8e4-f2df423f98e9 tempest-SnapshotMetadataTestJSON-1253752257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:22:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-989050435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d296207-9c9d-4a98-8c83-6d465c2e8ccf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4261679c30db452099822507c9b9802a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:22:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:22:59Z,use_quota=True,user_id='3b8ce69c2670447d927d97b616dc3324',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:22:58 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-a772002d-c845-4b1e-a8e4-f2df423f98e9 tempest-SnapshotMetadataTestJSON-1253752257 None] Creating volume 0d296207-9c9d-4a98-8c83-6d465c2e8ccf {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:22:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a772002d-c845-4b1e-a8e4-f2df423f98e9 tempest-SnapshotMetadataTestJSON-1253752257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:22:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a772002d-c845-4b1e-a8e4-f2df423f98e9 tempest-SnapshotMetadataTestJSON-1253752257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:22:58 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-a772002d-c845-4b1e-a8e4-f2df423f98e9 tempest-SnapshotMetadataTestJSON-1253752257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:22:58 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-a772002d-c845-4b1e-a8e4-f2df423f98e9 tempest-SnapshotMetadataTestJSON-1253752257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:22:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a772002d-c845-4b1e-a8e4-f2df423f98e9 tempest-SnapshotMetadataTestJSON-1253752257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:22:58 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-a772002d-c845-4b1e-a8e4-f2df423f98e9 tempest-SnapshotMetadataTestJSON-1253752257 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:22:58 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-a772002d-c845-4b1e-a8e4-f2df423f98e9 tempest-SnapshotMetadataTestJSON-1253752257 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:22:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a772002d-c845-4b1e-a8e4-f2df423f98e9 tempest-SnapshotMetadataTestJSON-1253752257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0d296207-9c9d-4a98-8c83-6d465c2e8ccf 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:22:58 devstack sudo[99231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0d296207-9c9d-4a98-8c83-6d465c2e8ccf 1073741824 Aug 05 10:22:58 devstack sudo[99231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:22:58 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-9a262702-1efd-45a9-b830-afa9dd83ee7c tempest-VolumesActionsTest-1281671309 None] Created reservations ['f67390e6-1b8b-4c57-8e59-01b8764dc076', 'cf01ed48-0c97-4b23-b798-c2ef549e7a6a', 'f04bc56e-356e-4794-8047-b4c44139bbb8', '781f43ca-eb7c-4777-ba32-db6c2820b781'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:22:58 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-79034593-a1a7-45f9-b032-cda0a092bb44 tempest-AbsoluteLimitsTests-221391342 None] Acquiring lock "cinder-quobyte-9b713b34-5c8c-4492-a915-521bbef747ec" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:22:59 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-79034593-a1a7-45f9-b032-cda0a092bb44 tempest-AbsoluteLimitsTests-221391342 None] Lock "cinder-quobyte-9b713b34-5c8c-4492-a915-521bbef747ec" acquired by "delete_volume" :: waited 0.036s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:22:59 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8bf06d-9d4a-4685-9b76-c44830026e4f]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:22:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-79034593-a1a7-45f9-b032-cda0a092bb44 tempest-AbsoluteLimitsTests-221391342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9b713b34-5c8c-4492-a915-521bbef747ec {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:22:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-9a262702-1efd-45a9-b830-afa9dd83ee7c tempest-VolumesActionsTest-1281671309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:22:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-9a262702-1efd-45a9-b830-afa9dd83ee7c tempest-VolumesActionsTest-1281671309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:22:59 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-9a262702-1efd-45a9-b830-afa9dd83ee7c tempest-VolumesActionsTest-1281671309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:22:59 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-9a262702-1efd-45a9-b830-afa9dd83ee7c tempest-VolumesActionsTest-1281671309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:22:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-9a262702-1efd-45a9-b830-afa9dd83ee7c tempest-VolumesActionsTest-1281671309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:22:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9a262702-1efd-45a9-b830-afa9dd83ee7c tempest-VolumesActionsTest-1281671309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:22:59 devstack sudo[99234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:22:59 devstack sudo[99234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:22:59 devstack sudo[99233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9b713b34-5c8c-4492-a915-521bbef747ec Aug 05 10:22:59 devstack sudo[99233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:22:59 devstack sudo[99234]: pam_unix(sudo:session): session closed for user root Aug 05 10:22:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9a262702-1efd-45a9-b830-afa9dd83ee7c tempest-VolumesActionsTest-1281671309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.464s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:22:59 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-9a262702-1efd-45a9-b830-afa9dd83ee7c tempest-VolumesActionsTest-1281671309 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:22:59 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-9a262702-1efd-45a9-b830-afa9dd83ee7c tempest-VolumesActionsTest-1281671309 None] Deleted volume successfully. Aug 05 10:22:59 devstack sudo[99231]: pam_unix(sudo:session): session closed for user root Aug 05 10:22:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a772002d-c845-4b1e-a8e4-f2df423f98e9 tempest-SnapshotMetadataTestJSON-1253752257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0d296207-9c9d-4a98-8c83-6d465c2e8ccf 1073741824" returned: 0 in 0.757s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:22:59 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-9a262702-1efd-45a9-b830-afa9dd83ee7c tempest-VolumesActionsTest-1281671309 None] Lock "cinder-29ea44d6-c77e-4dd6-91d2-ad731671fef8-delete_volume" released by "delete_volume" :: held 2.150s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:22:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a772002d-c845-4b1e-a8e4-f2df423f98e9 tempest-SnapshotMetadataTestJSON-1253752257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0d296207-9c9d-4a98-8c83-6d465c2e8ccf {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:22:59 devstack sudo[99243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0d296207-9c9d-4a98-8c83-6d465c2e8ccf Aug 05 10:22:59 devstack sudo[99243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:22:59 devstack sudo[99233]: pam_unix(sudo:session): session closed for user root Aug 05 10:22:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-79034593-a1a7-45f9-b032-cda0a092bb44 tempest-AbsoluteLimitsTests-221391342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9b713b34-5c8c-4492-a915-521bbef747ec" returned: 0 in 0.805s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:22:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-79034593-a1a7-45f9-b032-cda0a092bb44 tempest-AbsoluteLimitsTests-221391342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9b713b34-5c8c-4492-a915-521bbef747ec {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:22:59 devstack sudo[99247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9b713b34-5c8c-4492-a915-521bbef747ec Aug 05 10:22:59 devstack sudo[99247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:00 devstack sudo[99243]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:00 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a772002d-c845-4b1e-a8e4-f2df423f98e9 tempest-SnapshotMetadataTestJSON-1253752257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0d296207-9c9d-4a98-8c83-6d465c2e8ccf" returned: 0 in 0.418s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:00 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-a772002d-c845-4b1e-a8e4-f2df423f98e9 tempest-SnapshotMetadataTestJSON-1253752257 None] <== create_volume: return (1236ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:23:00 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a772002d-c845-4b1e-a8e4-f2df423f98e9 tempest-SnapshotMetadataTestJSON-1253752257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.240s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:23:00 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a772002d-c845-4b1e-a8e4-f2df423f98e9 tempest-SnapshotMetadataTestJSON-1253752257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5adaf179-a201-4d08-9365-27ebb37e6fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d296207-9c9d-4a98-8c83-6d465c2e8ccf', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:00 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a772002d-c845-4b1e-a8e4-f2df423f98e9 tempest-SnapshotMetadataTestJSON-1253752257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16385b5a-d619-4483-ae21-bc0e4ff86345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:00 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-a772002d-c845-4b1e-a8e4-f2df423f98e9 tempest-SnapshotMetadataTestJSON-1253752257 None] Volume volume-0d296207-9c9d-4a98-8c83-6d465c2e8ccf (0d296207-9c9d-4a98-8c83-6d465c2e8ccf): created successfully Aug 05 10:23:00 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a772002d-c845-4b1e-a8e4-f2df423f98e9 tempest-SnapshotMetadataTestJSON-1253752257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16385b5a-d619-4483-ae21-bc0e4ff86345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:00 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a772002d-c845-4b1e-a8e4-f2df423f98e9 tempest-SnapshotMetadataTestJSON-1253752257 None] Flow 'volume_create_manager' (cff30690-504d-4c61-9436-5e31451576f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:23:00 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-a772002d-c845-4b1e-a8e4-f2df423f98e9 tempest-SnapshotMetadataTestJSON-1253752257 None] Created volume successfully. Aug 05 10:23:00 devstack sudo[99247]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:00 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-79034593-a1a7-45f9-b032-cda0a092bb44 tempest-AbsoluteLimitsTests-221391342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9b713b34-5c8c-4492-a915-521bbef747ec" returned: 0 in 0.355s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:00 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-79034593-a1a7-45f9-b032-cda0a092bb44 tempest-AbsoluteLimitsTests-221391342 None] Lock "cinder-quobyte-9b713b34-5c8c-4492-a915-521bbef747ec" released by "delete_volume" :: held 1.222s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:23:00 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-79034593-a1a7-45f9-b032-cda0a092bb44 tempest-AbsoluteLimitsTests-221391342 None] Created reservations ['15e7a5d4-3fde-426c-af65-3e49235b3bb7', '8d8e8158-077a-4089-97e3-26cf4079aa45', '3cbb5858-23bb-4636-8de9-4b823df9bd00', '362f7033-adf5-4aea-b028-52eae0de805c'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:23:00 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-79034593-a1a7-45f9-b032-cda0a092bb44 tempest-AbsoluteLimitsTests-221391342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:23:00 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-79034593-a1a7-45f9-b032-cda0a092bb44 tempest-AbsoluteLimitsTests-221391342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:23:00 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-79034593-a1a7-45f9-b032-cda0a092bb44 tempest-AbsoluteLimitsTests-221391342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:23:00 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-79034593-a1a7-45f9-b032-cda0a092bb44 tempest-AbsoluteLimitsTests-221391342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:23:00 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-79034593-a1a7-45f9-b032-cda0a092bb44 tempest-AbsoluteLimitsTests-221391342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:23:00 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-79034593-a1a7-45f9-b032-cda0a092bb44 tempest-AbsoluteLimitsTests-221391342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:00 devstack sudo[99252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:23:00 devstack sudo[99252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:00 devstack sudo[99252]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:00 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-79034593-a1a7-45f9-b032-cda0a092bb44 tempest-AbsoluteLimitsTests-221391342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.405s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:00 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-79034593-a1a7-45f9-b032-cda0a092bb44 tempest-AbsoluteLimitsTests-221391342 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:23:00 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-79034593-a1a7-45f9-b032-cda0a092bb44 tempest-AbsoluteLimitsTests-221391342 None] Deleted volume successfully. Aug 05 10:23:00 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-705a7d95-64b5-43a2-80d5-97beff1ef4b5 tempest-SnapshotMetadataTestJSON-1253752257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:23:00 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-705a7d95-64b5-43a2-80d5-97beff1ef4b5 tempest-SnapshotMetadataTestJSON-1253752257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:23:00 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-79034593-a1a7-45f9-b032-cda0a092bb44 tempest-AbsoluteLimitsTests-221391342 None] Lock "cinder-9b713b34-5c8c-4492-a915-521bbef747ec-delete_volume" released by "delete_volume" :: held 2.101s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:23:00 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-705a7d95-64b5-43a2-80d5-97beff1ef4b5 tempest-SnapshotMetadataTestJSON-1253752257 None] Creating offline snapshot 642b27dd-b164-4b4c-a766-ac7ae4d4d20b of volume 0d296207-9c9d-4a98-8c83-6d465c2e8ccf {{(pid=88613) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:23:00 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b01d80f-8123-473f-bc7b-b6713c2b0c05]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:23:00 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-705a7d95-64b5-43a2-80d5-97beff1ef4b5 tempest-SnapshotMetadataTestJSON-1253752257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0d296207-9c9d-4a98-8c83-6d465c2e8ccf {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:01 devstack sudo[99262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0d296207-9c9d-4a98-8c83-6d465c2e8ccf Aug 05 10:23:01 devstack sudo[99262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:01 devstack sudo[99262]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:01 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-705a7d95-64b5-43a2-80d5-97beff1ef4b5 tempest-SnapshotMetadataTestJSON-1253752257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0d296207-9c9d-4a98-8c83-6d465c2e8ccf" returned: 0 in 0.501s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:01 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-705a7d95-64b5-43a2-80d5-97beff1ef4b5 tempest-SnapshotMetadataTestJSON-1253752257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0d296207-9c9d-4a98-8c83-6d465c2e8ccf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0d296207-9c9d-4a98-8c83-6d465c2e8ccf.642b27dd-b164-4b4c-a766-ac7ae4d4d20b 1G {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:01 devstack sudo[99283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0d296207-9c9d-4a98-8c83-6d465c2e8ccf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0d296207-9c9d-4a98-8c83-6d465c2e8ccf.642b27dd-b164-4b4c-a766-ac7ae4d4d20b 1G Aug 05 10:23:01 devstack sudo[99283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:01 devstack sudo[99283]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:01 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-705a7d95-64b5-43a2-80d5-97beff1ef4b5 tempest-SnapshotMetadataTestJSON-1253752257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0d296207-9c9d-4a98-8c83-6d465c2e8ccf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0d296207-9c9d-4a98-8c83-6d465c2e8ccf.642b27dd-b164-4b4c-a766-ac7ae4d4d20b 1G" returned: 0 in 0.529s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:01 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-705a7d95-64b5-43a2-80d5-97beff1ef4b5 tempest-SnapshotMetadataTestJSON-1253752257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d296207-9c9d-4a98-8c83-6d465c2e8ccf -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0d296207-9c9d-4a98-8c83-6d465c2e8ccf.642b27dd-b164-4b4c-a766-ac7ae4d4d20b {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:02 devstack sudo[99290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d296207-9c9d-4a98-8c83-6d465c2e8ccf -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0d296207-9c9d-4a98-8c83-6d465c2e8ccf.642b27dd-b164-4b4c-a766-ac7ae4d4d20b Aug 05 10:23:02 devstack sudo[99290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:02 devstack sudo[99290]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:02 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-705a7d95-64b5-43a2-80d5-97beff1ef4b5 tempest-SnapshotMetadataTestJSON-1253752257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d296207-9c9d-4a98-8c83-6d465c2e8ccf -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0d296207-9c9d-4a98-8c83-6d465c2e8ccf.642b27dd-b164-4b4c-a766-ac7ae4d4d20b" returned: 0 in 0.542s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:02 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-705a7d95-64b5-43a2-80d5-97beff1ef4b5 tempest-SnapshotMetadataTestJSON-1253752257 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0d296207-9c9d-4a98-8c83-6d465c2e8ccf.642b27dd-b164-4b4c-a766-ac7ae4d4d20b is being set with open permissions: ugo+rw Aug 05 10:23:02 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-705a7d95-64b5-43a2-80d5-97beff1ef4b5 tempest-SnapshotMetadataTestJSON-1253752257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0d296207-9c9d-4a98-8c83-6d465c2e8ccf.642b27dd-b164-4b4c-a766-ac7ae4d4d20b {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:02 devstack sudo[99299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0d296207-9c9d-4a98-8c83-6d465c2e8ccf.642b27dd-b164-4b4c-a766-ac7ae4d4d20b Aug 05 10:23:02 devstack sudo[99299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:02 devstack sudo[99299]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:02 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-705a7d95-64b5-43a2-80d5-97beff1ef4b5 tempest-SnapshotMetadataTestJSON-1253752257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0d296207-9c9d-4a98-8c83-6d465c2e8ccf.642b27dd-b164-4b4c-a766-ac7ae4d4d20b" returned: 0 in 0.313s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:02 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-705a7d95-64b5-43a2-80d5-97beff1ef4b5 tempest-SnapshotMetadataTestJSON-1253752257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0d296207-9c9d-4a98-8c83-6d465c2e8ccf.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:02 devstack sudo[99302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0d296207-9c9d-4a98-8c83-6d465c2e8ccf.info Aug 05 10:23:02 devstack sudo[99302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:03 devstack sudo[99302]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:03 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-705a7d95-64b5-43a2-80d5-97beff1ef4b5 tempest-SnapshotMetadataTestJSON-1253752257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0d296207-9c9d-4a98-8c83-6d465c2e8ccf.info" returned: 0 in 0.354s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:03 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-705a7d95-64b5-43a2-80d5-97beff1ef4b5 tempest-SnapshotMetadataTestJSON-1253752257 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0d296207-9c9d-4a98-8c83-6d465c2e8ccf.info is being set with open permissions: ugo+rw Aug 05 10:23:03 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-705a7d95-64b5-43a2-80d5-97beff1ef4b5 tempest-SnapshotMetadataTestJSON-1253752257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0d296207-9c9d-4a98-8c83-6d465c2e8ccf.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:03 devstack sudo[99305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0d296207-9c9d-4a98-8c83-6d465c2e8ccf.info Aug 05 10:23:03 devstack sudo[99305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:03 devstack sudo[99305]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:03 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-705a7d95-64b5-43a2-80d5-97beff1ef4b5 tempest-SnapshotMetadataTestJSON-1253752257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0d296207-9c9d-4a98-8c83-6d465c2e8ccf.info" returned: 0 in 0.307s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:03 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-705a7d95-64b5-43a2-80d5-97beff1ef4b5 tempest-SnapshotMetadataTestJSON-1253752257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.669s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:23:03 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-705a7d95-64b5-43a2-80d5-97beff1ef4b5 tempest-SnapshotMetadataTestJSON-1253752257 None] Create snapshot completed successfully Aug 05 10:23:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-f2ceab6e-bb79-46ca-becf-13af5b8f859c req-dbe53653-9208-40bc-a114-6a723235066d tempest-TestServerVolumeAttachmentScenario-18472656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:23:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-f2ceab6e-bb79-46ca-becf-13af5b8f859c req-dbe53653-9208-40bc-a114-6a723235066d tempest-TestServerVolumeAttachmentScenario-18472656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:23:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-f2ceab6e-bb79-46ca-becf-13af5b8f859c req-dbe53653-9208-40bc-a114-6a723235066d tempest-TestServerVolumeAttachmentScenario-18472656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:23:04 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-6aae65b5-9224-4442-b651-c3e3c278b4d4 tempest-VolumesActionsTest-1281671309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:23:04 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-6aae65b5-9224-4442-b651-c3e3c278b4d4 tempest-VolumesActionsTest-1281671309 None] Flow 'volume_create_manager' (940f390a-3de0-42b5-a510-d293603bc3e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:23:04 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-6aae65b5-9224-4442-b651-c3e3c278b4d4 tempest-VolumesActionsTest-1281671309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65410b65-0662-4e28-ab76-f83e59814b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:04 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [req-f2ceab6e-bb79-46ca-becf-13af5b8f859c req-dbe53653-9208-40bc-a114-6a723235066d tempest-TestServerVolumeAttachmentScenario-18472656 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1', 'name': 'volume-3ac49342-aa81-4663-9939-d798f6deb6b0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '74e912b1-8f47-449f-bf96-89c398585b8d', 'enforce_multipath': True} {{(pid=88613) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 10:23:04 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-6aae65b5-9224-4442-b651-c3e3c278b4d4 tempest-VolumesActionsTest-1281671309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65410b65-0662-4e28-ab76-f83e59814b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:23:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-503298957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fb3bfa3-659e-4688-aaec-28516119b735,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59d84c17dc794fb7b0527b1d35296590',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:23:04Z,use_quota=True,user_id='31056132f57d464587cf0bbc4d7d7cf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:04 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-6aae65b5-9224-4442-b651-c3e3c278b4d4 tempest-VolumesActionsTest-1281671309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6006f3a-5111-416d-96a1-1120f22ae96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:04 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-6aae65b5-9224-4442-b651-c3e3c278b4d4 tempest-VolumesActionsTest-1281671309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6006f3a-5111-416d-96a1-1120f22ae96e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:04 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-6aae65b5-9224-4442-b651-c3e3c278b4d4 tempest-VolumesActionsTest-1281671309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85fcf826-2352-4516-aa77-6a77655d8643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:04 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-6aae65b5-9224-4442-b651-c3e3c278b4d4 tempest-VolumesActionsTest-1281671309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85fcf826-2352-4516-aa77-6a77655d8643) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fb3bfa3-659e-4688-aaec-28516119b735', 'volume_name': 'volume-4fb3bfa3-659e-4688-aaec-28516119b735', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:04 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-6aae65b5-9224-4442-b651-c3e3c278b4d4 tempest-VolumesActionsTest-1281671309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7534e57-dd93-4691-965a-7a02abf42756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:04 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-6aae65b5-9224-4442-b651-c3e3c278b4d4 tempest-VolumesActionsTest-1281671309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7534e57-dd93-4691-965a-7a02abf42756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:04 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-6aae65b5-9224-4442-b651-c3e3c278b4d4 tempest-VolumesActionsTest-1281671309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1945039b-faf8-4fc4-a844-38af77aa752c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:04 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-6aae65b5-9224-4442-b651-c3e3c278b4d4 tempest-VolumesActionsTest-1281671309 None] Volume 4fb3bfa3-659e-4688-aaec-28516119b735: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fb3bfa3-659e-4688-aaec-28516119b735', 'volume_size': 1} Aug 05 10:23:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-6aae65b5-9224-4442-b651-c3e3c278b4d4 tempest-VolumesActionsTest-1281671309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:23:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-6aae65b5-9224-4442-b651-c3e3c278b4d4 tempest-VolumesActionsTest-1281671309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:23:04 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-6aae65b5-9224-4442-b651-c3e3c278b4d4 tempest-VolumesActionsTest-1281671309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:23:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-503298957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fb3bfa3-659e-4688-aaec-28516119b735,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59d84c17dc794fb7b0527b1d35296590',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:23:04Z,use_quota=True,user_id='31056132f57d464587cf0bbc4d7d7cf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:23:04 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-6aae65b5-9224-4442-b651-c3e3c278b4d4 tempest-VolumesActionsTest-1281671309 None] Creating volume 4fb3bfa3-659e-4688-aaec-28516119b735 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:23:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-6aae65b5-9224-4442-b651-c3e3c278b4d4 tempest-VolumesActionsTest-1281671309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:23:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-6aae65b5-9224-4442-b651-c3e3c278b4d4 tempest-VolumesActionsTest-1281671309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:23:04 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-6aae65b5-9224-4442-b651-c3e3c278b4d4 tempest-VolumesActionsTest-1281671309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:23:04 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-6aae65b5-9224-4442-b651-c3e3c278b4d4 tempest-VolumesActionsTest-1281671309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:23:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-6aae65b5-9224-4442-b651-c3e3c278b4d4 tempest-VolumesActionsTest-1281671309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:23:04 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-6aae65b5-9224-4442-b651-c3e3c278b4d4 tempest-VolumesActionsTest-1281671309 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:23:04 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-6aae65b5-9224-4442-b651-c3e3c278b4d4 tempest-VolumesActionsTest-1281671309 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:23:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6aae65b5-9224-4442-b651-c3e3c278b4d4 tempest-VolumesActionsTest-1281671309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-4fb3bfa3-659e-4688-aaec-28516119b735 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:04 devstack sudo[99320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-4fb3bfa3-659e-4688-aaec-28516119b735 1073741824 Aug 05 10:23:04 devstack sudo[99320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:04 devstack cinder-volume[88613]: INFO cinder.volume.manager [req-f2ceab6e-bb79-46ca-becf-13af5b8f859c req-dbe53653-9208-40bc-a114-6a723235066d tempest-TestServerVolumeAttachmentScenario-18472656 None] attachment_update completed successfully. Aug 05 10:23:04 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-f2ba77e2-50ca-4d41-80bf-b1fc0164d754 tempest-SnapshotMetadataTestJSON-1253752257 None] Acquiring lock "cinder-642b27dd-b164-4b4c-a766-ac7ae4d4d20b-delete_snapshot" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:23:05 devstack sudo[99320]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:05 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6aae65b5-9224-4442-b651-c3e3c278b4d4 tempest-VolumesActionsTest-1281671309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-4fb3bfa3-659e-4688-aaec-28516119b735 1073741824" returned: 0 in 0.689s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:05 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-f2ba77e2-50ca-4d41-80bf-b1fc0164d754 tempest-SnapshotMetadataTestJSON-1253752257 None] Lock "cinder-642b27dd-b164-4b4c-a766-ac7ae4d4d20b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:23:05 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-f2ba77e2-50ca-4d41-80bf-b1fc0164d754 tempest-SnapshotMetadataTestJSON-1253752257 None] Acquiring lock "cinder-quobyte-0d296207-9c9d-4a98-8c83-6d465c2e8ccf" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:23:05 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-f2ba77e2-50ca-4d41-80bf-b1fc0164d754 tempest-SnapshotMetadataTestJSON-1253752257 None] Lock "cinder-quobyte-0d296207-9c9d-4a98-8c83-6d465c2e8ccf" acquired by "delete_snapshot" :: waited 0.040s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:23:05 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-f2ba77e2-50ca-4d41-80bf-b1fc0164d754 tempest-SnapshotMetadataTestJSON-1253752257 None] Acquiring lock "cinder-quobyte-642b27dd-b164-4b4c-a766-ac7ae4d4d20b" by "_delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:23:05 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6aae65b5-9224-4442-b651-c3e3c278b4d4 tempest-VolumesActionsTest-1281671309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-4fb3bfa3-659e-4688-aaec-28516119b735 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:05 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-f2ba77e2-50ca-4d41-80bf-b1fc0164d754 tempest-SnapshotMetadataTestJSON-1253752257 None] Lock "cinder-quobyte-642b27dd-b164-4b4c-a766-ac7ae4d4d20b" acquired by "_delete_snapshot" :: waited 0.049s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:23:05 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-f2ba77e2-50ca-4d41-80bf-b1fc0164d754 tempest-SnapshotMetadataTestJSON-1253752257 None] Deleting offline snapshot 642b27dd-b164-4b4c-a766-ac7ae4d4d20b of volume 0d296207-9c9d-4a98-8c83-6d465c2e8ccf {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:23:05 devstack sudo[99710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-4fb3bfa3-659e-4688-aaec-28516119b735 Aug 05 10:23:05 devstack sudo[99710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:05 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-f2ba77e2-50ca-4d41-80bf-b1fc0164d754 tempest-SnapshotMetadataTestJSON-1253752257 None] snapshot_file for this snap is: volume-0d296207-9c9d-4a98-8c83-6d465c2e8ccf.642b27dd-b164-4b4c-a766-ac7ae4d4d20b {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:23:05 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac4619e-de1e-4735-b613-20c4fe0619e3]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:23:05 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f2ba77e2-50ca-4d41-80bf-b1fc0164d754 tempest-SnapshotMetadataTestJSON-1253752257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0d296207-9c9d-4a98-8c83-6d465c2e8ccf.642b27dd-b164-4b4c-a766-ac7ae4d4d20b {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:05 devstack sudo[99713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0d296207-9c9d-4a98-8c83-6d465c2e8ccf.642b27dd-b164-4b4c-a766-ac7ae4d4d20b Aug 05 10:23:05 devstack sudo[99713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:05 devstack sudo[99710]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:05 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6aae65b5-9224-4442-b651-c3e3c278b4d4 tempest-VolumesActionsTest-1281671309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-4fb3bfa3-659e-4688-aaec-28516119b735" returned: 0 in 0.395s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:05 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-6aae65b5-9224-4442-b651-c3e3c278b4d4 tempest-VolumesActionsTest-1281671309 None] <== create_volume: return (1160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:23:05 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-6aae65b5-9224-4442-b651-c3e3c278b4d4 tempest-VolumesActionsTest-1281671309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.162s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:23:05 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-6aae65b5-9224-4442-b651-c3e3c278b4d4 tempest-VolumesActionsTest-1281671309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1945039b-faf8-4fc4-a844-38af77aa752c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fb3bfa3-659e-4688-aaec-28516119b735', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:05 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-6aae65b5-9224-4442-b651-c3e3c278b4d4 tempest-VolumesActionsTest-1281671309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c880015-a085-4114-90d8-9fad93f4c582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:05 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-6aae65b5-9224-4442-b651-c3e3c278b4d4 tempest-VolumesActionsTest-1281671309 None] Volume volume-4fb3bfa3-659e-4688-aaec-28516119b735 (4fb3bfa3-659e-4688-aaec-28516119b735): created successfully Aug 05 10:23:05 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-6aae65b5-9224-4442-b651-c3e3c278b4d4 tempest-VolumesActionsTest-1281671309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c880015-a085-4114-90d8-9fad93f4c582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:05 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-6aae65b5-9224-4442-b651-c3e3c278b4d4 tempest-VolumesActionsTest-1281671309 None] Flow 'volume_create_manager' (940f390a-3de0-42b5-a510-d293603bc3e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:23:05 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-6aae65b5-9224-4442-b651-c3e3c278b4d4 tempest-VolumesActionsTest-1281671309 None] Created volume successfully. Aug 05 10:23:05 devstack sudo[99713]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:05 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f2ba77e2-50ca-4d41-80bf-b1fc0164d754 tempest-SnapshotMetadataTestJSON-1253752257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0d296207-9c9d-4a98-8c83-6d465c2e8ccf.642b27dd-b164-4b4c-a766-ac7ae4d4d20b" returned: 0 in 0.524s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:05 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-f2ba77e2-50ca-4d41-80bf-b1fc0164d754 tempest-SnapshotMetadataTestJSON-1253752257 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d296207-9c9d-4a98-8c83-6d465c2e8ccf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88613) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:23:05 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac3e10a-f3c5-47b4-bef4-601cb054680c]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:23:05 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f2ba77e2-50ca-4d41-80bf-b1fc0164d754 tempest-SnapshotMetadataTestJSON-1253752257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0d296207-9c9d-4a98-8c83-6d465c2e8ccf {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:05 devstack sudo[99719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0d296207-9c9d-4a98-8c83-6d465c2e8ccf Aug 05 10:23:05 devstack sudo[99719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:06 devstack sudo[99719]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f2ba77e2-50ca-4d41-80bf-b1fc0164d754 tempest-SnapshotMetadataTestJSON-1253752257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0d296207-9c9d-4a98-8c83-6d465c2e8ccf" returned: 0 in 0.412s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f2ba77e2-50ca-4d41-80bf-b1fc0164d754 tempest-SnapshotMetadataTestJSON-1253752257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0d296207-9c9d-4a98-8c83-6d465c2e8ccf.642b27dd-b164-4b4c-a766-ac7ae4d4d20b {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:06 devstack sudo[99724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0d296207-9c9d-4a98-8c83-6d465c2e8ccf.642b27dd-b164-4b4c-a766-ac7ae4d4d20b Aug 05 10:23:06 devstack sudo[99724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:06 devstack sudo[99724]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f2ba77e2-50ca-4d41-80bf-b1fc0164d754 tempest-SnapshotMetadataTestJSON-1253752257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0d296207-9c9d-4a98-8c83-6d465c2e8ccf.642b27dd-b164-4b4c-a766-ac7ae4d4d20b" returned: 0 in 0.465s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f2ba77e2-50ca-4d41-80bf-b1fc0164d754 tempest-SnapshotMetadataTestJSON-1253752257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0d296207-9c9d-4a98-8c83-6d465c2e8ccf.642b27dd-b164-4b4c-a766-ac7ae4d4d20b {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:06 devstack sudo[99730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0d296207-9c9d-4a98-8c83-6d465c2e8ccf.642b27dd-b164-4b4c-a766-ac7ae4d4d20b Aug 05 10:23:06 devstack sudo[99730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:06 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-2956be57-534f-4b67-9989-2c48deea3645 tempest-VolumesMetadataTest-1829520626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:23:06 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2956be57-534f-4b67-9989-2c48deea3645 tempest-VolumesMetadataTest-1829520626 None] Flow 'volume_create_manager' (20243480-5450-45a0-966a-b81d726b239c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:23:06 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2956be57-534f-4b67-9989-2c48deea3645 tempest-VolumesMetadataTest-1829520626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9820e42f-f02c-4cab-aa08-b38a208b101d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:06 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2956be57-534f-4b67-9989-2c48deea3645 tempest-VolumesMetadataTest-1829520626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9820e42f-f02c-4cab-aa08-b38a208b101d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:23:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-737839073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45db69f1-1821-4ba9-becb-9ac5eb0ba2a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99e1703192644ecd871a87752d4f731c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:23:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:23:07Z,use_quota=True,user_id='5ecba5948c8b42b2a278940b1102432e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:06 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2956be57-534f-4b67-9989-2c48deea3645 tempest-VolumesMetadataTest-1829520626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20047696-574e-4970-9f5f-fa746f253963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:06 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2956be57-534f-4b67-9989-2c48deea3645 tempest-VolumesMetadataTest-1829520626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20047696-574e-4970-9f5f-fa746f253963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:06 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2956be57-534f-4b67-9989-2c48deea3645 tempest-VolumesMetadataTest-1829520626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d71b1993-0fe4-49f2-9c7f-b0c59f09342b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:06 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2956be57-534f-4b67-9989-2c48deea3645 tempest-VolumesMetadataTest-1829520626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d71b1993-0fe4-49f2-9c7f-b0c59f09342b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45db69f1-1821-4ba9-becb-9ac5eb0ba2a2', 'volume_name': 'volume-45db69f1-1821-4ba9-becb-9ac5eb0ba2a2', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:06 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2956be57-534f-4b67-9989-2c48deea3645 tempest-VolumesMetadataTest-1829520626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (104cd0f3-ec71-4a9c-85a0-b9e9c3731294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:06 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2956be57-534f-4b67-9989-2c48deea3645 tempest-VolumesMetadataTest-1829520626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (104cd0f3-ec71-4a9c-85a0-b9e9c3731294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:06 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2956be57-534f-4b67-9989-2c48deea3645 tempest-VolumesMetadataTest-1829520626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd6e34f6-cd2c-4c14-99a3-e068c1389266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:06 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-2956be57-534f-4b67-9989-2c48deea3645 tempest-VolumesMetadataTest-1829520626 None] Volume 45db69f1-1821-4ba9-becb-9ac5eb0ba2a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45db69f1-1821-4ba9-becb-9ac5eb0ba2a2', 'volume_size': 1} Aug 05 10:23:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2956be57-534f-4b67-9989-2c48deea3645 tempest-VolumesMetadataTest-1829520626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:23:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2956be57-534f-4b67-9989-2c48deea3645 tempest-VolumesMetadataTest-1829520626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:23:06 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-2956be57-534f-4b67-9989-2c48deea3645 tempest-VolumesMetadataTest-1829520626 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:23:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-737839073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45db69f1-1821-4ba9-becb-9ac5eb0ba2a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99e1703192644ecd871a87752d4f731c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:23:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:23:07Z,use_quota=True,user_id='5ecba5948c8b42b2a278940b1102432e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:23:06 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-2956be57-534f-4b67-9989-2c48deea3645 tempest-VolumesMetadataTest-1829520626 None] Creating volume 45db69f1-1821-4ba9-becb-9ac5eb0ba2a2 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:23:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2956be57-534f-4b67-9989-2c48deea3645 tempest-VolumesMetadataTest-1829520626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:23:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2956be57-534f-4b67-9989-2c48deea3645 tempest-VolumesMetadataTest-1829520626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:23:06 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-2956be57-534f-4b67-9989-2c48deea3645 tempest-VolumesMetadataTest-1829520626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:23:06 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-2956be57-534f-4b67-9989-2c48deea3645 tempest-VolumesMetadataTest-1829520626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:23:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2956be57-534f-4b67-9989-2c48deea3645 tempest-VolumesMetadataTest-1829520626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:23:06 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-2956be57-534f-4b67-9989-2c48deea3645 tempest-VolumesMetadataTest-1829520626 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:23:06 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-2956be57-534f-4b67-9989-2c48deea3645 tempest-VolumesMetadataTest-1829520626 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:23:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2956be57-534f-4b67-9989-2c48deea3645 tempest-VolumesMetadataTest-1829520626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-45db69f1-1821-4ba9-becb-9ac5eb0ba2a2 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:06 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-bd81a0ae-c4ce-4bbe-a134-e7cff4451f59 tempest-VolumesActionsTest-2123852216 None] Acquiring lock "cinder-4fb3bfa3-659e-4688-aaec-28516119b735-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:23:06 devstack sudo[99732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-45db69f1-1821-4ba9-becb-9ac5eb0ba2a2 1073741824 Aug 05 10:23:06 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-bd81a0ae-c4ce-4bbe-a134-e7cff4451f59 tempest-VolumesActionsTest-2123852216 None] Lock "cinder-4fb3bfa3-659e-4688-aaec-28516119b735-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:23:06 devstack sudo[99732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:06 devstack sudo[99730]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f2ba77e2-50ca-4d41-80bf-b1fc0164d754 tempest-SnapshotMetadataTestJSON-1253752257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0d296207-9c9d-4a98-8c83-6d465c2e8ccf.642b27dd-b164-4b4c-a766-ac7ae4d4d20b" returned: 0 in 0.344s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:06 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-bd81a0ae-c4ce-4bbe-a134-e7cff4451f59 tempest-VolumesActionsTest-2123852216 None] Acquiring lock "cinder-quobyte-4fb3bfa3-659e-4688-aaec-28516119b735" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:23:07 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-bd81a0ae-c4ce-4bbe-a134-e7cff4451f59 tempest-VolumesActionsTest-2123852216 None] Lock "cinder-quobyte-4fb3bfa3-659e-4688-aaec-28516119b735" acquired by "delete_volume" :: waited 0.047s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:23:07 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-f2ba77e2-50ca-4d41-80bf-b1fc0164d754 tempest-SnapshotMetadataTestJSON-1253752257 None] Lock "cinder-quobyte-642b27dd-b164-4b4c-a766-ac7ae4d4d20b" released by "_delete_snapshot" :: held 1.911s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:23:07 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-f2ba77e2-50ca-4d41-80bf-b1fc0164d754 tempest-SnapshotMetadataTestJSON-1253752257 None] Lock "cinder-quobyte-0d296207-9c9d-4a98-8c83-6d465c2e8ccf" released by "delete_snapshot" :: held 1.972s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:23:07 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[f69630d6-2915-48d1-8621-3a4a9d1cd8b1]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:23:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-bd81a0ae-c4ce-4bbe-a134-e7cff4451f59 tempest-VolumesActionsTest-2123852216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-4fb3bfa3-659e-4688-aaec-28516119b735 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:07 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-f2ba77e2-50ca-4d41-80bf-b1fc0164d754 tempest-SnapshotMetadataTestJSON-1253752257 None] Created reservations ['9c918586-910e-4bb5-b57f-d4dbda65d1fc', 'f4dc0227-1bc8-4960-b261-1c07a23681bf', '1bcd3274-4a38-4ed5-9d61-336271f58559', '9e2d2b1f-541a-46b9-a703-0384f82c1a68'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:23:07 devstack sudo[99735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-4fb3bfa3-659e-4688-aaec-28516119b735 Aug 05 10:23:07 devstack sudo[99735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:07 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-f2ba77e2-50ca-4d41-80bf-b1fc0164d754 tempest-SnapshotMetadataTestJSON-1253752257 None] Delete snapshot completed successfully. Aug 05 10:23:07 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-f2ba77e2-50ca-4d41-80bf-b1fc0164d754 tempest-SnapshotMetadataTestJSON-1253752257 None] Lock "cinder-642b27dd-b164-4b4c-a766-ac7ae4d4d20b-delete_snapshot" released by "delete_snapshot" :: held 2.201s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:23:07 devstack sudo[99732]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2956be57-534f-4b67-9989-2c48deea3645 tempest-VolumesMetadataTest-1829520626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-45db69f1-1821-4ba9-becb-9ac5eb0ba2a2 1073741824" returned: 0 in 0.586s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:07 devstack sudo[99735]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-bd81a0ae-c4ce-4bbe-a134-e7cff4451f59 tempest-VolumesActionsTest-2123852216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-4fb3bfa3-659e-4688-aaec-28516119b735" returned: 0 in 0.439s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-bd81a0ae-c4ce-4bbe-a134-e7cff4451f59 tempest-VolumesActionsTest-2123852216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-4fb3bfa3-659e-4688-aaec-28516119b735 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2956be57-534f-4b67-9989-2c48deea3645 tempest-VolumesMetadataTest-1829520626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-45db69f1-1821-4ba9-becb-9ac5eb0ba2a2 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:07 devstack sudo[99746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-4fb3bfa3-659e-4688-aaec-28516119b735 Aug 05 10:23:07 devstack sudo[99746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:07 devstack sudo[99747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-45db69f1-1821-4ba9-becb-9ac5eb0ba2a2 Aug 05 10:23:07 devstack sudo[99747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:07 devstack sudo[99747]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2956be57-534f-4b67-9989-2c48deea3645 tempest-VolumesMetadataTest-1829520626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-45db69f1-1821-4ba9-becb-9ac5eb0ba2a2" returned: 0 in 0.296s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:07 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-2956be57-534f-4b67-9989-2c48deea3645 tempest-VolumesMetadataTest-1829520626 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:23:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2956be57-534f-4b67-9989-2c48deea3645 tempest-VolumesMetadataTest-1829520626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:23:07 devstack sudo[99746]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-bd81a0ae-c4ce-4bbe-a134-e7cff4451f59 tempest-VolumesActionsTest-2123852216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-4fb3bfa3-659e-4688-aaec-28516119b735" returned: 0 in 0.319s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:07 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2956be57-534f-4b67-9989-2c48deea3645 tempest-VolumesMetadataTest-1829520626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd6e34f6-cd2c-4c14-99a3-e068c1389266) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45db69f1-1821-4ba9-becb-9ac5eb0ba2a2', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:07 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2956be57-534f-4b67-9989-2c48deea3645 tempest-VolumesMetadataTest-1829520626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e1482e7-23f4-4ded-a3a3-6f14a451640d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:07 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-bd81a0ae-c4ce-4bbe-a134-e7cff4451f59 tempest-VolumesActionsTest-2123852216 None] Lock "cinder-quobyte-4fb3bfa3-659e-4688-aaec-28516119b735" released by "delete_volume" :: held 0.830s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:23:07 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-2956be57-534f-4b67-9989-2c48deea3645 tempest-VolumesMetadataTest-1829520626 None] Volume volume-45db69f1-1821-4ba9-becb-9ac5eb0ba2a2 (45db69f1-1821-4ba9-becb-9ac5eb0ba2a2): created successfully Aug 05 10:23:07 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2956be57-534f-4b67-9989-2c48deea3645 tempest-VolumesMetadataTest-1829520626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e1482e7-23f4-4ded-a3a3-6f14a451640d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:07 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2956be57-534f-4b67-9989-2c48deea3645 tempest-VolumesMetadataTest-1829520626 None] Flow 'volume_create_manager' (20243480-5450-45a0-966a-b81d726b239c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:23:07 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-2956be57-534f-4b67-9989-2c48deea3645 tempest-VolumesMetadataTest-1829520626 None] Created volume successfully. Aug 05 10:23:07 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-bd81a0ae-c4ce-4bbe-a134-e7cff4451f59 tempest-VolumesActionsTest-2123852216 None] Created reservations ['20ce06e6-fe68-4433-91b9-c52b42cfc3b2', '9945dfc9-d0a9-4014-9184-ca5e0fc204e4', '51da25cd-b63c-4f3c-83d6-15f96bd60430', '192f6d21-6905-402a-8443-004c8293aeb3'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:23:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-bd81a0ae-c4ce-4bbe-a134-e7cff4451f59 tempest-VolumesActionsTest-2123852216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:23:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-bd81a0ae-c4ce-4bbe-a134-e7cff4451f59 tempest-VolumesActionsTest-2123852216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:23:07 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-bd81a0ae-c4ce-4bbe-a134-e7cff4451f59 tempest-VolumesActionsTest-2123852216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:23:08 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-bd81a0ae-c4ce-4bbe-a134-e7cff4451f59 tempest-VolumesActionsTest-2123852216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:23:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-bd81a0ae-c4ce-4bbe-a134-e7cff4451f59 tempest-VolumesActionsTest-2123852216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:23:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-bd81a0ae-c4ce-4bbe-a134-e7cff4451f59 tempest-VolumesActionsTest-2123852216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:08 devstack sudo[99758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:23:08 devstack sudo[99758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:08 devstack sudo[99758]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-bd81a0ae-c4ce-4bbe-a134-e7cff4451f59 tempest-VolumesActionsTest-2123852216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.278s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:08 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-bd81a0ae-c4ce-4bbe-a134-e7cff4451f59 tempest-VolumesActionsTest-2123852216 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:23:08 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-bd81a0ae-c4ce-4bbe-a134-e7cff4451f59 tempest-VolumesActionsTest-2123852216 None] Deleted volume successfully. Aug 05 10:23:08 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-432e3a2b-4d27-427f-8a04-db82dd2fa092 tempest-SnapshotMetadataTestJSON-1253752257 None] Acquiring lock "cinder-0d296207-9c9d-4a98-8c83-6d465c2e8ccf-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:23:08 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-bd81a0ae-c4ce-4bbe-a134-e7cff4451f59 tempest-VolumesActionsTest-2123852216 None] Lock "cinder-4fb3bfa3-659e-4688-aaec-28516119b735-delete_volume" released by "delete_volume" :: held 1.398s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:23:08 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-432e3a2b-4d27-427f-8a04-db82dd2fa092 tempest-SnapshotMetadataTestJSON-1253752257 None] Lock "cinder-0d296207-9c9d-4a98-8c83-6d465c2e8ccf-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:23:08 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-432e3a2b-4d27-427f-8a04-db82dd2fa092 tempest-SnapshotMetadataTestJSON-1253752257 None] Acquiring lock "cinder-quobyte-0d296207-9c9d-4a98-8c83-6d465c2e8ccf" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:23:08 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-432e3a2b-4d27-427f-8a04-db82dd2fa092 tempest-SnapshotMetadataTestJSON-1253752257 None] Lock "cinder-quobyte-0d296207-9c9d-4a98-8c83-6d465c2e8ccf" acquired by "delete_volume" :: waited 0.020s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:23:08 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[5927df8a-d091-46f1-9134-0f5e94bcecc2]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:23:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-432e3a2b-4d27-427f-8a04-db82dd2fa092 tempest-SnapshotMetadataTestJSON-1253752257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0d296207-9c9d-4a98-8c83-6d465c2e8ccf {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:08 devstack sudo[99761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0d296207-9c9d-4a98-8c83-6d465c2e8ccf Aug 05 10:23:08 devstack sudo[99761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:08 devstack sudo[99761]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-432e3a2b-4d27-427f-8a04-db82dd2fa092 tempest-SnapshotMetadataTestJSON-1253752257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0d296207-9c9d-4a98-8c83-6d465c2e8ccf" returned: 0 in 0.399s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-432e3a2b-4d27-427f-8a04-db82dd2fa092 tempest-SnapshotMetadataTestJSON-1253752257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0d296207-9c9d-4a98-8c83-6d465c2e8ccf {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:08 devstack sudo[99769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0d296207-9c9d-4a98-8c83-6d465c2e8ccf Aug 05 10:23:08 devstack sudo[99769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:09 devstack sudo[99769]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-432e3a2b-4d27-427f-8a04-db82dd2fa092 tempest-SnapshotMetadataTestJSON-1253752257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0d296207-9c9d-4a98-8c83-6d465c2e8ccf" returned: 0 in 0.327s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:09 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-432e3a2b-4d27-427f-8a04-db82dd2fa092 tempest-SnapshotMetadataTestJSON-1253752257 None] Lock "cinder-quobyte-0d296207-9c9d-4a98-8c83-6d465c2e8ccf" released by "delete_volume" :: held 0.806s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:23:09 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-432e3a2b-4d27-427f-8a04-db82dd2fa092 tempest-SnapshotMetadataTestJSON-1253752257 None] Created reservations ['f798975f-261c-40c7-8b76-e446cdbcce72', '48ea6d46-ec57-4712-a2d3-5cfd796483e0', 'b3cf6afa-2a29-48f5-ab24-243d6d3b3e87', '604c9dc1-2c2a-4d8c-a2d7-260475912d78'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:23:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-432e3a2b-4d27-427f-8a04-db82dd2fa092 tempest-SnapshotMetadataTestJSON-1253752257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:23:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-432e3a2b-4d27-427f-8a04-db82dd2fa092 tempest-SnapshotMetadataTestJSON-1253752257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:23:09 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-432e3a2b-4d27-427f-8a04-db82dd2fa092 tempest-SnapshotMetadataTestJSON-1253752257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:23:09 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-432e3a2b-4d27-427f-8a04-db82dd2fa092 tempest-SnapshotMetadataTestJSON-1253752257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:23:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-432e3a2b-4d27-427f-8a04-db82dd2fa092 tempest-SnapshotMetadataTestJSON-1253752257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:23:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-432e3a2b-4d27-427f-8a04-db82dd2fa092 tempest-SnapshotMetadataTestJSON-1253752257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:09 devstack sudo[99776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:23:09 devstack sudo[99776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:09 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d2c2f81-85d6-44fb-8e10-ef24110c626d tempest-VolumesActionsTest-1281671309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:23:09 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0d2c2f81-85d6-44fb-8e10-ef24110c626d tempest-VolumesActionsTest-1281671309 None] Flow 'volume_create_manager' (47382b63-7060-4bac-b526-90014e581a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:23:09 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0d2c2f81-85d6-44fb-8e10-ef24110c626d tempest-VolumesActionsTest-1281671309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70e75638-cac2-46fd-afb1-88fd7e3bca8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:09 devstack sudo[99776]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:09 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0d2c2f81-85d6-44fb-8e10-ef24110c626d tempest-VolumesActionsTest-1281671309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70e75638-cac2-46fd-afb1-88fd7e3bca8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:23:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1443132691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b27d306e-146f-437a-ba4a-00ba17f08fcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59d84c17dc794fb7b0527b1d35296590',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:23:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:23:10Z,use_quota=True,user_id='31056132f57d464587cf0bbc4d7d7cf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:09 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0d2c2f81-85d6-44fb-8e10-ef24110c626d tempest-VolumesActionsTest-1281671309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a368086-2afc-4247-95b5-5aab8c880f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:09 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0d2c2f81-85d6-44fb-8e10-ef24110c626d tempest-VolumesActionsTest-1281671309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a368086-2afc-4247-95b5-5aab8c880f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:09 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0d2c2f81-85d6-44fb-8e10-ef24110c626d tempest-VolumesActionsTest-1281671309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90c6bb3c-5234-4c42-99a2-750cd2e2542f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:09 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0d2c2f81-85d6-44fb-8e10-ef24110c626d tempest-VolumesActionsTest-1281671309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90c6bb3c-5234-4c42-99a2-750cd2e2542f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b27d306e-146f-437a-ba4a-00ba17f08fcc', 'volume_name': 'volume-b27d306e-146f-437a-ba4a-00ba17f08fcc', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:09 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0d2c2f81-85d6-44fb-8e10-ef24110c626d tempest-VolumesActionsTest-1281671309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bdca429-dcd2-475c-8fdc-64b2513f551d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:09 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0d2c2f81-85d6-44fb-8e10-ef24110c626d tempest-VolumesActionsTest-1281671309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bdca429-dcd2-475c-8fdc-64b2513f551d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:09 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0d2c2f81-85d6-44fb-8e10-ef24110c626d tempest-VolumesActionsTest-1281671309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea87e0f4-273e-4a1a-aee5-0a5d04c6e737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:09 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-0d2c2f81-85d6-44fb-8e10-ef24110c626d tempest-VolumesActionsTest-1281671309 None] Volume b27d306e-146f-437a-ba4a-00ba17f08fcc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b27d306e-146f-437a-ba4a-00ba17f08fcc', 'volume_size': 1} Aug 05 10:23:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-0d2c2f81-85d6-44fb-8e10-ef24110c626d tempest-VolumesActionsTest-1281671309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:23:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-0d2c2f81-85d6-44fb-8e10-ef24110c626d tempest-VolumesActionsTest-1281671309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:23:09 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-0d2c2f81-85d6-44fb-8e10-ef24110c626d tempest-VolumesActionsTest-1281671309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:23:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1443132691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b27d306e-146f-437a-ba4a-00ba17f08fcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59d84c17dc794fb7b0527b1d35296590',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:23:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:23:10Z,use_quota=True,user_id='31056132f57d464587cf0bbc4d7d7cf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:23:09 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-0d2c2f81-85d6-44fb-8e10-ef24110c626d tempest-VolumesActionsTest-1281671309 None] Creating volume b27d306e-146f-437a-ba4a-00ba17f08fcc {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:23:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-0d2c2f81-85d6-44fb-8e10-ef24110c626d tempest-VolumesActionsTest-1281671309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:23:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-0d2c2f81-85d6-44fb-8e10-ef24110c626d tempest-VolumesActionsTest-1281671309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:23:09 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-0d2c2f81-85d6-44fb-8e10-ef24110c626d tempest-VolumesActionsTest-1281671309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:23:09 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-0d2c2f81-85d6-44fb-8e10-ef24110c626d tempest-VolumesActionsTest-1281671309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:23:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-0d2c2f81-85d6-44fb-8e10-ef24110c626d tempest-VolumesActionsTest-1281671309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:23:09 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-0d2c2f81-85d6-44fb-8e10-ef24110c626d tempest-VolumesActionsTest-1281671309 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:23:09 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-0d2c2f81-85d6-44fb-8e10-ef24110c626d tempest-VolumesActionsTest-1281671309 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:23:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-0d2c2f81-85d6-44fb-8e10-ef24110c626d tempest-VolumesActionsTest-1281671309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-b27d306e-146f-437a-ba4a-00ba17f08fcc 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-a9de116f-9256-46dc-8d57-bc9eb12d7a67 req-b19d3097-9a43-4af0-8f4a-ec726c2e66af tempest-TestServerVolumeAttachmentScenario-18472656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:23:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-432e3a2b-4d27-427f-8a04-db82dd2fa092 tempest-SnapshotMetadataTestJSON-1253752257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.477s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:09 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-432e3a2b-4d27-427f-8a04-db82dd2fa092 tempest-SnapshotMetadataTestJSON-1253752257 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:23:09 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-432e3a2b-4d27-427f-8a04-db82dd2fa092 tempest-SnapshotMetadataTestJSON-1253752257 None] Deleted volume successfully. Aug 05 10:23:09 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-432e3a2b-4d27-427f-8a04-db82dd2fa092 tempest-SnapshotMetadataTestJSON-1253752257 None] Lock "cinder-0d296207-9c9d-4a98-8c83-6d465c2e8ccf-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:23:09 devstack sudo[99783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-b27d306e-146f-437a-ba4a-00ba17f08fcc 1073741824 Aug 05 10:23:09 devstack sudo[99783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:10 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-b87a65b1-bf6d-4a0e-a1cd-f38751f6f26d tempest-VolumesMetadataTest-1829520626 None] Acquiring lock "cinder-45db69f1-1821-4ba9-becb-9ac5eb0ba2a2-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:23:10 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-b87a65b1-bf6d-4a0e-a1cd-f38751f6f26d tempest-VolumesMetadataTest-1829520626 None] Lock "cinder-45db69f1-1821-4ba9-becb-9ac5eb0ba2a2-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:23:10 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-b87a65b1-bf6d-4a0e-a1cd-f38751f6f26d tempest-VolumesMetadataTest-1829520626 None] Acquiring lock "cinder-quobyte-45db69f1-1821-4ba9-becb-9ac5eb0ba2a2" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:23:10 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-b87a65b1-bf6d-4a0e-a1cd-f38751f6f26d tempest-VolumesMetadataTest-1829520626 None] Lock "cinder-quobyte-45db69f1-1821-4ba9-becb-9ac5eb0ba2a2" acquired by "delete_volume" :: waited 0.015s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:23:10 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c9e5ec-c0a6-4c67-ac3d-99a8bbf4dc22]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:23:10 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b87a65b1-bf6d-4a0e-a1cd-f38751f6f26d tempest-VolumesMetadataTest-1829520626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-45db69f1-1821-4ba9-becb-9ac5eb0ba2a2 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:10 devstack sudo[99787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-45db69f1-1821-4ba9-becb-9ac5eb0ba2a2 Aug 05 10:23:10 devstack sudo[99787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:10 devstack sudo[99783]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:10 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-0d2c2f81-85d6-44fb-8e10-ef24110c626d tempest-VolumesActionsTest-1281671309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-b27d306e-146f-437a-ba4a-00ba17f08fcc 1073741824" returned: 0 in 0.575s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:10 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-0d2c2f81-85d6-44fb-8e10-ef24110c626d tempest-VolumesActionsTest-1281671309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-b27d306e-146f-437a-ba4a-00ba17f08fcc {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:10 devstack sudo[99791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-b27d306e-146f-437a-ba4a-00ba17f08fcc Aug 05 10:23:10 devstack sudo[99791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:10 devstack sudo[99787]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:10 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b87a65b1-bf6d-4a0e-a1cd-f38751f6f26d tempest-VolumesMetadataTest-1829520626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-45db69f1-1821-4ba9-becb-9ac5eb0ba2a2" returned: 0 in 0.440s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:10 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b87a65b1-bf6d-4a0e-a1cd-f38751f6f26d tempest-VolumesMetadataTest-1829520626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-45db69f1-1821-4ba9-becb-9ac5eb0ba2a2 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:10 devstack sudo[99797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-45db69f1-1821-4ba9-becb-9ac5eb0ba2a2 Aug 05 10:23:10 devstack sudo[99797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:10 devstack sudo[99791]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:10 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-0d2c2f81-85d6-44fb-8e10-ef24110c626d tempest-VolumesActionsTest-1281671309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-b27d306e-146f-437a-ba4a-00ba17f08fcc" returned: 0 in 0.277s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:10 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-0d2c2f81-85d6-44fb-8e10-ef24110c626d tempest-VolumesActionsTest-1281671309 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:23:10 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-0d2c2f81-85d6-44fb-8e10-ef24110c626d tempest-VolumesActionsTest-1281671309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:23:10 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-a9de116f-9256-46dc-8d57-bc9eb12d7a67 req-b19d3097-9a43-4af0-8f4a-ec726c2e66af tempest-TestServerVolumeAttachmentScenario-18472656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.907s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:23:10 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0d2c2f81-85d6-44fb-8e10-ef24110c626d tempest-VolumesActionsTest-1281671309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea87e0f4-273e-4a1a-aee5-0a5d04c6e737) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b27d306e-146f-437a-ba4a-00ba17f08fcc', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:10 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0d2c2f81-85d6-44fb-8e10-ef24110c626d tempest-VolumesActionsTest-1281671309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4677e8f8-ca2e-4887-8b54-8c82f7d36a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:10 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-a9de116f-9256-46dc-8d57-bc9eb12d7a67 req-b19d3097-9a43-4af0-8f4a-ec726c2e66af tempest-TestServerVolumeAttachmentScenario-18472656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:23:10 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-0d2c2f81-85d6-44fb-8e10-ef24110c626d tempest-VolumesActionsTest-1281671309 None] Volume volume-b27d306e-146f-437a-ba4a-00ba17f08fcc (b27d306e-146f-437a-ba4a-00ba17f08fcc): created successfully Aug 05 10:23:10 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0d2c2f81-85d6-44fb-8e10-ef24110c626d tempest-VolumesActionsTest-1281671309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4677e8f8-ca2e-4887-8b54-8c82f7d36a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:10 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0d2c2f81-85d6-44fb-8e10-ef24110c626d tempest-VolumesActionsTest-1281671309 None] Flow 'volume_create_manager' (47382b63-7060-4bac-b526-90014e581a0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:23:10 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-0d2c2f81-85d6-44fb-8e10-ef24110c626d tempest-VolumesActionsTest-1281671309 None] Created volume successfully. Aug 05 10:23:10 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [req-a9de116f-9256-46dc-8d57-bc9eb12d7a67 req-b19d3097-9a43-4af0-8f4a-ec726c2e66af tempest-TestServerVolumeAttachmentScenario-18472656 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1', 'name': 'volume-b7a3359b-2c8e-4495-a87b-42cc222a17dc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '88008c37-cdfe-4a69-a6ba-a664ce846535', 'enforce_multipath': True} {{(pid=88613) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 10:23:10 devstack sudo[99797]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:10 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b87a65b1-bf6d-4a0e-a1cd-f38751f6f26d tempest-VolumesMetadataTest-1829520626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-45db69f1-1821-4ba9-becb-9ac5eb0ba2a2" returned: 0 in 0.285s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:10 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-b87a65b1-bf6d-4a0e-a1cd-f38751f6f26d tempest-VolumesMetadataTest-1829520626 None] Lock "cinder-quobyte-45db69f1-1821-4ba9-becb-9ac5eb0ba2a2" released by "delete_volume" :: held 0.780s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:23:10 devstack cinder-volume[88613]: INFO cinder.volume.manager [req-a9de116f-9256-46dc-8d57-bc9eb12d7a67 req-b19d3097-9a43-4af0-8f4a-ec726c2e66af tempest-TestServerVolumeAttachmentScenario-18472656 None] attachment_update completed successfully. Aug 05 10:23:11 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-b87a65b1-bf6d-4a0e-a1cd-f38751f6f26d tempest-VolumesMetadataTest-1829520626 None] Created reservations ['37dc8d0e-e887-48b2-9f83-0e7d09614d42', '6cf2a031-f952-449b-ace2-99872a47741e', 'e8c985c0-45ce-416e-a502-39d7703525a5', '458e8c07-1a3c-4960-bbe4-52041d9bfd18'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:23:11 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-b87a65b1-bf6d-4a0e-a1cd-f38751f6f26d tempest-VolumesMetadataTest-1829520626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:23:11 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-b87a65b1-bf6d-4a0e-a1cd-f38751f6f26d tempest-VolumesMetadataTest-1829520626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:23:11 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-b87a65b1-bf6d-4a0e-a1cd-f38751f6f26d tempest-VolumesMetadataTest-1829520626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:23:11 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-b87a65b1-bf6d-4a0e-a1cd-f38751f6f26d tempest-VolumesMetadataTest-1829520626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:23:11 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-b87a65b1-bf6d-4a0e-a1cd-f38751f6f26d tempest-VolumesMetadataTest-1829520626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:23:11 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b87a65b1-bf6d-4a0e-a1cd-f38751f6f26d tempest-VolumesMetadataTest-1829520626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:11 devstack sudo[99803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:23:11 devstack sudo[99803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:11 devstack sudo[99803]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:11 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b87a65b1-bf6d-4a0e-a1cd-f38751f6f26d tempest-VolumesMetadataTest-1829520626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.350s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:11 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-b87a65b1-bf6d-4a0e-a1cd-f38751f6f26d tempest-VolumesMetadataTest-1829520626 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:23:11 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-b87a65b1-bf6d-4a0e-a1cd-f38751f6f26d tempest-VolumesMetadataTest-1829520626 None] Deleted volume successfully. Aug 05 10:23:11 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-b87a65b1-bf6d-4a0e-a1cd-f38751f6f26d tempest-VolumesMetadataTest-1829520626 None] Lock "cinder-45db69f1-1821-4ba9-becb-9ac5eb0ba2a2-delete_volume" released by "delete_volume" :: held 1.423s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:23:12 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-6a61f426-3b6f-4cbf-b692-36f14ca686fd tempest-VolumesActionsTest-2123852216 None] Acquiring lock "cinder-b27d306e-146f-437a-ba4a-00ba17f08fcc-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:23:12 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-6a61f426-3b6f-4cbf-b692-36f14ca686fd tempest-VolumesActionsTest-2123852216 None] Lock "cinder-b27d306e-146f-437a-ba4a-00ba17f08fcc-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:23:12 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-6a61f426-3b6f-4cbf-b692-36f14ca686fd tempest-VolumesActionsTest-2123852216 None] Acquiring lock "cinder-quobyte-b27d306e-146f-437a-ba4a-00ba17f08fcc" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:23:12 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-6a61f426-3b6f-4cbf-b692-36f14ca686fd tempest-VolumesActionsTest-2123852216 None] Lock "cinder-quobyte-b27d306e-146f-437a-ba4a-00ba17f08fcc" acquired by "delete_volume" :: waited 0.018s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:23:12 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[6172cbb2-8b1c-4514-b3ea-de2da2534fde]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:23:12 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6a61f426-3b6f-4cbf-b692-36f14ca686fd tempest-VolumesActionsTest-2123852216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-b27d306e-146f-437a-ba4a-00ba17f08fcc {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:12 devstack sudo[99809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-b27d306e-146f-437a-ba4a-00ba17f08fcc Aug 05 10:23:12 devstack sudo[99809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:12 devstack sudo[99809]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:12 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6a61f426-3b6f-4cbf-b692-36f14ca686fd tempest-VolumesActionsTest-2123852216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-b27d306e-146f-437a-ba4a-00ba17f08fcc" returned: 0 in 0.531s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:12 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6a61f426-3b6f-4cbf-b692-36f14ca686fd tempest-VolumesActionsTest-2123852216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-b27d306e-146f-437a-ba4a-00ba17f08fcc {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:12 devstack sudo[99815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-b27d306e-146f-437a-ba4a-00ba17f08fcc Aug 05 10:23:12 devstack sudo[99815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:13 devstack sudo[99815]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:13 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6a61f426-3b6f-4cbf-b692-36f14ca686fd tempest-VolumesActionsTest-2123852216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-b27d306e-146f-437a-ba4a-00ba17f08fcc" returned: 0 in 0.354s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:13 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-6a61f426-3b6f-4cbf-b692-36f14ca686fd tempest-VolumesActionsTest-2123852216 None] Lock "cinder-quobyte-b27d306e-146f-437a-ba4a-00ba17f08fcc" released by "delete_volume" :: held 0.940s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:23:13 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-6a61f426-3b6f-4cbf-b692-36f14ca686fd tempest-VolumesActionsTest-2123852216 None] Created reservations ['cbbdd9da-cd20-47bd-bf66-7538864de407', '899193a1-abdf-47ab-82ad-bc4f6b6f7c9d', 'e2f47097-c156-4feb-b4ea-ae775196c69c', '08477348-2fa2-49bd-a364-7c842fe1f447'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:23:13 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-6a61f426-3b6f-4cbf-b692-36f14ca686fd tempest-VolumesActionsTest-2123852216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:23:13 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-6a61f426-3b6f-4cbf-b692-36f14ca686fd tempest-VolumesActionsTest-2123852216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:23:13 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-6a61f426-3b6f-4cbf-b692-36f14ca686fd tempest-VolumesActionsTest-2123852216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:23:13 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-6a61f426-3b6f-4cbf-b692-36f14ca686fd tempest-VolumesActionsTest-2123852216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:23:13 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-6a61f426-3b6f-4cbf-b692-36f14ca686fd tempest-VolumesActionsTest-2123852216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:23:13 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6a61f426-3b6f-4cbf-b692-36f14ca686fd tempest-VolumesActionsTest-2123852216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:13 devstack sudo[99818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:23:13 devstack sudo[99818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:13 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-5de0e201-1d62-42b3-82df-c225ce4e2b74 tempest-VolumesDeleteCascade-209937010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:23:13 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5de0e201-1d62-42b3-82df-c225ce4e2b74 tempest-VolumesDeleteCascade-209937010 None] Flow 'volume_create_manager' (06eebc42-1e30-4d74-8a7c-3b38a016e01f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:23:13 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5de0e201-1d62-42b3-82df-c225ce4e2b74 tempest-VolumesDeleteCascade-209937010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e19b1797-b64c-4575-83d2-97a028be15e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:13 devstack sudo[99818]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:13 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6a61f426-3b6f-4cbf-b692-36f14ca686fd tempest-VolumesActionsTest-2123852216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.346s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:13 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-6a61f426-3b6f-4cbf-b692-36f14ca686fd tempest-VolumesActionsTest-2123852216 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:23:13 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5de0e201-1d62-42b3-82df-c225ce4e2b74 tempest-VolumesDeleteCascade-209937010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e19b1797-b64c-4575-83d2-97a028be15e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:23:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-327031430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e72bbc0-9911-4094-b13d-d503bac50acf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5eb090a71f14c278530d309ba2d85ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:23:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:23:13Z,use_quota=True,user_id='bee3dc2926dc4e56acaa771d12c6ad8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:13 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5de0e201-1d62-42b3-82df-c225ce4e2b74 tempest-VolumesDeleteCascade-209937010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a41f255d-e8fc-4ee6-9a18-799f66cca521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:13 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5de0e201-1d62-42b3-82df-c225ce4e2b74 tempest-VolumesDeleteCascade-209937010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a41f255d-e8fc-4ee6-9a18-799f66cca521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:13 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5de0e201-1d62-42b3-82df-c225ce4e2b74 tempest-VolumesDeleteCascade-209937010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24a6bf43-0111-4a91-b333-a70a32892068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:13 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5de0e201-1d62-42b3-82df-c225ce4e2b74 tempest-VolumesDeleteCascade-209937010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24a6bf43-0111-4a91-b333-a70a32892068) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e72bbc0-9911-4094-b13d-d503bac50acf', 'volume_name': 'volume-8e72bbc0-9911-4094-b13d-d503bac50acf', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:13 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5de0e201-1d62-42b3-82df-c225ce4e2b74 tempest-VolumesDeleteCascade-209937010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13edf316-9a2b-4875-a845-4a97d5560ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:13 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5de0e201-1d62-42b3-82df-c225ce4e2b74 tempest-VolumesDeleteCascade-209937010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13edf316-9a2b-4875-a845-4a97d5560ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:13 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5de0e201-1d62-42b3-82df-c225ce4e2b74 tempest-VolumesDeleteCascade-209937010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77b93fc3-9629-4873-9b1b-7c85d1ee1dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:13 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-5de0e201-1d62-42b3-82df-c225ce4e2b74 tempest-VolumesDeleteCascade-209937010 None] Volume 8e72bbc0-9911-4094-b13d-d503bac50acf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e72bbc0-9911-4094-b13d-d503bac50acf', 'volume_size': 1} Aug 05 10:23:13 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5de0e201-1d62-42b3-82df-c225ce4e2b74 tempest-VolumesDeleteCascade-209937010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:23:13 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5de0e201-1d62-42b3-82df-c225ce4e2b74 tempest-VolumesDeleteCascade-209937010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:23:13 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-5de0e201-1d62-42b3-82df-c225ce4e2b74 tempest-VolumesDeleteCascade-209937010 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:23:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-327031430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e72bbc0-9911-4094-b13d-d503bac50acf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5eb090a71f14c278530d309ba2d85ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:23:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:23:13Z,use_quota=True,user_id='bee3dc2926dc4e56acaa771d12c6ad8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:23:13 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-5de0e201-1d62-42b3-82df-c225ce4e2b74 tempest-VolumesDeleteCascade-209937010 None] Creating volume 8e72bbc0-9911-4094-b13d-d503bac50acf {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:23:13 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5de0e201-1d62-42b3-82df-c225ce4e2b74 tempest-VolumesDeleteCascade-209937010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:23:13 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5de0e201-1d62-42b3-82df-c225ce4e2b74 tempest-VolumesDeleteCascade-209937010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:23:13 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-5de0e201-1d62-42b3-82df-c225ce4e2b74 tempest-VolumesDeleteCascade-209937010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:23:13 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-5de0e201-1d62-42b3-82df-c225ce4e2b74 tempest-VolumesDeleteCascade-209937010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:23:13 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5de0e201-1d62-42b3-82df-c225ce4e2b74 tempest-VolumesDeleteCascade-209937010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:23:13 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-5de0e201-1d62-42b3-82df-c225ce4e2b74 tempest-VolumesDeleteCascade-209937010 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:23:13 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-5de0e201-1d62-42b3-82df-c225ce4e2b74 tempest-VolumesDeleteCascade-209937010 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:23:13 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5de0e201-1d62-42b3-82df-c225ce4e2b74 tempest-VolumesDeleteCascade-209937010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e72bbc0-9911-4094-b13d-d503bac50acf 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:13 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-6a61f426-3b6f-4cbf-b692-36f14ca686fd tempest-VolumesActionsTest-2123852216 None] Deleted volume successfully. Aug 05 10:23:13 devstack sudo[99825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e72bbc0-9911-4094-b13d-d503bac50acf 1073741824 Aug 05 10:23:13 devstack sudo[99825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:13 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-6a61f426-3b6f-4cbf-b692-36f14ca686fd tempest-VolumesActionsTest-2123852216 None] Lock "cinder-b27d306e-146f-437a-ba4a-00ba17f08fcc-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:23:13 devstack cinder-volume[88613]: INFO cinder.volume.manager [req-913fe7b9-2f48-4ec0-aa05-5cd07ecae8bc req-6134ac13-1e3e-49fa-b196-f68d1928c123 tempest-TestServerVolumeAttachmentScenario-18472656 None] Terminate volume connection completed successfully. Aug 05 10:23:13 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [req-913fe7b9-2f48-4ec0-aa05-5cd07ecae8bc req-6134ac13-1e3e-49fa-b196-f68d1928c123 tempest-TestServerVolumeAttachmentScenario-18472656 None] Deleting attachment 88008c37-cdfe-4a69-a6ba-a664ce846535. {{(pid=88613) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 10:23:14 devstack sudo[99825]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:14 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5de0e201-1d62-42b3-82df-c225ce4e2b74 tempest-VolumesDeleteCascade-209937010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e72bbc0-9911-4094-b13d-d503bac50acf 1073741824" returned: 0 in 0.502s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:14 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5de0e201-1d62-42b3-82df-c225ce4e2b74 tempest-VolumesDeleteCascade-209937010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e72bbc0-9911-4094-b13d-d503bac50acf {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:14 devstack sudo[99834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e72bbc0-9911-4094-b13d-d503bac50acf Aug 05 10:23:14 devstack sudo[99834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:14 devstack sudo[99834]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:14 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5de0e201-1d62-42b3-82df-c225ce4e2b74 tempest-VolumesDeleteCascade-209937010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e72bbc0-9911-4094-b13d-d503bac50acf" returned: 0 in 0.300s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:14 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-5de0e201-1d62-42b3-82df-c225ce4e2b74 tempest-VolumesDeleteCascade-209937010 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:23:14 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5de0e201-1d62-42b3-82df-c225ce4e2b74 tempest-VolumesDeleteCascade-209937010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:23:14 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5de0e201-1d62-42b3-82df-c225ce4e2b74 tempest-VolumesDeleteCascade-209937010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77b93fc3-9629-4873-9b1b-7c85d1ee1dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e72bbc0-9911-4094-b13d-d503bac50acf', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:14 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5de0e201-1d62-42b3-82df-c225ce4e2b74 tempest-VolumesDeleteCascade-209937010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81be64d6-f4c9-4edd-a793-412ad36700b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:14 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-5de0e201-1d62-42b3-82df-c225ce4e2b74 tempest-VolumesDeleteCascade-209937010 None] Volume volume-8e72bbc0-9911-4094-b13d-d503bac50acf (8e72bbc0-9911-4094-b13d-d503bac50acf): created successfully Aug 05 10:23:14 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5de0e201-1d62-42b3-82df-c225ce4e2b74 tempest-VolumesDeleteCascade-209937010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81be64d6-f4c9-4edd-a793-412ad36700b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:14 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5de0e201-1d62-42b3-82df-c225ce4e2b74 tempest-VolumesDeleteCascade-209937010 None] Flow 'volume_create_manager' (06eebc42-1e30-4d74-8a7c-3b38a016e01f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:23:14 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-5de0e201-1d62-42b3-82df-c225ce4e2b74 tempest-VolumesDeleteCascade-209937010 None] Created volume successfully. Aug 05 10:23:15 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-379bbbfd-0eb1-4d6c-8a8d-14c87fdc69fb tempest-VolumesActionsTest-1281671309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:23:15 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-379bbbfd-0eb1-4d6c-8a8d-14c87fdc69fb tempest-VolumesActionsTest-1281671309 None] Flow 'volume_create_manager' (835e8df5-6208-4ea2-9d4b-eb1f5383fc80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:23:15 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-379bbbfd-0eb1-4d6c-8a8d-14c87fdc69fb tempest-VolumesActionsTest-1281671309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2522e1a-f5fb-41c9-bc7f-26c865509849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:15 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-379bbbfd-0eb1-4d6c-8a8d-14c87fdc69fb tempest-VolumesActionsTest-1281671309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2522e1a-f5fb-41c9-bc7f-26c865509849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:23:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1817429877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d283d5e5-c1ba-4347-a851-a2086e7b0735,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59d84c17dc794fb7b0527b1d35296590',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:23:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:23:15Z,use_quota=True,user_id='31056132f57d464587cf0bbc4d7d7cf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:15 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-379bbbfd-0eb1-4d6c-8a8d-14c87fdc69fb tempest-VolumesActionsTest-1281671309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e801cfaf-9b92-49f2-a1d6-632fb0825406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:15 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-379bbbfd-0eb1-4d6c-8a8d-14c87fdc69fb tempest-VolumesActionsTest-1281671309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e801cfaf-9b92-49f2-a1d6-632fb0825406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:15 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-379bbbfd-0eb1-4d6c-8a8d-14c87fdc69fb tempest-VolumesActionsTest-1281671309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44b36541-a00a-4740-bdda-08f91694f47b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:15 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-379bbbfd-0eb1-4d6c-8a8d-14c87fdc69fb tempest-VolumesActionsTest-1281671309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44b36541-a00a-4740-bdda-08f91694f47b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd283d5e5-c1ba-4347-a851-a2086e7b0735', 'volume_name': 'volume-d283d5e5-c1ba-4347-a851-a2086e7b0735', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:15 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-379bbbfd-0eb1-4d6c-8a8d-14c87fdc69fb tempest-VolumesActionsTest-1281671309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6960810-4cf7-4891-90a1-6695cefaff19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:15 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-379bbbfd-0eb1-4d6c-8a8d-14c87fdc69fb tempest-VolumesActionsTest-1281671309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6960810-4cf7-4891-90a1-6695cefaff19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:15 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-379bbbfd-0eb1-4d6c-8a8d-14c87fdc69fb tempest-VolumesActionsTest-1281671309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad17c007-551a-4c6f-8f3d-ce4b4d547cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:15 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-379bbbfd-0eb1-4d6c-8a8d-14c87fdc69fb tempest-VolumesActionsTest-1281671309 None] Volume d283d5e5-c1ba-4347-a851-a2086e7b0735: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d283d5e5-c1ba-4347-a851-a2086e7b0735', 'volume_size': 1} Aug 05 10:23:15 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-379bbbfd-0eb1-4d6c-8a8d-14c87fdc69fb tempest-VolumesActionsTest-1281671309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:23:15 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-379bbbfd-0eb1-4d6c-8a8d-14c87fdc69fb tempest-VolumesActionsTest-1281671309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:23:15 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-379bbbfd-0eb1-4d6c-8a8d-14c87fdc69fb tempest-VolumesActionsTest-1281671309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:23:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1817429877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d283d5e5-c1ba-4347-a851-a2086e7b0735,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59d84c17dc794fb7b0527b1d35296590',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:23:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:23:15Z,use_quota=True,user_id='31056132f57d464587cf0bbc4d7d7cf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:23:15 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-379bbbfd-0eb1-4d6c-8a8d-14c87fdc69fb tempest-VolumesActionsTest-1281671309 None] Creating volume d283d5e5-c1ba-4347-a851-a2086e7b0735 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:23:15 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-379bbbfd-0eb1-4d6c-8a8d-14c87fdc69fb tempest-VolumesActionsTest-1281671309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:23:15 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-379bbbfd-0eb1-4d6c-8a8d-14c87fdc69fb tempest-VolumesActionsTest-1281671309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:23:15 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-379bbbfd-0eb1-4d6c-8a8d-14c87fdc69fb tempest-VolumesActionsTest-1281671309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:23:15 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-379bbbfd-0eb1-4d6c-8a8d-14c87fdc69fb tempest-VolumesActionsTest-1281671309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:23:15 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-379bbbfd-0eb1-4d6c-8a8d-14c87fdc69fb tempest-VolumesActionsTest-1281671309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:23:15 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-379bbbfd-0eb1-4d6c-8a8d-14c87fdc69fb tempest-VolumesActionsTest-1281671309 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:23:15 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-379bbbfd-0eb1-4d6c-8a8d-14c87fdc69fb tempest-VolumesActionsTest-1281671309 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:23:15 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-379bbbfd-0eb1-4d6c-8a8d-14c87fdc69fb tempest-VolumesActionsTest-1281671309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d283d5e5-c1ba-4347-a851-a2086e7b0735 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:15 devstack sudo[99837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d283d5e5-c1ba-4347-a851-a2086e7b0735 1073741824 Aug 05 10:23:15 devstack sudo[99837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:15 devstack sudo[99837]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:15 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-379bbbfd-0eb1-4d6c-8a8d-14c87fdc69fb tempest-VolumesActionsTest-1281671309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d283d5e5-c1ba-4347-a851-a2086e7b0735 1073741824" returned: 0 in 0.552s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:15 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-379bbbfd-0eb1-4d6c-8a8d-14c87fdc69fb tempest-VolumesActionsTest-1281671309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d283d5e5-c1ba-4347-a851-a2086e7b0735 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:15 devstack sudo[99846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d283d5e5-c1ba-4347-a851-a2086e7b0735 Aug 05 10:23:15 devstack sudo[99846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:15 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-830f6b42-6d47-48f9-b9d1-5122983ee9fd tempest-VolumesDeleteCascade-209937010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:23:16 devstack sudo[99846]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:16 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-379bbbfd-0eb1-4d6c-8a8d-14c87fdc69fb tempest-VolumesActionsTest-1281671309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d283d5e5-c1ba-4347-a851-a2086e7b0735" returned: 0 in 0.318s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:16 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-379bbbfd-0eb1-4d6c-8a8d-14c87fdc69fb tempest-VolumesActionsTest-1281671309 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:23:16 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-379bbbfd-0eb1-4d6c-8a8d-14c87fdc69fb tempest-VolumesActionsTest-1281671309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:23:16 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-830f6b42-6d47-48f9-b9d1-5122983ee9fd tempest-VolumesDeleteCascade-209937010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.262s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:23:16 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-379bbbfd-0eb1-4d6c-8a8d-14c87fdc69fb tempest-VolumesActionsTest-1281671309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad17c007-551a-4c6f-8f3d-ce4b4d547cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d283d5e5-c1ba-4347-a851-a2086e7b0735', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:16 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-379bbbfd-0eb1-4d6c-8a8d-14c87fdc69fb tempest-VolumesActionsTest-1281671309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5efec9f-17d5-4416-abd2-69cc10d0341f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:16 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-830f6b42-6d47-48f9-b9d1-5122983ee9fd tempest-VolumesDeleteCascade-209937010 None] Creating offline snapshot 9a635dde-0983-4da8-b3d9-46c162ba021a of volume 8e72bbc0-9911-4094-b13d-d503bac50acf {{(pid=88613) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:23:16 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-379bbbfd-0eb1-4d6c-8a8d-14c87fdc69fb tempest-VolumesActionsTest-1281671309 None] Volume volume-d283d5e5-c1ba-4347-a851-a2086e7b0735 (d283d5e5-c1ba-4347-a851-a2086e7b0735): created successfully Aug 05 10:23:16 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-379bbbfd-0eb1-4d6c-8a8d-14c87fdc69fb tempest-VolumesActionsTest-1281671309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5efec9f-17d5-4416-abd2-69cc10d0341f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:16 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-379bbbfd-0eb1-4d6c-8a8d-14c87fdc69fb tempest-VolumesActionsTest-1281671309 None] Flow 'volume_create_manager' (835e8df5-6208-4ea2-9d4b-eb1f5383fc80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:23:16 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[30afe71f-5267-4c79-b246-338fec558660]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:23:16 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-830f6b42-6d47-48f9-b9d1-5122983ee9fd tempest-VolumesDeleteCascade-209937010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e72bbc0-9911-4094-b13d-d503bac50acf {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:16 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-379bbbfd-0eb1-4d6c-8a8d-14c87fdc69fb tempest-VolumesActionsTest-1281671309 None] Created volume successfully. Aug 05 10:23:16 devstack sudo[99878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e72bbc0-9911-4094-b13d-d503bac50acf Aug 05 10:23:16 devstack sudo[99878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:16 devstack cinder-volume[88613]: INFO cinder.volume.manager [req-367a85ab-a019-4252-a275-b45a098b4167 req-0d75eb85-e477-4e66-a022-f290e9369eea tempest-TestServerVolumeAttachmentScenario-18472656 None] Terminate volume connection completed successfully. Aug 05 10:23:16 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [req-367a85ab-a019-4252-a275-b45a098b4167 req-0d75eb85-e477-4e66-a022-f290e9369eea tempest-TestServerVolumeAttachmentScenario-18472656 None] Deleting attachment 74e912b1-8f47-449f-bf96-89c398585b8d. {{(pid=88613) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 10:23:16 devstack sudo[99878]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:16 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-830f6b42-6d47-48f9-b9d1-5122983ee9fd tempest-VolumesDeleteCascade-209937010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e72bbc0-9911-4094-b13d-d503bac50acf" returned: 0 in 0.455s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:16 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-830f6b42-6d47-48f9-b9d1-5122983ee9fd tempest-VolumesDeleteCascade-209937010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e72bbc0-9911-4094-b13d-d503bac50acf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e72bbc0-9911-4094-b13d-d503bac50acf.9a635dde-0983-4da8-b3d9-46c162ba021a 1G {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:16 devstack sudo[99883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e72bbc0-9911-4094-b13d-d503bac50acf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e72bbc0-9911-4094-b13d-d503bac50acf.9a635dde-0983-4da8-b3d9-46c162ba021a 1G Aug 05 10:23:16 devstack sudo[99883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:17 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-ece0766f-76c1-48af-af3c-9e1fd51b880d tempest-VolumesTransfersV357Test-1986616456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:23:17 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ece0766f-76c1-48af-af3c-9e1fd51b880d tempest-VolumesTransfersV357Test-1986616456 None] Flow 'volume_create_manager' (d71fbd64-ab05-4e33-9b53-a2253ada1f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:23:17 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ece0766f-76c1-48af-af3c-9e1fd51b880d tempest-VolumesTransfersV357Test-1986616456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db3efdce-fc9a-4e81-972f-6cca88bd3879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:17 devstack sudo[99883]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-830f6b42-6d47-48f9-b9d1-5122983ee9fd tempest-VolumesDeleteCascade-209937010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e72bbc0-9911-4094-b13d-d503bac50acf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e72bbc0-9911-4094-b13d-d503bac50acf.9a635dde-0983-4da8-b3d9-46c162ba021a 1G" returned: 0 in 0.461s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-830f6b42-6d47-48f9-b9d1-5122983ee9fd tempest-VolumesDeleteCascade-209937010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e72bbc0-9911-4094-b13d-d503bac50acf -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e72bbc0-9911-4094-b13d-d503bac50acf.9a635dde-0983-4da8-b3d9-46c162ba021a {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:17 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ece0766f-76c1-48af-af3c-9e1fd51b880d tempest-VolumesTransfersV357Test-1986616456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db3efdce-fc9a-4e81-972f-6cca88bd3879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:23:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1438873983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb4e7b64-8d44-442e-a9c8-a1210df8c190,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a87a07b8e6df43a4950ae1a68b77311f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:23:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:23:17Z,use_quota=True,user_id='594ffed48d694e61b71f66aecf1f5d33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:17 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ece0766f-76c1-48af-af3c-9e1fd51b880d tempest-VolumesTransfersV357Test-1986616456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03e91f92-d125-48cf-bae5-08f0bd6a7d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:17 devstack sudo[99889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e72bbc0-9911-4094-b13d-d503bac50acf -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e72bbc0-9911-4094-b13d-d503bac50acf.9a635dde-0983-4da8-b3d9-46c162ba021a Aug 05 10:23:17 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ece0766f-76c1-48af-af3c-9e1fd51b880d tempest-VolumesTransfersV357Test-1986616456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03e91f92-d125-48cf-bae5-08f0bd6a7d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:17 devstack sudo[99889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:17 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ece0766f-76c1-48af-af3c-9e1fd51b880d tempest-VolumesTransfersV357Test-1986616456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2c50e78-70b5-465f-854b-ff7c1bd26512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:17 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ece0766f-76c1-48af-af3c-9e1fd51b880d tempest-VolumesTransfersV357Test-1986616456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2c50e78-70b5-465f-854b-ff7c1bd26512) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb4e7b64-8d44-442e-a9c8-a1210df8c190', 'volume_name': 'volume-cb4e7b64-8d44-442e-a9c8-a1210df8c190', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:17 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ece0766f-76c1-48af-af3c-9e1fd51b880d tempest-VolumesTransfersV357Test-1986616456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab464f7e-ddec-4e75-bbf9-49b44c55d325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:17 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ece0766f-76c1-48af-af3c-9e1fd51b880d tempest-VolumesTransfersV357Test-1986616456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab464f7e-ddec-4e75-bbf9-49b44c55d325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:17 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ece0766f-76c1-48af-af3c-9e1fd51b880d tempest-VolumesTransfersV357Test-1986616456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28a01436-e3c7-40dd-b5aa-148cfb55d9ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:17 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-ece0766f-76c1-48af-af3c-9e1fd51b880d tempest-VolumesTransfersV357Test-1986616456 None] Volume cb4e7b64-8d44-442e-a9c8-a1210df8c190: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb4e7b64-8d44-442e-a9c8-a1210df8c190', 'volume_size': 1} Aug 05 10:23:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-ece0766f-76c1-48af-af3c-9e1fd51b880d tempest-VolumesTransfersV357Test-1986616456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:23:17 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-81e1001b-ac05-4d64-835c-21a8ef69d538 tempest-VolumesActionsTest-2123852216 None] Acquiring lock "cinder-d283d5e5-c1ba-4347-a851-a2086e7b0735-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:23:17 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-81e1001b-ac05-4d64-835c-21a8ef69d538 tempest-VolumesActionsTest-2123852216 None] Lock "cinder-d283d5e5-c1ba-4347-a851-a2086e7b0735-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:23:17 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-81e1001b-ac05-4d64-835c-21a8ef69d538 tempest-VolumesActionsTest-2123852216 None] Acquiring lock "cinder-quobyte-d283d5e5-c1ba-4347-a851-a2086e7b0735" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:23:17 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-81e1001b-ac05-4d64-835c-21a8ef69d538 tempest-VolumesActionsTest-2123852216 None] Lock "cinder-quobyte-d283d5e5-c1ba-4347-a851-a2086e7b0735" acquired by "delete_volume" :: waited 0.021s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:23:17 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[195d0622-1274-43b5-810c-1338e92ab1ca]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:23:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-81e1001b-ac05-4d64-835c-21a8ef69d538 tempest-VolumesActionsTest-2123852216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d283d5e5-c1ba-4347-a851-a2086e7b0735 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:17 devstack sudo[99889]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-830f6b42-6d47-48f9-b9d1-5122983ee9fd tempest-VolumesDeleteCascade-209937010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e72bbc0-9911-4094-b13d-d503bac50acf -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e72bbc0-9911-4094-b13d-d503bac50acf.9a635dde-0983-4da8-b3d9-46c162ba021a" returned: 0 in 0.358s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:17 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-830f6b42-6d47-48f9-b9d1-5122983ee9fd tempest-VolumesDeleteCascade-209937010 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e72bbc0-9911-4094-b13d-d503bac50acf.9a635dde-0983-4da8-b3d9-46c162ba021a is being set with open permissions: ugo+rw Aug 05 10:23:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-830f6b42-6d47-48f9-b9d1-5122983ee9fd tempest-VolumesDeleteCascade-209937010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e72bbc0-9911-4094-b13d-d503bac50acf.9a635dde-0983-4da8-b3d9-46c162ba021a {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:17 devstack sudo[99895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e72bbc0-9911-4094-b13d-d503bac50acf.9a635dde-0983-4da8-b3d9-46c162ba021a Aug 05 10:23:17 devstack sudo[99895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:17 devstack sudo[99894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d283d5e5-c1ba-4347-a851-a2086e7b0735 Aug 05 10:23:17 devstack sudo[99894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:17 devstack sudo[99895]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-830f6b42-6d47-48f9-b9d1-5122983ee9fd tempest-VolumesDeleteCascade-209937010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e72bbc0-9911-4094-b13d-d503bac50acf.9a635dde-0983-4da8-b3d9-46c162ba021a" returned: 0 in 0.304s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-830f6b42-6d47-48f9-b9d1-5122983ee9fd tempest-VolumesDeleteCascade-209937010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e72bbc0-9911-4094-b13d-d503bac50acf.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:17 devstack sudo[99902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e72bbc0-9911-4094-b13d-d503bac50acf.info Aug 05 10:23:17 devstack sudo[99902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:17 devstack sudo[99894]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-81e1001b-ac05-4d64-835c-21a8ef69d538 tempest-VolumesActionsTest-2123852216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d283d5e5-c1ba-4347-a851-a2086e7b0735" returned: 0 in 0.406s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-81e1001b-ac05-4d64-835c-21a8ef69d538 tempest-VolumesActionsTest-2123852216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d283d5e5-c1ba-4347-a851-a2086e7b0735 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:17 devstack sudo[99904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d283d5e5-c1ba-4347-a851-a2086e7b0735 Aug 05 10:23:17 devstack sudo[99904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:18 devstack sudo[99902]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-830f6b42-6d47-48f9-b9d1-5122983ee9fd tempest-VolumesDeleteCascade-209937010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e72bbc0-9911-4094-b13d-d503bac50acf.info" returned: 0 in 0.300s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:18 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-830f6b42-6d47-48f9-b9d1-5122983ee9fd tempest-VolumesDeleteCascade-209937010 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e72bbc0-9911-4094-b13d-d503bac50acf.info is being set with open permissions: ugo+rw Aug 05 10:23:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-830f6b42-6d47-48f9-b9d1-5122983ee9fd tempest-VolumesDeleteCascade-209937010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e72bbc0-9911-4094-b13d-d503bac50acf.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:18 devstack sudo[99904]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-81e1001b-ac05-4d64-835c-21a8ef69d538 tempest-VolumesActionsTest-2123852216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d283d5e5-c1ba-4347-a851-a2086e7b0735" returned: 0 in 0.309s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:18 devstack sudo[99908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e72bbc0-9911-4094-b13d-d503bac50acf.info Aug 05 10:23:18 devstack sudo[99908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:18 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-81e1001b-ac05-4d64-835c-21a8ef69d538 tempest-VolumesActionsTest-2123852216 None] Lock "cinder-quobyte-d283d5e5-c1ba-4347-a851-a2086e7b0735" released by "delete_volume" :: held 0.781s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:23:18 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-81e1001b-ac05-4d64-835c-21a8ef69d538 tempest-VolumesActionsTest-2123852216 None] Created reservations ['6c72e06b-7904-49ad-bcc6-f5e18e806735', '43264956-0ccd-48d9-bbd0-853ae79fa4db', '39e0888e-cf41-4a06-9a8a-e549d8d11619', 'c1171ae5-841f-4bcc-9e2b-5677ed5af21c'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:23:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-81e1001b-ac05-4d64-835c-21a8ef69d538 tempest-VolumesActionsTest-2123852216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:23:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-81e1001b-ac05-4d64-835c-21a8ef69d538 tempest-VolumesActionsTest-2123852216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:23:18 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-81e1001b-ac05-4d64-835c-21a8ef69d538 tempest-VolumesActionsTest-2123852216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:23:18 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-81e1001b-ac05-4d64-835c-21a8ef69d538 tempest-VolumesActionsTest-2123852216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:23:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-81e1001b-ac05-4d64-835c-21a8ef69d538 tempest-VolumesActionsTest-2123852216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:23:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-81e1001b-ac05-4d64-835c-21a8ef69d538 tempest-VolumesActionsTest-2123852216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:18 devstack sudo[99913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:23:18 devstack sudo[99913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:18 devstack sudo[99908]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-830f6b42-6d47-48f9-b9d1-5122983ee9fd tempest-VolumesDeleteCascade-209937010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e72bbc0-9911-4094-b13d-d503bac50acf.info" returned: 0 in 0.320s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-830f6b42-6d47-48f9-b9d1-5122983ee9fd tempest-VolumesDeleteCascade-209937010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.337s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:23:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-ece0766f-76c1-48af-af3c-9e1fd51b880d tempest-VolumesTransfersV357Test-1986616456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.298s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:23:18 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-ece0766f-76c1-48af-af3c-9e1fd51b880d tempest-VolumesTransfersV357Test-1986616456 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:23:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1438873983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb4e7b64-8d44-442e-a9c8-a1210df8c190,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a87a07b8e6df43a4950ae1a68b77311f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:23:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:23:17Z,use_quota=True,user_id='594ffed48d694e61b71f66aecf1f5d33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:23:18 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-ece0766f-76c1-48af-af3c-9e1fd51b880d tempest-VolumesTransfersV357Test-1986616456 None] Creating volume cb4e7b64-8d44-442e-a9c8-a1210df8c190 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:23:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-ece0766f-76c1-48af-af3c-9e1fd51b880d tempest-VolumesTransfersV357Test-1986616456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:23:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-ece0766f-76c1-48af-af3c-9e1fd51b880d tempest-VolumesTransfersV357Test-1986616456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:23:18 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-ece0766f-76c1-48af-af3c-9e1fd51b880d tempest-VolumesTransfersV357Test-1986616456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:23:18 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-ece0766f-76c1-48af-af3c-9e1fd51b880d tempest-VolumesTransfersV357Test-1986616456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:23:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-ece0766f-76c1-48af-af3c-9e1fd51b880d tempest-VolumesTransfersV357Test-1986616456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:23:18 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-ece0766f-76c1-48af-af3c-9e1fd51b880d tempest-VolumesTransfersV357Test-1986616456 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:23:18 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-ece0766f-76c1-48af-af3c-9e1fd51b880d tempest-VolumesTransfersV357Test-1986616456 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:23:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ece0766f-76c1-48af-af3c-9e1fd51b880d tempest-VolumesTransfersV357Test-1986616456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-cb4e7b64-8d44-442e-a9c8-a1210df8c190 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:18 devstack sudo[99917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-cb4e7b64-8d44-442e-a9c8-a1210df8c190 1073741824 Aug 05 10:23:18 devstack sudo[99917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:18 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-830f6b42-6d47-48f9-b9d1-5122983ee9fd tempest-VolumesDeleteCascade-209937010 None] Create snapshot completed successfully Aug 05 10:23:18 devstack sudo[99913]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-81e1001b-ac05-4d64-835c-21a8ef69d538 tempest-VolumesActionsTest-2123852216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.526s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:18 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-81e1001b-ac05-4d64-835c-21a8ef69d538 tempest-VolumesActionsTest-2123852216 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:23:18 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-81e1001b-ac05-4d64-835c-21a8ef69d538 tempest-VolumesActionsTest-2123852216 None] Deleted volume successfully. Aug 05 10:23:18 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-81e1001b-ac05-4d64-835c-21a8ef69d538 tempest-VolumesActionsTest-2123852216 None] Lock "cinder-d283d5e5-c1ba-4347-a851-a2086e7b0735-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:23:19 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-12c99fe1-7104-4f93-8377-3a0dbe3ea8da tempest-VolumesActionsTest-1281671309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:23:19 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-12c99fe1-7104-4f93-8377-3a0dbe3ea8da tempest-VolumesActionsTest-1281671309 None] Flow 'volume_create_manager' (eecec7be-664e-40e6-9e67-0860705af085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:23:19 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-12c99fe1-7104-4f93-8377-3a0dbe3ea8da tempest-VolumesActionsTest-1281671309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fda25194-8838-434a-9653-655cdd280b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:19 devstack sudo[99917]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:19 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-12c99fe1-7104-4f93-8377-3a0dbe3ea8da tempest-VolumesActionsTest-1281671309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fda25194-8838-434a-9653-655cdd280b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:23:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-600702207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90fb9609-d84b-4c73-88d2-c5db3dfeae50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59d84c17dc794fb7b0527b1d35296590',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:23:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:23:19Z,use_quota=True,user_id='31056132f57d464587cf0bbc4d7d7cf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:19 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-12c99fe1-7104-4f93-8377-3a0dbe3ea8da tempest-VolumesActionsTest-1281671309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3799a10e-27e9-41af-8526-b3d7a5855935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:19 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-12c99fe1-7104-4f93-8377-3a0dbe3ea8da tempest-VolumesActionsTest-1281671309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3799a10e-27e9-41af-8526-b3d7a5855935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:19 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-12c99fe1-7104-4f93-8377-3a0dbe3ea8da tempest-VolumesActionsTest-1281671309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf5b248b-2cde-4130-bf58-2fee32a48bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:19 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-12c99fe1-7104-4f93-8377-3a0dbe3ea8da tempest-VolumesActionsTest-1281671309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf5b248b-2cde-4130-bf58-2fee32a48bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90fb9609-d84b-4c73-88d2-c5db3dfeae50', 'volume_name': 'volume-90fb9609-d84b-4c73-88d2-c5db3dfeae50', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:19 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-12c99fe1-7104-4f93-8377-3a0dbe3ea8da tempest-VolumesActionsTest-1281671309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b35c1111-bcc7-4c80-8913-7113a814c504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:19 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-12c99fe1-7104-4f93-8377-3a0dbe3ea8da tempest-VolumesActionsTest-1281671309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b35c1111-bcc7-4c80-8913-7113a814c504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:19 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-12c99fe1-7104-4f93-8377-3a0dbe3ea8da tempest-VolumesActionsTest-1281671309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4f7923a-ca89-44f3-9bb8-bbd86170e149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:19 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-12c99fe1-7104-4f93-8377-3a0dbe3ea8da tempest-VolumesActionsTest-1281671309 None] Volume 90fb9609-d84b-4c73-88d2-c5db3dfeae50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90fb9609-d84b-4c73-88d2-c5db3dfeae50', 'volume_size': 1} Aug 05 10:23:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-12c99fe1-7104-4f93-8377-3a0dbe3ea8da tempest-VolumesActionsTest-1281671309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:23:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ece0766f-76c1-48af-af3c-9e1fd51b880d tempest-VolumesTransfersV357Test-1986616456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-cb4e7b64-8d44-442e-a9c8-a1210df8c190 1073741824" returned: 0 in 0.988s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-3e60c0ea-eeb4-4e07-a48a-f59ea7bf2d8b tempest-VolumesDeleteCascade-209937010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:23:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ece0766f-76c1-48af-af3c-9e1fd51b880d tempest-VolumesTransfersV357Test-1986616456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-cb4e7b64-8d44-442e-a9c8-a1210df8c190 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:19 devstack sudo[99947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-cb4e7b64-8d44-442e-a9c8-a1210df8c190 Aug 05 10:23:19 devstack sudo[99947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:19 devstack sudo[99947]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ece0766f-76c1-48af-af3c-9e1fd51b880d tempest-VolumesTransfersV357Test-1986616456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-cb4e7b64-8d44-442e-a9c8-a1210df8c190" returned: 0 in 0.276s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:19 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-ece0766f-76c1-48af-af3c-9e1fd51b880d tempest-VolumesTransfersV357Test-1986616456 None] <== create_volume: return (1319ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:23:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-ece0766f-76c1-48af-af3c-9e1fd51b880d tempest-VolumesTransfersV357Test-1986616456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.326s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:23:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-12c99fe1-7104-4f93-8377-3a0dbe3ea8da tempest-VolumesActionsTest-1281671309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.322s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:23:19 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-12c99fe1-7104-4f93-8377-3a0dbe3ea8da tempest-VolumesActionsTest-1281671309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:23:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-600702207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90fb9609-d84b-4c73-88d2-c5db3dfeae50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59d84c17dc794fb7b0527b1d35296590',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:23:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:23:19Z,use_quota=True,user_id='31056132f57d464587cf0bbc4d7d7cf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:23:19 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-12c99fe1-7104-4f93-8377-3a0dbe3ea8da tempest-VolumesActionsTest-1281671309 None] Creating volume 90fb9609-d84b-4c73-88d2-c5db3dfeae50 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:23:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-12c99fe1-7104-4f93-8377-3a0dbe3ea8da tempest-VolumesActionsTest-1281671309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:23:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-12c99fe1-7104-4f93-8377-3a0dbe3ea8da tempest-VolumesActionsTest-1281671309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:23:19 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-12c99fe1-7104-4f93-8377-3a0dbe3ea8da tempest-VolumesActionsTest-1281671309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:23:19 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-12c99fe1-7104-4f93-8377-3a0dbe3ea8da tempest-VolumesActionsTest-1281671309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:23:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-12c99fe1-7104-4f93-8377-3a0dbe3ea8da tempest-VolumesActionsTest-1281671309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:23:19 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-12c99fe1-7104-4f93-8377-3a0dbe3ea8da tempest-VolumesActionsTest-1281671309 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:23:19 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-12c99fe1-7104-4f93-8377-3a0dbe3ea8da tempest-VolumesActionsTest-1281671309 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:23:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-12c99fe1-7104-4f93-8377-3a0dbe3ea8da tempest-VolumesActionsTest-1281671309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-90fb9609-d84b-4c73-88d2-c5db3dfeae50 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:19 devstack sudo[99951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-90fb9609-d84b-4c73-88d2-c5db3dfeae50 1073741824 Aug 05 10:23:19 devstack sudo[99951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:19 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ece0766f-76c1-48af-af3c-9e1fd51b880d tempest-VolumesTransfersV357Test-1986616456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28a01436-e3c7-40dd-b5aa-148cfb55d9ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb4e7b64-8d44-442e-a9c8-a1210df8c190', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:19 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ece0766f-76c1-48af-af3c-9e1fd51b880d tempest-VolumesTransfersV357Test-1986616456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ddbb0e8-0827-4d95-b194-41e2bc053be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:19 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-ece0766f-76c1-48af-af3c-9e1fd51b880d tempest-VolumesTransfersV357Test-1986616456 None] Volume volume-cb4e7b64-8d44-442e-a9c8-a1210df8c190 (cb4e7b64-8d44-442e-a9c8-a1210df8c190): created successfully Aug 05 10:23:19 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ece0766f-76c1-48af-af3c-9e1fd51b880d tempest-VolumesTransfersV357Test-1986616456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ddbb0e8-0827-4d95-b194-41e2bc053be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:19 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ece0766f-76c1-48af-af3c-9e1fd51b880d tempest-VolumesTransfersV357Test-1986616456 None] Flow 'volume_create_manager' (d71fbd64-ab05-4e33-9b53-a2253ada1f80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:23:19 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-ece0766f-76c1-48af-af3c-9e1fd51b880d tempest-VolumesTransfersV357Test-1986616456 None] Created volume successfully. Aug 05 10:23:20 devstack sudo[99951]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-12c99fe1-7104-4f93-8377-3a0dbe3ea8da tempest-VolumesActionsTest-1281671309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-90fb9609-d84b-4c73-88d2-c5db3dfeae50 1073741824" returned: 0 in 0.564s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-12c99fe1-7104-4f93-8377-3a0dbe3ea8da tempest-VolumesActionsTest-1281671309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-90fb9609-d84b-4c73-88d2-c5db3dfeae50 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:20 devstack sudo[99958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-90fb9609-d84b-4c73-88d2-c5db3dfeae50 Aug 05 10:23:20 devstack sudo[99958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:20 devstack sudo[99958]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-12c99fe1-7104-4f93-8377-3a0dbe3ea8da tempest-VolumesActionsTest-1281671309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-90fb9609-d84b-4c73-88d2-c5db3dfeae50" returned: 0 in 0.329s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:20 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-12c99fe1-7104-4f93-8377-3a0dbe3ea8da tempest-VolumesActionsTest-1281671309 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:23:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-12c99fe1-7104-4f93-8377-3a0dbe3ea8da tempest-VolumesActionsTest-1281671309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:23:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-3e60c0ea-eeb4-4e07-a48a-f59ea7bf2d8b tempest-VolumesDeleteCascade-209937010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.278s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:23:20 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-12c99fe1-7104-4f93-8377-3a0dbe3ea8da tempest-VolumesActionsTest-1281671309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4f7923a-ca89-44f3-9bb8-bbd86170e149) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90fb9609-d84b-4c73-88d2-c5db3dfeae50', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:20 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-12c99fe1-7104-4f93-8377-3a0dbe3ea8da tempest-VolumesActionsTest-1281671309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baad9065-0ed1-4571-99dc-82efee3687e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:20 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-3e60c0ea-eeb4-4e07-a48a-f59ea7bf2d8b tempest-VolumesDeleteCascade-209937010 None] Creating offline snapshot 004ac049-5b90-4a3b-9d72-995bfc6455fb of volume 8e72bbc0-9911-4094-b13d-d503bac50acf {{(pid=88613) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:23:20 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-12c99fe1-7104-4f93-8377-3a0dbe3ea8da tempest-VolumesActionsTest-1281671309 None] Volume volume-90fb9609-d84b-4c73-88d2-c5db3dfeae50 (90fb9609-d84b-4c73-88d2-c5db3dfeae50): created successfully Aug 05 10:23:20 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-12c99fe1-7104-4f93-8377-3a0dbe3ea8da tempest-VolumesActionsTest-1281671309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baad9065-0ed1-4571-99dc-82efee3687e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:20 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-12c99fe1-7104-4f93-8377-3a0dbe3ea8da tempest-VolumesActionsTest-1281671309 None] Flow 'volume_create_manager' (eecec7be-664e-40e6-9e67-0860705af085) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:23:20 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0db17b1-4067-4a1f-98f2-44a4763c3fce]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:23:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3e60c0ea-eeb4-4e07-a48a-f59ea7bf2d8b tempest-VolumesDeleteCascade-209937010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e72bbc0-9911-4094-b13d-d503bac50acf.9a635dde-0983-4da8-b3d9-46c162ba021a {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:20 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-12c99fe1-7104-4f93-8377-3a0dbe3ea8da tempest-VolumesActionsTest-1281671309 None] Created volume successfully. Aug 05 10:23:20 devstack sudo[99962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e72bbc0-9911-4094-b13d-d503bac50acf.9a635dde-0983-4da8-b3d9-46c162ba021a Aug 05 10:23:20 devstack sudo[99962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:21 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-0f3efdcd-1fc3-400d-881f-69866276954a tempest-VolumesTransfersV357Test-787169781 None] Transfer volume completed successfully. Aug 05 10:23:21 devstack sudo[99962]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3e60c0ea-eeb4-4e07-a48a-f59ea7bf2d8b tempest-VolumesDeleteCascade-209937010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e72bbc0-9911-4094-b13d-d503bac50acf.9a635dde-0983-4da8-b3d9-46c162ba021a" returned: 0 in 0.483s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:21 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-3e60c0ea-eeb4-4e07-a48a-f59ea7bf2d8b tempest-VolumesDeleteCascade-209937010 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e72bbc0-9911-4094-b13d-d503bac50acf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88613) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:23:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3e60c0ea-eeb4-4e07-a48a-f59ea7bf2d8b tempest-VolumesDeleteCascade-209937010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e72bbc0-9911-4094-b13d-d503bac50acf.9a635dde-0983-4da8-b3d9-46c162ba021a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e72bbc0-9911-4094-b13d-d503bac50acf.004ac049-5b90-4a3b-9d72-995bfc6455fb 1G {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:21 devstack sudo[99967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e72bbc0-9911-4094-b13d-d503bac50acf.9a635dde-0983-4da8-b3d9-46c162ba021a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e72bbc0-9911-4094-b13d-d503bac50acf.004ac049-5b90-4a3b-9d72-995bfc6455fb 1G Aug 05 10:23:21 devstack sudo[99967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:21 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-ffe6baf8-84e2-43d8-80cb-f794916583d6 tempest-VolumesActionsTest-2123852216 None] Acquiring lock "cinder-90fb9609-d84b-4c73-88d2-c5db3dfeae50-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:23:21 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-ffe6baf8-84e2-43d8-80cb-f794916583d6 tempest-VolumesActionsTest-2123852216 None] Lock "cinder-90fb9609-d84b-4c73-88d2-c5db3dfeae50-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:23:21 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-ffe6baf8-84e2-43d8-80cb-f794916583d6 tempest-VolumesActionsTest-2123852216 None] Acquiring lock "cinder-quobyte-90fb9609-d84b-4c73-88d2-c5db3dfeae50" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:23:21 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-ffe6baf8-84e2-43d8-80cb-f794916583d6 tempest-VolumesActionsTest-2123852216 None] Lock "cinder-quobyte-90fb9609-d84b-4c73-88d2-c5db3dfeae50" acquired by "delete_volume" :: waited 0.019s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:23:21 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[47afeaa1-02b1-4e10-a1c1-c65b5783debc]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:23:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ffe6baf8-84e2-43d8-80cb-f794916583d6 tempest-VolumesActionsTest-2123852216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-90fb9609-d84b-4c73-88d2-c5db3dfeae50 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:21 devstack cinder-volume[88613]: DEBUG oslo_service.periodic_task [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88613) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:23:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:23:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:23:21 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:23:21 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:23:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:23:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:21 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-28c7953f-fffe-41a4-bff3-10d3f49a8504 tempest-VolumesTransfersV357Test-881422573 None] Acquiring lock "cinder-cb4e7b64-8d44-442e-a9c8-a1210df8c190-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:23:21 devstack sudo[99974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:23:21 devstack sudo[99974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:21 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-28c7953f-fffe-41a4-bff3-10d3f49a8504 tempest-VolumesTransfersV357Test-881422573 None] Lock "cinder-cb4e7b64-8d44-442e-a9c8-a1210df8c190-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:23:21 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-28c7953f-fffe-41a4-bff3-10d3f49a8504 tempest-VolumesTransfersV357Test-881422573 None] Acquiring lock "cinder-quobyte-cb4e7b64-8d44-442e-a9c8-a1210df8c190" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:23:21 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-28c7953f-fffe-41a4-bff3-10d3f49a8504 tempest-VolumesTransfersV357Test-881422573 None] Lock "cinder-quobyte-cb4e7b64-8d44-442e-a9c8-a1210df8c190" acquired by "delete_volume" :: waited 0.030s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:23:21 devstack sudo[99973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-90fb9609-d84b-4c73-88d2-c5db3dfeae50 Aug 05 10:23:21 devstack sudo[99973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:21 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd187fb-59d6-43cf-9bc5-43c13ed18557]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:23:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-28c7953f-fffe-41a4-bff3-10d3f49a8504 tempest-VolumesTransfersV357Test-881422573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-cb4e7b64-8d44-442e-a9c8-a1210df8c190 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:21 devstack sudo[99967]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3e60c0ea-eeb4-4e07-a48a-f59ea7bf2d8b tempest-VolumesDeleteCascade-209937010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e72bbc0-9911-4094-b13d-d503bac50acf.9a635dde-0983-4da8-b3d9-46c162ba021a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e72bbc0-9911-4094-b13d-d503bac50acf.004ac049-5b90-4a3b-9d72-995bfc6455fb 1G" returned: 0 in 0.656s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3e60c0ea-eeb4-4e07-a48a-f59ea7bf2d8b tempest-VolumesDeleteCascade-209937010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e72bbc0-9911-4094-b13d-d503bac50acf.9a635dde-0983-4da8-b3d9-46c162ba021a -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e72bbc0-9911-4094-b13d-d503bac50acf.004ac049-5b90-4a3b-9d72-995bfc6455fb {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:22 devstack sudo[99978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e72bbc0-9911-4094-b13d-d503bac50acf.9a635dde-0983-4da8-b3d9-46c162ba021a -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e72bbc0-9911-4094-b13d-d503bac50acf.004ac049-5b90-4a3b-9d72-995bfc6455fb Aug 05 10:23:22 devstack sudo[99978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:22 devstack sudo[99977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-cb4e7b64-8d44-442e-a9c8-a1210df8c190 Aug 05 10:23:22 devstack sudo[99977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:22 devstack sudo[99974]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.407s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:22 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:23:22 devstack cinder-volume[88613]: DEBUG oslo_service.periodic_task [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Running periodic task VolumeManager._thread_info {{(pid=88613) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:23:22 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] thread count: 28 {{(pid=88613) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 10:23:22 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] thread info: [<_MainThread(MainThread, started 126173666128000)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88613) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 10:23:22 devstack sudo[99973]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ffe6baf8-84e2-43d8-80cb-f794916583d6 tempest-VolumesActionsTest-2123852216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-90fb9609-d84b-4c73-88d2-c5db3dfeae50" returned: 0 in 0.498s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ffe6baf8-84e2-43d8-80cb-f794916583d6 tempest-VolumesActionsTest-2123852216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-90fb9609-d84b-4c73-88d2-c5db3dfeae50 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:22 devstack sudo[99985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-90fb9609-d84b-4c73-88d2-c5db3dfeae50 Aug 05 10:23:22 devstack sudo[99985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:22 devstack sudo[99977]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:22 devstack sudo[99978]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-28c7953f-fffe-41a4-bff3-10d3f49a8504 tempest-VolumesTransfersV357Test-881422573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-cb4e7b64-8d44-442e-a9c8-a1210df8c190" returned: 0 in 0.532s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-28c7953f-fffe-41a4-bff3-10d3f49a8504 tempest-VolumesTransfersV357Test-881422573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-cb4e7b64-8d44-442e-a9c8-a1210df8c190 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3e60c0ea-eeb4-4e07-a48a-f59ea7bf2d8b tempest-VolumesDeleteCascade-209937010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e72bbc0-9911-4094-b13d-d503bac50acf.9a635dde-0983-4da8-b3d9-46c162ba021a -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e72bbc0-9911-4094-b13d-d503bac50acf.004ac049-5b90-4a3b-9d72-995bfc6455fb" returned: 0 in 0.490s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:22 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-3e60c0ea-eeb4-4e07-a48a-f59ea7bf2d8b tempest-VolumesDeleteCascade-209937010 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e72bbc0-9911-4094-b13d-d503bac50acf.004ac049-5b90-4a3b-9d72-995bfc6455fb is being set with open permissions: ugo+rw Aug 05 10:23:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3e60c0ea-eeb4-4e07-a48a-f59ea7bf2d8b tempest-VolumesDeleteCascade-209937010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e72bbc0-9911-4094-b13d-d503bac50acf.004ac049-5b90-4a3b-9d72-995bfc6455fb {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:22 devstack sudo[99994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-cb4e7b64-8d44-442e-a9c8-a1210df8c190 Aug 05 10:23:22 devstack sudo[99994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:22 devstack sudo[99995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e72bbc0-9911-4094-b13d-d503bac50acf.004ac049-5b90-4a3b-9d72-995bfc6455fb Aug 05 10:23:22 devstack sudo[99995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:22 devstack sudo[99985]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ffe6baf8-84e2-43d8-80cb-f794916583d6 tempest-VolumesActionsTest-2123852216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-90fb9609-d84b-4c73-88d2-c5db3dfeae50" returned: 0 in 0.374s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:22 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-ffe6baf8-84e2-43d8-80cb-f794916583d6 tempest-VolumesActionsTest-2123852216 None] Lock "cinder-quobyte-90fb9609-d84b-4c73-88d2-c5db3dfeae50" released by "delete_volume" :: held 0.927s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:23:22 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-ffe6baf8-84e2-43d8-80cb-f794916583d6 tempest-VolumesActionsTest-2123852216 None] Created reservations ['2657f69b-5da6-407a-b59d-fade53280915', '927bc7b8-2df6-4bb4-b83b-62fc5768bace', '49f47836-d3c0-4e76-acdf-19fbd692508a', '2f1e73be-de74-40f6-87e3-ebb1a5f1fba0'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:23:22 devstack sudo[99995]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:22 devstack sudo[99994]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3e60c0ea-eeb4-4e07-a48a-f59ea7bf2d8b tempest-VolumesDeleteCascade-209937010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e72bbc0-9911-4094-b13d-d503bac50acf.004ac049-5b90-4a3b-9d72-995bfc6455fb" returned: 0 in 0.282s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-28c7953f-fffe-41a4-bff3-10d3f49a8504 tempest-VolumesTransfersV357Test-881422573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-cb4e7b64-8d44-442e-a9c8-a1210df8c190" returned: 0 in 0.305s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:22 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-28c7953f-fffe-41a4-bff3-10d3f49a8504 tempest-VolumesTransfersV357Test-881422573 None] Lock "cinder-quobyte-cb4e7b64-8d44-442e-a9c8-a1210df8c190" released by "delete_volume" :: held 0.900s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:23:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-3e60c0ea-eeb4-4e07-a48a-f59ea7bf2d8b tempest-VolumesDeleteCascade-209937010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.079s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:23:22 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-3e60c0ea-eeb4-4e07-a48a-f59ea7bf2d8b tempest-VolumesDeleteCascade-209937010 None] Create snapshot completed successfully Aug 05 10:23:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-ffe6baf8-84e2-43d8-80cb-f794916583d6 tempest-VolumesActionsTest-2123852216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:23:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-ffe6baf8-84e2-43d8-80cb-f794916583d6 tempest-VolumesActionsTest-2123852216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:23:22 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-ffe6baf8-84e2-43d8-80cb-f794916583d6 tempest-VolumesActionsTest-2123852216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:23:22 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-ffe6baf8-84e2-43d8-80cb-f794916583d6 tempest-VolumesActionsTest-2123852216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:23:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-ffe6baf8-84e2-43d8-80cb-f794916583d6 tempest-VolumesActionsTest-2123852216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:23:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ffe6baf8-84e2-43d8-80cb-f794916583d6 tempest-VolumesActionsTest-2123852216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:22 devstack sudo[100001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:23:22 devstack sudo[100001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:22 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-28c7953f-fffe-41a4-bff3-10d3f49a8504 tempest-VolumesTransfersV357Test-881422573 None] Created reservations ['cb477add-4613-44f4-b01e-384504f5372b', 'f442d30a-5d85-4c63-a6b1-302fbe4c5261', '25d377a0-7e55-4bb6-bcf0-0f37e687e98c', '2a302d81-152a-4b26-a91c-b1c876882b5f'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:23:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-28c7953f-fffe-41a4-bff3-10d3f49a8504 tempest-VolumesTransfersV357Test-881422573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:23:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-28c7953f-fffe-41a4-bff3-10d3f49a8504 tempest-VolumesTransfersV357Test-881422573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:23:22 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-28c7953f-fffe-41a4-bff3-10d3f49a8504 tempest-VolumesTransfersV357Test-881422573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:23:22 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-28c7953f-fffe-41a4-bff3-10d3f49a8504 tempest-VolumesTransfersV357Test-881422573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:23:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-28c7953f-fffe-41a4-bff3-10d3f49a8504 tempest-VolumesTransfersV357Test-881422573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:23:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-28c7953f-fffe-41a4-bff3-10d3f49a8504 tempest-VolumesTransfersV357Test-881422573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:23 devstack sudo[100003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:23:23 devstack sudo[100003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:23 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e5b99d6d-a498-4d7a-a26c-20e7953252c8 tempest-TestServerVolumeAttachmentScenario-18472656 None] Acquiring lock "cinder-b7a3359b-2c8e-4495-a87b-42cc222a17dc-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:23:23 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e5b99d6d-a498-4d7a-a26c-20e7953252c8 tempest-TestServerVolumeAttachmentScenario-18472656 None] Lock "cinder-b7a3359b-2c8e-4495-a87b-42cc222a17dc-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:23:23 devstack sudo[100001]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ffe6baf8-84e2-43d8-80cb-f794916583d6 tempest-VolumesActionsTest-2123852216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.315s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:23 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-ffe6baf8-84e2-43d8-80cb-f794916583d6 tempest-VolumesActionsTest-2123852216 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:23:23 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-ffe6baf8-84e2-43d8-80cb-f794916583d6 tempest-VolumesActionsTest-2123852216 None] Deleted volume successfully. Aug 05 10:23:23 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e5b99d6d-a498-4d7a-a26c-20e7953252c8 tempest-TestServerVolumeAttachmentScenario-18472656 None] Acquiring lock "cinder-quobyte-b7a3359b-2c8e-4495-a87b-42cc222a17dc" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:23:23 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e5b99d6d-a498-4d7a-a26c-20e7953252c8 tempest-TestServerVolumeAttachmentScenario-18472656 None] Lock "cinder-quobyte-b7a3359b-2c8e-4495-a87b-42cc222a17dc" acquired by "delete_volume" :: waited 0.020s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:23:23 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-ffe6baf8-84e2-43d8-80cb-f794916583d6 tempest-VolumesActionsTest-2123852216 None] Lock "cinder-90fb9609-d84b-4c73-88d2-c5db3dfeae50-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:23:23 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc610ed2-f84d-4bde-9e7f-b1a4c1eefd75]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:23:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e5b99d6d-a498-4d7a-a26c-20e7953252c8 tempest-TestServerVolumeAttachmentScenario-18472656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-b7a3359b-2c8e-4495-a87b-42cc222a17dc {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:23 devstack sudo[100003]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-28c7953f-fffe-41a4-bff3-10d3f49a8504 tempest-VolumesTransfersV357Test-881422573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.272s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:23 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-28c7953f-fffe-41a4-bff3-10d3f49a8504 tempest-VolumesTransfersV357Test-881422573 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:23:23 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-28c7953f-fffe-41a4-bff3-10d3f49a8504 tempest-VolumesTransfersV357Test-881422573 None] Deleted volume successfully. Aug 05 10:23:23 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-28c7953f-fffe-41a4-bff3-10d3f49a8504 tempest-VolumesTransfersV357Test-881422573 None] Lock "cinder-cb4e7b64-8d44-442e-a9c8-a1210df8c190-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:23:23 devstack sudo[100007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-b7a3359b-2c8e-4495-a87b-42cc222a17dc Aug 05 10:23:23 devstack sudo[100007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:23 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d4203e22-dad9-4109-9e41-a3a4438eae1a tempest-VolumesDeleteCascade-209937010 None] Acquiring lock "cinder-8e72bbc0-9911-4094-b13d-d503bac50acf-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:23:23 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d4203e22-dad9-4109-9e41-a3a4438eae1a tempest-VolumesDeleteCascade-209937010 None] Lock "cinder-8e72bbc0-9911-4094-b13d-d503bac50acf-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:23:23 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d4203e22-dad9-4109-9e41-a3a4438eae1a tempest-VolumesDeleteCascade-209937010 None] Performing cascade delete. {{(pid=88613) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Aug 05 10:23:23 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d4203e22-dad9-4109-9e41-a3a4438eae1a tempest-VolumesDeleteCascade-209937010 None] Acquiring lock "cinder-004ac049-5b90-4a3b-9d72-995bfc6455fb-delete_snapshot" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:23:23 devstack sudo[100007]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e5b99d6d-a498-4d7a-a26c-20e7953252c8 tempest-TestServerVolumeAttachmentScenario-18472656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-b7a3359b-2c8e-4495-a87b-42cc222a17dc" returned: 0 in 0.403s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e5b99d6d-a498-4d7a-a26c-20e7953252c8 tempest-TestServerVolumeAttachmentScenario-18472656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-b7a3359b-2c8e-4495-a87b-42cc222a17dc {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:23 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d4203e22-dad9-4109-9e41-a3a4438eae1a tempest-VolumesDeleteCascade-209937010 None] Lock "cinder-004ac049-5b90-4a3b-9d72-995bfc6455fb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:23:23 devstack sudo[100012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-b7a3359b-2c8e-4495-a87b-42cc222a17dc Aug 05 10:23:23 devstack sudo[100012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:23 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d4203e22-dad9-4109-9e41-a3a4438eae1a tempest-VolumesDeleteCascade-209937010 None] Acquiring lock "cinder-quobyte-8e72bbc0-9911-4094-b13d-d503bac50acf" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:23:23 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d4203e22-dad9-4109-9e41-a3a4438eae1a tempest-VolumesDeleteCascade-209937010 None] Lock "cinder-quobyte-8e72bbc0-9911-4094-b13d-d503bac50acf" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:23:23 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d4203e22-dad9-4109-9e41-a3a4438eae1a tempest-VolumesDeleteCascade-209937010 None] Acquiring lock "cinder-quobyte-004ac049-5b90-4a3b-9d72-995bfc6455fb" by "_delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:23:23 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d4203e22-dad9-4109-9e41-a3a4438eae1a tempest-VolumesDeleteCascade-209937010 None] Lock "cinder-quobyte-004ac049-5b90-4a3b-9d72-995bfc6455fb" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:23:23 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-d4203e22-dad9-4109-9e41-a3a4438eae1a tempest-VolumesDeleteCascade-209937010 None] Deleting offline snapshot 004ac049-5b90-4a3b-9d72-995bfc6455fb of volume 8e72bbc0-9911-4094-b13d-d503bac50acf {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:23:23 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-d4203e22-dad9-4109-9e41-a3a4438eae1a tempest-VolumesDeleteCascade-209937010 None] snapshot_file for this snap is: volume-8e72bbc0-9911-4094-b13d-d503bac50acf.004ac049-5b90-4a3b-9d72-995bfc6455fb {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:23:23 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[2665c30e-0a03-410d-b631-c0db91f8901c]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:23:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d4203e22-dad9-4109-9e41-a3a4438eae1a tempest-VolumesDeleteCascade-209937010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e72bbc0-9911-4094-b13d-d503bac50acf.004ac049-5b90-4a3b-9d72-995bfc6455fb {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:23 devstack sudo[100014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e72bbc0-9911-4094-b13d-d503bac50acf.004ac049-5b90-4a3b-9d72-995bfc6455fb Aug 05 10:23:23 devstack sudo[100014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:23 devstack sudo[100012]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e5b99d6d-a498-4d7a-a26c-20e7953252c8 tempest-TestServerVolumeAttachmentScenario-18472656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-b7a3359b-2c8e-4495-a87b-42cc222a17dc" returned: 0 in 0.261s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:23 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e5b99d6d-a498-4d7a-a26c-20e7953252c8 tempest-TestServerVolumeAttachmentScenario-18472656 None] Lock "cinder-quobyte-b7a3359b-2c8e-4495-a87b-42cc222a17dc" released by "delete_volume" :: held 0.708s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:23:24 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-e5b99d6d-a498-4d7a-a26c-20e7953252c8 tempest-TestServerVolumeAttachmentScenario-18472656 None] Created reservations ['72c78e54-88a9-4c4d-9e75-6aaabe75e920', '2193ed69-4ff8-4ed9-ba58-1082733d55b4', '6265f7b2-7db7-4644-bc2a-05f2f45343e3', 'b98c9e23-2877-4833-bb11-942884cff0fc'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:23:24 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-e5b99d6d-a498-4d7a-a26c-20e7953252c8 tempest-TestServerVolumeAttachmentScenario-18472656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:23:24 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-e5b99d6d-a498-4d7a-a26c-20e7953252c8 tempest-TestServerVolumeAttachmentScenario-18472656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:23:24 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-e5b99d6d-a498-4d7a-a26c-20e7953252c8 tempest-TestServerVolumeAttachmentScenario-18472656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:23:24 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-e5b99d6d-a498-4d7a-a26c-20e7953252c8 tempest-TestServerVolumeAttachmentScenario-18472656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:23:24 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-e5b99d6d-a498-4d7a-a26c-20e7953252c8 tempest-TestServerVolumeAttachmentScenario-18472656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:23:24 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e5b99d6d-a498-4d7a-a26c-20e7953252c8 tempest-TestServerVolumeAttachmentScenario-18472656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:24 devstack sudo[100020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:23:24 devstack sudo[100020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:24 devstack sudo[100014]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:24 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d4203e22-dad9-4109-9e41-a3a4438eae1a tempest-VolumesDeleteCascade-209937010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e72bbc0-9911-4094-b13d-d503bac50acf.004ac049-5b90-4a3b-9d72-995bfc6455fb" returned: 0 in 0.483s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:24 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-d4203e22-dad9-4109-9e41-a3a4438eae1a tempest-VolumesDeleteCascade-209937010 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e72bbc0-9911-4094-b13d-d503bac50acf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88613) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:23:24 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d69ddb4-83e4-4ac8-b518-4efa2b0b147a]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:23:24 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d4203e22-dad9-4109-9e41-a3a4438eae1a tempest-VolumesDeleteCascade-209937010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e72bbc0-9911-4094-b13d-d503bac50acf.9a635dde-0983-4da8-b3d9-46c162ba021a {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:24 devstack sudo[100024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e72bbc0-9911-4094-b13d-d503bac50acf.9a635dde-0983-4da8-b3d9-46c162ba021a Aug 05 10:23:24 devstack sudo[100024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:24 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-31bdbd10-ad29-4beb-b06d-6942ea3d29bd tempest-TestServerVolumeAttachmentScenario-18472656 None] Acquiring lock "cinder-3ac49342-aa81-4663-9939-d798f6deb6b0-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:23:24 devstack sudo[100020]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:24 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e5b99d6d-a498-4d7a-a26c-20e7953252c8 tempest-TestServerVolumeAttachmentScenario-18472656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.402s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:24 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-e5b99d6d-a498-4d7a-a26c-20e7953252c8 tempest-TestServerVolumeAttachmentScenario-18472656 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:23:24 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-31bdbd10-ad29-4beb-b06d-6942ea3d29bd tempest-TestServerVolumeAttachmentScenario-18472656 None] Lock "cinder-3ac49342-aa81-4663-9939-d798f6deb6b0-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:23:24 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-e5b99d6d-a498-4d7a-a26c-20e7953252c8 tempest-TestServerVolumeAttachmentScenario-18472656 None] Deleted volume successfully. Aug 05 10:23:24 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e5b99d6d-a498-4d7a-a26c-20e7953252c8 tempest-TestServerVolumeAttachmentScenario-18472656 None] Lock "cinder-b7a3359b-2c8e-4495-a87b-42cc222a17dc-delete_volume" released by "delete_volume" :: held 1.447s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:23:24 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-31bdbd10-ad29-4beb-b06d-6942ea3d29bd tempest-TestServerVolumeAttachmentScenario-18472656 None] Acquiring lock "cinder-quobyte-3ac49342-aa81-4663-9939-d798f6deb6b0" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:23:24 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-31bdbd10-ad29-4beb-b06d-6942ea3d29bd tempest-TestServerVolumeAttachmentScenario-18472656 None] Lock "cinder-quobyte-3ac49342-aa81-4663-9939-d798f6deb6b0" acquired by "delete_volume" :: waited 0.023s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:23:24 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[b61bb4d0-f44a-419d-bab0-faea3b520177]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:23:24 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-31bdbd10-ad29-4beb-b06d-6942ea3d29bd tempest-TestServerVolumeAttachmentScenario-18472656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3ac49342-aa81-4663-9939-d798f6deb6b0 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:24 devstack sudo[100024]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:24 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d4203e22-dad9-4109-9e41-a3a4438eae1a tempest-VolumesDeleteCascade-209937010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e72bbc0-9911-4094-b13d-d503bac50acf.9a635dde-0983-4da8-b3d9-46c162ba021a" returned: 0 in 0.484s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:24 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-d4203e22-dad9-4109-9e41-a3a4438eae1a tempest-VolumesDeleteCascade-209937010 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e72bbc0-9911-4094-b13d-d503bac50acf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88613) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:23:24 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d4203e22-dad9-4109-9e41-a3a4438eae1a tempest-VolumesDeleteCascade-209937010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e72bbc0-9911-4094-b13d-d503bac50acf.004ac049-5b90-4a3b-9d72-995bfc6455fb {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:24 devstack sudo[100031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e72bbc0-9911-4094-b13d-d503bac50acf.004ac049-5b90-4a3b-9d72-995bfc6455fb Aug 05 10:23:24 devstack sudo[100031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:24 devstack sudo[100027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3ac49342-aa81-4663-9939-d798f6deb6b0 Aug 05 10:23:24 devstack sudo[100027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:24 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-dce5cecb-18f7-4378-9c8b-dd55cfc66e5c tempest-VolumesActionsTest-1281671309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:23:24 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-dce5cecb-18f7-4378-9c8b-dd55cfc66e5c tempest-VolumesActionsTest-1281671309 None] Flow 'volume_create_manager' (46be1980-6641-40d4-9ed7-432d4301fa50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:23:24 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-dce5cecb-18f7-4378-9c8b-dd55cfc66e5c tempest-VolumesActionsTest-1281671309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a11aeda-0fd4-4494-87e1-4373482c6abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:24 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a9653e8-3b94-46db-b6bb-947247498ecc tempest-VolumesTransfersV357Test-1986616456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:23:24 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9a9653e8-3b94-46db-b6bb-947247498ecc tempest-VolumesTransfersV357Test-1986616456 None] Flow 'volume_create_manager' (f3b191e9-8b3e-4030-a85a-1b6a75f2df74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:23:24 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9a9653e8-3b94-46db-b6bb-947247498ecc tempest-VolumesTransfersV357Test-1986616456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3f63c1c-e23e-4e2e-b4b4-63a8e26b48e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:24 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-dce5cecb-18f7-4378-9c8b-dd55cfc66e5c tempest-VolumesActionsTest-1281671309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a11aeda-0fd4-4494-87e1-4373482c6abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:23:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1421427726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7777e90-04e3-49b2-ab72-c9818ac32814,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59d84c17dc794fb7b0527b1d35296590',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:23:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:23:25Z,use_quota=True,user_id='31056132f57d464587cf0bbc4d7d7cf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:24 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-dce5cecb-18f7-4378-9c8b-dd55cfc66e5c tempest-VolumesActionsTest-1281671309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dcb08ea-8cf1-4669-a691-f689b96a0514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:24 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-dce5cecb-18f7-4378-9c8b-dd55cfc66e5c tempest-VolumesActionsTest-1281671309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dcb08ea-8cf1-4669-a691-f689b96a0514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:24 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-dce5cecb-18f7-4378-9c8b-dd55cfc66e5c tempest-VolumesActionsTest-1281671309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8f95d52-d74d-4b30-8f03-01707a09b87b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:25 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-dce5cecb-18f7-4378-9c8b-dd55cfc66e5c tempest-VolumesActionsTest-1281671309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8f95d52-d74d-4b30-8f03-01707a09b87b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7777e90-04e3-49b2-ab72-c9818ac32814', 'volume_name': 'volume-e7777e90-04e3-49b2-ab72-c9818ac32814', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:25 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-dce5cecb-18f7-4378-9c8b-dd55cfc66e5c tempest-VolumesActionsTest-1281671309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (736e1cc2-d003-4635-b5e9-453a225619e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:25 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-dce5cecb-18f7-4378-9c8b-dd55cfc66e5c tempest-VolumesActionsTest-1281671309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (736e1cc2-d003-4635-b5e9-453a225619e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:25 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-dce5cecb-18f7-4378-9c8b-dd55cfc66e5c tempest-VolumesActionsTest-1281671309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc6b8fb7-7aa4-477c-a666-247e00d86a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:25 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-dce5cecb-18f7-4378-9c8b-dd55cfc66e5c tempest-VolumesActionsTest-1281671309 None] Volume e7777e90-04e3-49b2-ab72-c9818ac32814: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7777e90-04e3-49b2-ab72-c9818ac32814', 'volume_size': 1} Aug 05 10:23:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-dce5cecb-18f7-4378-9c8b-dd55cfc66e5c tempest-VolumesActionsTest-1281671309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:23:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-dce5cecb-18f7-4378-9c8b-dd55cfc66e5c tempest-VolumesActionsTest-1281671309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:23:25 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-dce5cecb-18f7-4378-9c8b-dd55cfc66e5c tempest-VolumesActionsTest-1281671309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:23:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1421427726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7777e90-04e3-49b2-ab72-c9818ac32814,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59d84c17dc794fb7b0527b1d35296590',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:23:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:23:25Z,use_quota=True,user_id='31056132f57d464587cf0bbc4d7d7cf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:23:25 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-dce5cecb-18f7-4378-9c8b-dd55cfc66e5c tempest-VolumesActionsTest-1281671309 None] Creating volume e7777e90-04e3-49b2-ab72-c9818ac32814 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:23:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-dce5cecb-18f7-4378-9c8b-dd55cfc66e5c tempest-VolumesActionsTest-1281671309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:23:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-dce5cecb-18f7-4378-9c8b-dd55cfc66e5c tempest-VolumesActionsTest-1281671309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:23:25 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-dce5cecb-18f7-4378-9c8b-dd55cfc66e5c tempest-VolumesActionsTest-1281671309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:23:25 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-dce5cecb-18f7-4378-9c8b-dd55cfc66e5c tempest-VolumesActionsTest-1281671309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:23:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-dce5cecb-18f7-4378-9c8b-dd55cfc66e5c tempest-VolumesActionsTest-1281671309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:23:25 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-dce5cecb-18f7-4378-9c8b-dd55cfc66e5c tempest-VolumesActionsTest-1281671309 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:23:25 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-dce5cecb-18f7-4378-9c8b-dd55cfc66e5c tempest-VolumesActionsTest-1281671309 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:23:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-dce5cecb-18f7-4378-9c8b-dd55cfc66e5c tempest-VolumesActionsTest-1281671309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e7777e90-04e3-49b2-ab72-c9818ac32814 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:25 devstack sudo[100041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e7777e90-04e3-49b2-ab72-c9818ac32814 1073741824 Aug 05 10:23:25 devstack sudo[100041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:25 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9a9653e8-3b94-46db-b6bb-947247498ecc tempest-VolumesTransfersV357Test-1986616456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3f63c1c-e23e-4e2e-b4b4-63a8e26b48e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:23:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-506709080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f504e0cc-185a-4871-8dc3-ed8337636414,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a87a07b8e6df43a4950ae1a68b77311f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:23:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:23:25Z,use_quota=True,user_id='594ffed48d694e61b71f66aecf1f5d33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:25 devstack sudo[100027]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:25 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9a9653e8-3b94-46db-b6bb-947247498ecc tempest-VolumesTransfersV357Test-1986616456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e5661cf-f21f-401b-869a-2cb52ba871c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:25 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9a9653e8-3b94-46db-b6bb-947247498ecc tempest-VolumesTransfersV357Test-1986616456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e5661cf-f21f-401b-869a-2cb52ba871c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:25 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9a9653e8-3b94-46db-b6bb-947247498ecc tempest-VolumesTransfersV357Test-1986616456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e2c7844-10c4-4b08-8e10-2470030679dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:25 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9a9653e8-3b94-46db-b6bb-947247498ecc tempest-VolumesTransfersV357Test-1986616456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e2c7844-10c4-4b08-8e10-2470030679dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f504e0cc-185a-4871-8dc3-ed8337636414', 'volume_name': 'volume-f504e0cc-185a-4871-8dc3-ed8337636414', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:25 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9a9653e8-3b94-46db-b6bb-947247498ecc tempest-VolumesTransfersV357Test-1986616456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fe6505e-7291-43e9-b51d-689fef3e5e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:25 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9a9653e8-3b94-46db-b6bb-947247498ecc tempest-VolumesTransfersV357Test-1986616456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fe6505e-7291-43e9-b51d-689fef3e5e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:25 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9a9653e8-3b94-46db-b6bb-947247498ecc tempest-VolumesTransfersV357Test-1986616456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72846abe-627d-4611-a8c1-813ada8a4ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:25 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-9a9653e8-3b94-46db-b6bb-947247498ecc tempest-VolumesTransfersV357Test-1986616456 None] Volume f504e0cc-185a-4871-8dc3-ed8337636414: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f504e0cc-185a-4871-8dc3-ed8337636414', 'volume_size': 1} Aug 05 10:23:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-9a9653e8-3b94-46db-b6bb-947247498ecc tempest-VolumesTransfersV357Test-1986616456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:23:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-31bdbd10-ad29-4beb-b06d-6942ea3d29bd tempest-TestServerVolumeAttachmentScenario-18472656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3ac49342-aa81-4663-9939-d798f6deb6b0" returned: 0 in 0.434s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-31bdbd10-ad29-4beb-b06d-6942ea3d29bd tempest-TestServerVolumeAttachmentScenario-18472656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3ac49342-aa81-4663-9939-d798f6deb6b0 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:25 devstack sudo[100045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3ac49342-aa81-4663-9939-d798f6deb6b0 Aug 05 10:23:25 devstack sudo[100045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:25 devstack sudo[100031]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d4203e22-dad9-4109-9e41-a3a4438eae1a tempest-VolumesDeleteCascade-209937010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e72bbc0-9911-4094-b13d-d503bac50acf.004ac049-5b90-4a3b-9d72-995bfc6455fb" returned: 0 in 0.491s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d4203e22-dad9-4109-9e41-a3a4438eae1a tempest-VolumesDeleteCascade-209937010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e72bbc0-9911-4094-b13d-d503bac50acf.004ac049-5b90-4a3b-9d72-995bfc6455fb {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:25 devstack sudo[100047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e72bbc0-9911-4094-b13d-d503bac50acf.004ac049-5b90-4a3b-9d72-995bfc6455fb Aug 05 10:23:25 devstack sudo[100047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:25 devstack sudo[100045]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-31bdbd10-ad29-4beb-b06d-6942ea3d29bd tempest-TestServerVolumeAttachmentScenario-18472656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3ac49342-aa81-4663-9939-d798f6deb6b0" returned: 0 in 0.319s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:25 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-31bdbd10-ad29-4beb-b06d-6942ea3d29bd tempest-TestServerVolumeAttachmentScenario-18472656 None] Lock "cinder-quobyte-3ac49342-aa81-4663-9939-d798f6deb6b0" released by "delete_volume" :: held 0.801s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:23:25 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-31bdbd10-ad29-4beb-b06d-6942ea3d29bd tempest-TestServerVolumeAttachmentScenario-18472656 None] Created reservations ['8e1ff94b-050d-4153-9db7-12aabb55c1b7', 'ed26795e-07b1-40cb-8e99-6c604d2ce1c4', 'e424c3df-dc61-4042-8363-7d24d6a03b25', '2f3cfaaf-5633-4e91-abdb-536b4841ce41'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:23:25 devstack sudo[100047]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d4203e22-dad9-4109-9e41-a3a4438eae1a tempest-VolumesDeleteCascade-209937010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e72bbc0-9911-4094-b13d-d503bac50acf.004ac049-5b90-4a3b-9d72-995bfc6455fb" returned: 0 in 0.292s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:25 devstack sudo[100041]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-dce5cecb-18f7-4378-9c8b-dd55cfc66e5c tempest-VolumesActionsTest-1281671309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e7777e90-04e3-49b2-ab72-c9818ac32814 1073741824" returned: 0 in 0.533s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:25 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d4203e22-dad9-4109-9e41-a3a4438eae1a tempest-VolumesDeleteCascade-209937010 None] Lock "cinder-quobyte-004ac049-5b90-4a3b-9d72-995bfc6455fb" released by "_delete_snapshot" :: held 1.858s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:23:25 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d4203e22-dad9-4109-9e41-a3a4438eae1a tempest-VolumesDeleteCascade-209937010 None] Lock "cinder-quobyte-8e72bbc0-9911-4094-b13d-d503bac50acf" released by "delete_snapshot" :: held 1.884s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:23:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-dce5cecb-18f7-4378-9c8b-dd55cfc66e5c tempest-VolumesActionsTest-1281671309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e7777e90-04e3-49b2-ab72-c9818ac32814 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-31bdbd10-ad29-4beb-b06d-6942ea3d29bd tempest-TestServerVolumeAttachmentScenario-18472656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:23:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-31bdbd10-ad29-4beb-b06d-6942ea3d29bd tempest-TestServerVolumeAttachmentScenario-18472656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:23:25 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-31bdbd10-ad29-4beb-b06d-6942ea3d29bd tempest-TestServerVolumeAttachmentScenario-18472656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:23:25 devstack sudo[100054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e7777e90-04e3-49b2-ab72-c9818ac32814 Aug 05 10:23:25 devstack sudo[100054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:25 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-31bdbd10-ad29-4beb-b06d-6942ea3d29bd tempest-TestServerVolumeAttachmentScenario-18472656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:23:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-31bdbd10-ad29-4beb-b06d-6942ea3d29bd tempest-TestServerVolumeAttachmentScenario-18472656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:23:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-31bdbd10-ad29-4beb-b06d-6942ea3d29bd tempest-TestServerVolumeAttachmentScenario-18472656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:25 devstack sudo[100056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:23:25 devstack sudo[100056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:25 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-d4203e22-dad9-4109-9e41-a3a4438eae1a tempest-VolumesDeleteCascade-209937010 None] Created reservations ['7c733316-3294-4a2a-95f3-4a692b6a5866', '774d5b0e-6eed-4f6e-ae6f-f0426166017b', '00fd940d-80fd-4a68-9802-8bb3ad4de23e', '9f9626c1-c245-4aac-b5e3-b1cb3c1e0591'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:23:25 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-d4203e22-dad9-4109-9e41-a3a4438eae1a tempest-VolumesDeleteCascade-209937010 None] Delete snapshot completed successfully. Aug 05 10:23:25 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d4203e22-dad9-4109-9e41-a3a4438eae1a tempest-VolumesDeleteCascade-209937010 None] Lock "cinder-004ac049-5b90-4a3b-9d72-995bfc6455fb-delete_snapshot" released by "delete_snapshot" :: held 2.176s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:23:25 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d4203e22-dad9-4109-9e41-a3a4438eae1a tempest-VolumesDeleteCascade-209937010 None] Acquiring lock "cinder-9a635dde-0983-4da8-b3d9-46c162ba021a-delete_snapshot" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:23:25 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d4203e22-dad9-4109-9e41-a3a4438eae1a tempest-VolumesDeleteCascade-209937010 None] Lock "cinder-9a635dde-0983-4da8-b3d9-46c162ba021a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:23:25 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d4203e22-dad9-4109-9e41-a3a4438eae1a tempest-VolumesDeleteCascade-209937010 None] Acquiring lock "cinder-quobyte-8e72bbc0-9911-4094-b13d-d503bac50acf" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:23:25 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d4203e22-dad9-4109-9e41-a3a4438eae1a tempest-VolumesDeleteCascade-209937010 None] Lock "cinder-quobyte-8e72bbc0-9911-4094-b13d-d503bac50acf" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:23:25 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d4203e22-dad9-4109-9e41-a3a4438eae1a tempest-VolumesDeleteCascade-209937010 None] Acquiring lock "cinder-quobyte-9a635dde-0983-4da8-b3d9-46c162ba021a" by "_delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:23:25 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d4203e22-dad9-4109-9e41-a3a4438eae1a tempest-VolumesDeleteCascade-209937010 None] Lock "cinder-quobyte-9a635dde-0983-4da8-b3d9-46c162ba021a" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:23:25 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-d4203e22-dad9-4109-9e41-a3a4438eae1a tempest-VolumesDeleteCascade-209937010 None] Deleting offline snapshot 9a635dde-0983-4da8-b3d9-46c162ba021a of volume 8e72bbc0-9911-4094-b13d-d503bac50acf {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:23:25 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-d4203e22-dad9-4109-9e41-a3a4438eae1a tempest-VolumesDeleteCascade-209937010 None] snapshot_file for this snap is: volume-8e72bbc0-9911-4094-b13d-d503bac50acf.9a635dde-0983-4da8-b3d9-46c162ba021a {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:23:25 devstack sudo[100054]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:25 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ccbd873-68f4-4b56-b3ee-34048cd6b700]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:23:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d4203e22-dad9-4109-9e41-a3a4438eae1a tempest-VolumesDeleteCascade-209937010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e72bbc0-9911-4094-b13d-d503bac50acf.9a635dde-0983-4da8-b3d9-46c162ba021a {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-dce5cecb-18f7-4378-9c8b-dd55cfc66e5c tempest-VolumesActionsTest-1281671309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e7777e90-04e3-49b2-ab72-c9818ac32814" returned: 0 in 0.340s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:25 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-dce5cecb-18f7-4378-9c8b-dd55cfc66e5c tempest-VolumesActionsTest-1281671309 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:23:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-dce5cecb-18f7-4378-9c8b-dd55cfc66e5c tempest-VolumesActionsTest-1281671309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:23:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-9a9653e8-3b94-46db-b6bb-947247498ecc tempest-VolumesTransfersV357Test-1986616456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.881s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:23:25 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-9a9653e8-3b94-46db-b6bb-947247498ecc tempest-VolumesTransfersV357Test-1986616456 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:23:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-506709080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f504e0cc-185a-4871-8dc3-ed8337636414,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a87a07b8e6df43a4950ae1a68b77311f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:23:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:23:25Z,use_quota=True,user_id='594ffed48d694e61b71f66aecf1f5d33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:23:25 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-9a9653e8-3b94-46db-b6bb-947247498ecc tempest-VolumesTransfersV357Test-1986616456 None] Creating volume f504e0cc-185a-4871-8dc3-ed8337636414 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:23:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-9a9653e8-3b94-46db-b6bb-947247498ecc tempest-VolumesTransfersV357Test-1986616456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:23:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-9a9653e8-3b94-46db-b6bb-947247498ecc tempest-VolumesTransfersV357Test-1986616456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:23:25 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-9a9653e8-3b94-46db-b6bb-947247498ecc tempest-VolumesTransfersV357Test-1986616456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:23:25 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-9a9653e8-3b94-46db-b6bb-947247498ecc tempest-VolumesTransfersV357Test-1986616456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:23:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-9a9653e8-3b94-46db-b6bb-947247498ecc tempest-VolumesTransfersV357Test-1986616456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:23:25 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-9a9653e8-3b94-46db-b6bb-947247498ecc tempest-VolumesTransfersV357Test-1986616456 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:23:25 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-9a9653e8-3b94-46db-b6bb-947247498ecc tempest-VolumesTransfersV357Test-1986616456 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:23:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9a9653e8-3b94-46db-b6bb-947247498ecc tempest-VolumesTransfersV357Test-1986616456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f504e0cc-185a-4871-8dc3-ed8337636414 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:26 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-dce5cecb-18f7-4378-9c8b-dd55cfc66e5c tempest-VolumesActionsTest-1281671309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc6b8fb7-7aa4-477c-a666-247e00d86a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7777e90-04e3-49b2-ab72-c9818ac32814', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:26 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-dce5cecb-18f7-4378-9c8b-dd55cfc66e5c tempest-VolumesActionsTest-1281671309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c821f584-8811-4ad8-868b-7e10f1650650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:26 devstack sudo[100056]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:26 devstack sudo[100061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f504e0cc-185a-4871-8dc3-ed8337636414 1073741824 Aug 05 10:23:26 devstack sudo[100061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:26 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-31bdbd10-ad29-4beb-b06d-6942ea3d29bd tempest-TestServerVolumeAttachmentScenario-18472656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.371s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:26 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-31bdbd10-ad29-4beb-b06d-6942ea3d29bd tempest-TestServerVolumeAttachmentScenario-18472656 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:23:26 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-31bdbd10-ad29-4beb-b06d-6942ea3d29bd tempest-TestServerVolumeAttachmentScenario-18472656 None] Deleted volume successfully. Aug 05 10:23:26 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-dce5cecb-18f7-4378-9c8b-dd55cfc66e5c tempest-VolumesActionsTest-1281671309 None] Volume volume-e7777e90-04e3-49b2-ab72-c9818ac32814 (e7777e90-04e3-49b2-ab72-c9818ac32814): created successfully Aug 05 10:23:26 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-dce5cecb-18f7-4378-9c8b-dd55cfc66e5c tempest-VolumesActionsTest-1281671309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c821f584-8811-4ad8-868b-7e10f1650650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:26 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-dce5cecb-18f7-4378-9c8b-dd55cfc66e5c tempest-VolumesActionsTest-1281671309 None] Flow 'volume_create_manager' (46be1980-6641-40d4-9ed7-432d4301fa50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:23:26 devstack sudo[100059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e72bbc0-9911-4094-b13d-d503bac50acf.9a635dde-0983-4da8-b3d9-46c162ba021a Aug 05 10:23:26 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-31bdbd10-ad29-4beb-b06d-6942ea3d29bd tempest-TestServerVolumeAttachmentScenario-18472656 None] Lock "cinder-3ac49342-aa81-4663-9939-d798f6deb6b0-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:23:26 devstack sudo[100059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:26 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-dce5cecb-18f7-4378-9c8b-dd55cfc66e5c tempest-VolumesActionsTest-1281671309 None] Created volume successfully. Aug 05 10:23:26 devstack sudo[100059]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:26 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d4203e22-dad9-4109-9e41-a3a4438eae1a tempest-VolumesDeleteCascade-209937010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e72bbc0-9911-4094-b13d-d503bac50acf.9a635dde-0983-4da8-b3d9-46c162ba021a" returned: 0 in 0.438s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:26 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-d4203e22-dad9-4109-9e41-a3a4438eae1a tempest-VolumesDeleteCascade-209937010 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e72bbc0-9911-4094-b13d-d503bac50acf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88613) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:23:26 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec217603-0116-4773-8de1-818d8f67b54c]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:23:26 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d4203e22-dad9-4109-9e41-a3a4438eae1a tempest-VolumesDeleteCascade-209937010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e72bbc0-9911-4094-b13d-d503bac50acf {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:26 devstack sudo[100072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e72bbc0-9911-4094-b13d-d503bac50acf Aug 05 10:23:26 devstack sudo[100072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:26 devstack sudo[100061]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:26 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9a9653e8-3b94-46db-b6bb-947247498ecc tempest-VolumesTransfersV357Test-1986616456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f504e0cc-185a-4871-8dc3-ed8337636414 1073741824" returned: 0 in 0.585s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:26 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9a9653e8-3b94-46db-b6bb-947247498ecc tempest-VolumesTransfersV357Test-1986616456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f504e0cc-185a-4871-8dc3-ed8337636414 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:26 devstack sudo[100075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f504e0cc-185a-4871-8dc3-ed8337636414 Aug 05 10:23:26 devstack sudo[100075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:26 devstack sudo[100072]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:26 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d4203e22-dad9-4109-9e41-a3a4438eae1a tempest-VolumesDeleteCascade-209937010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e72bbc0-9911-4094-b13d-d503bac50acf" returned: 0 in 0.499s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:26 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d4203e22-dad9-4109-9e41-a3a4438eae1a tempest-VolumesDeleteCascade-209937010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e72bbc0-9911-4094-b13d-d503bac50acf.9a635dde-0983-4da8-b3d9-46c162ba021a {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:26 devstack sudo[100081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e72bbc0-9911-4094-b13d-d503bac50acf.9a635dde-0983-4da8-b3d9-46c162ba021a Aug 05 10:23:26 devstack sudo[100081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:27 devstack sudo[100075]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:27 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9a9653e8-3b94-46db-b6bb-947247498ecc tempest-VolumesTransfersV357Test-1986616456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f504e0cc-185a-4871-8dc3-ed8337636414" returned: 0 in 0.425s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:27 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-9a9653e8-3b94-46db-b6bb-947247498ecc tempest-VolumesTransfersV357Test-1986616456 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:23:27 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-9a9653e8-3b94-46db-b6bb-947247498ecc tempest-VolumesTransfersV357Test-1986616456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:23:27 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9a9653e8-3b94-46db-b6bb-947247498ecc tempest-VolumesTransfersV357Test-1986616456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72846abe-627d-4611-a8c1-813ada8a4ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f504e0cc-185a-4871-8dc3-ed8337636414', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:27 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9a9653e8-3b94-46db-b6bb-947247498ecc tempest-VolumesTransfersV357Test-1986616456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46f08e43-309a-4a3f-8e26-b11508dfcacc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:27 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-9a9653e8-3b94-46db-b6bb-947247498ecc tempest-VolumesTransfersV357Test-1986616456 None] Volume volume-f504e0cc-185a-4871-8dc3-ed8337636414 (f504e0cc-185a-4871-8dc3-ed8337636414): created successfully Aug 05 10:23:27 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9a9653e8-3b94-46db-b6bb-947247498ecc tempest-VolumesTransfersV357Test-1986616456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46f08e43-309a-4a3f-8e26-b11508dfcacc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:27 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9a9653e8-3b94-46db-b6bb-947247498ecc tempest-VolumesTransfersV357Test-1986616456 None] Flow 'volume_create_manager' (f3b191e9-8b3e-4030-a85a-1b6a75f2df74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:23:27 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-9a9653e8-3b94-46db-b6bb-947247498ecc tempest-VolumesTransfersV357Test-1986616456 None] Created volume successfully. Aug 05 10:23:27 devstack sudo[100081]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:27 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d4203e22-dad9-4109-9e41-a3a4438eae1a tempest-VolumesDeleteCascade-209937010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e72bbc0-9911-4094-b13d-d503bac50acf.9a635dde-0983-4da8-b3d9-46c162ba021a" returned: 0 in 0.507s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:27 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d4203e22-dad9-4109-9e41-a3a4438eae1a tempest-VolumesDeleteCascade-209937010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e72bbc0-9911-4094-b13d-d503bac50acf.9a635dde-0983-4da8-b3d9-46c162ba021a {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:27 devstack sudo[100088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e72bbc0-9911-4094-b13d-d503bac50acf.9a635dde-0983-4da8-b3d9-46c162ba021a Aug 05 10:23:27 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-dab12954-94e4-4559-8361-82b2839552ef tempest-VolumesActionsTest-1281671309 None] Acquiring lock "cinder-e7777e90-04e3-49b2-ab72-c9818ac32814-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:23:27 devstack sudo[100088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:27 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-dab12954-94e4-4559-8361-82b2839552ef tempest-VolumesActionsTest-1281671309 None] Lock "cinder-e7777e90-04e3-49b2-ab72-c9818ac32814-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:23:27 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-dab12954-94e4-4559-8361-82b2839552ef tempest-VolumesActionsTest-1281671309 None] Acquiring lock "cinder-quobyte-e7777e90-04e3-49b2-ab72-c9818ac32814" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:23:27 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-dab12954-94e4-4559-8361-82b2839552ef tempest-VolumesActionsTest-1281671309 None] Lock "cinder-quobyte-e7777e90-04e3-49b2-ab72-c9818ac32814" acquired by "delete_volume" :: waited 0.016s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:23:27 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e82a73-1711-498a-8177-7a6d87db1340]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:23:27 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-dab12954-94e4-4559-8361-82b2839552ef tempest-VolumesActionsTest-1281671309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e7777e90-04e3-49b2-ab72-c9818ac32814 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:27 devstack sudo[100088]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:27 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d4203e22-dad9-4109-9e41-a3a4438eae1a tempest-VolumesDeleteCascade-209937010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e72bbc0-9911-4094-b13d-d503bac50acf.9a635dde-0983-4da8-b3d9-46c162ba021a" returned: 0 in 0.317s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:27 devstack sudo[100090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e7777e90-04e3-49b2-ab72-c9818ac32814 Aug 05 10:23:27 devstack sudo[100090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:27 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d4203e22-dad9-4109-9e41-a3a4438eae1a tempest-VolumesDeleteCascade-209937010 None] Lock "cinder-quobyte-9a635dde-0983-4da8-b3d9-46c162ba021a" released by "_delete_snapshot" :: held 1.910s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:23:27 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d4203e22-dad9-4109-9e41-a3a4438eae1a tempest-VolumesDeleteCascade-209937010 None] Lock "cinder-quobyte-8e72bbc0-9911-4094-b13d-d503bac50acf" released by "delete_snapshot" :: held 1.942s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:23:27 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-d4203e22-dad9-4109-9e41-a3a4438eae1a tempest-VolumesDeleteCascade-209937010 None] Created reservations ['8c5d33b0-c947-4474-ae63-68454cb87420', '6bf8083f-c464-411c-84fd-61a542953a73', '975cd33a-c5e8-4634-81a2-173d69b5bfce', '5c6fbba6-d984-4dba-932a-cc98139d957f'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:23:28 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-d4203e22-dad9-4109-9e41-a3a4438eae1a tempest-VolumesDeleteCascade-209937010 None] Delete snapshot completed successfully. Aug 05 10:23:28 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d4203e22-dad9-4109-9e41-a3a4438eae1a tempest-VolumesDeleteCascade-209937010 None] Lock "cinder-9a635dde-0983-4da8-b3d9-46c162ba021a-delete_snapshot" released by "delete_snapshot" :: held 2.174s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:23:28 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d4203e22-dad9-4109-9e41-a3a4438eae1a tempest-VolumesDeleteCascade-209937010 None] Snapshots deleted, issuing volume delete {{(pid=88613) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Aug 05 10:23:28 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d4203e22-dad9-4109-9e41-a3a4438eae1a tempest-VolumesDeleteCascade-209937010 None] Acquiring lock "cinder-quobyte-8e72bbc0-9911-4094-b13d-d503bac50acf" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:23:28 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d4203e22-dad9-4109-9e41-a3a4438eae1a tempest-VolumesDeleteCascade-209937010 None] Lock "cinder-quobyte-8e72bbc0-9911-4094-b13d-d503bac50acf" acquired by "delete_volume" :: waited 0.023s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:23:28 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[6830eb20-03a6-4368-8805-ea38a4b5c822]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:23:28 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d4203e22-dad9-4109-9e41-a3a4438eae1a tempest-VolumesDeleteCascade-209937010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e72bbc0-9911-4094-b13d-d503bac50acf {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:28 devstack sudo[100090]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:28 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-dab12954-94e4-4559-8361-82b2839552ef tempest-VolumesActionsTest-1281671309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e7777e90-04e3-49b2-ab72-c9818ac32814" returned: 0 in 0.528s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:28 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-dab12954-94e4-4559-8361-82b2839552ef tempest-VolumesActionsTest-1281671309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e7777e90-04e3-49b2-ab72-c9818ac32814 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:28 devstack sudo[100097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e7777e90-04e3-49b2-ab72-c9818ac32814 Aug 05 10:23:28 devstack sudo[100097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:28 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-5c960ca2-7b78-4fe7-8e59-50c810105a72 tempest-VolumesTransfersV357Test-881422573 None] Acquiring lock "cinder-f504e0cc-185a-4871-8dc3-ed8337636414-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:23:28 devstack sudo[100096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e72bbc0-9911-4094-b13d-d503bac50acf Aug 05 10:23:28 devstack sudo[100096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:28 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-5c960ca2-7b78-4fe7-8e59-50c810105a72 tempest-VolumesTransfersV357Test-881422573 None] Lock "cinder-f504e0cc-185a-4871-8dc3-ed8337636414-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:23:28 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-5c960ca2-7b78-4fe7-8e59-50c810105a72 tempest-VolumesTransfersV357Test-881422573 None] Acquiring lock "cinder-quobyte-f504e0cc-185a-4871-8dc3-ed8337636414" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:23:28 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-5c960ca2-7b78-4fe7-8e59-50c810105a72 tempest-VolumesTransfersV357Test-881422573 None] Lock "cinder-quobyte-f504e0cc-185a-4871-8dc3-ed8337636414" acquired by "delete_volume" :: waited 0.016s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:23:28 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffab2bd5-34c4-49e0-ae1b-5d249534f8f0]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:23:28 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5c960ca2-7b78-4fe7-8e59-50c810105a72 tempest-VolumesTransfersV357Test-881422573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f504e0cc-185a-4871-8dc3-ed8337636414 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:28 devstack sudo[100097]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:28 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-dab12954-94e4-4559-8361-82b2839552ef tempest-VolumesActionsTest-1281671309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e7777e90-04e3-49b2-ab72-c9818ac32814" returned: 0 in 0.345s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:28 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-dab12954-94e4-4559-8361-82b2839552ef tempest-VolumesActionsTest-1281671309 None] Lock "cinder-quobyte-e7777e90-04e3-49b2-ab72-c9818ac32814" released by "delete_volume" :: held 0.927s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:23:28 devstack sudo[100100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f504e0cc-185a-4871-8dc3-ed8337636414 Aug 05 10:23:28 devstack sudo[100100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:28 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-dab12954-94e4-4559-8361-82b2839552ef tempest-VolumesActionsTest-1281671309 None] Created reservations ['407d4fc4-0269-4269-8fe4-d3e03dbf0fed', '6aeb315e-2283-4837-aedd-96b1ceb27748', 'd5d06433-3a76-4887-95d8-78d3376a8d79', '8190d091-bb2e-41db-9018-a2a66f83f5fa'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:23:28 devstack sudo[100096]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:28 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d4203e22-dad9-4109-9e41-a3a4438eae1a tempest-VolumesDeleteCascade-209937010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e72bbc0-9911-4094-b13d-d503bac50acf" returned: 0 in 0.570s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:28 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d4203e22-dad9-4109-9e41-a3a4438eae1a tempest-VolumesDeleteCascade-209937010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e72bbc0-9911-4094-b13d-d503bac50acf {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:28 devstack sudo[100106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e72bbc0-9911-4094-b13d-d503bac50acf Aug 05 10:23:28 devstack sudo[100106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:28 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-dab12954-94e4-4559-8361-82b2839552ef tempest-VolumesActionsTest-1281671309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:23:28 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-dab12954-94e4-4559-8361-82b2839552ef tempest-VolumesActionsTest-1281671309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:23:28 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-dab12954-94e4-4559-8361-82b2839552ef tempest-VolumesActionsTest-1281671309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:23:28 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-dab12954-94e4-4559-8361-82b2839552ef tempest-VolumesActionsTest-1281671309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:23:28 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-dab12954-94e4-4559-8361-82b2839552ef tempest-VolumesActionsTest-1281671309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:23:28 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-dab12954-94e4-4559-8361-82b2839552ef tempest-VolumesActionsTest-1281671309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:28 devstack sudo[100108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:23:28 devstack sudo[100108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:28 devstack sudo[100100]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:28 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5c960ca2-7b78-4fe7-8e59-50c810105a72 tempest-VolumesTransfersV357Test-881422573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f504e0cc-185a-4871-8dc3-ed8337636414" returned: 0 in 0.537s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:28 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5c960ca2-7b78-4fe7-8e59-50c810105a72 tempest-VolumesTransfersV357Test-881422573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f504e0cc-185a-4871-8dc3-ed8337636414 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:29 devstack sudo[100114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f504e0cc-185a-4871-8dc3-ed8337636414 Aug 05 10:23:29 devstack sudo[100114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:29 devstack sudo[100106]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:29 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d4203e22-dad9-4109-9e41-a3a4438eae1a tempest-VolumesDeleteCascade-209937010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e72bbc0-9911-4094-b13d-d503bac50acf" returned: 0 in 0.369s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:29 devstack sudo[100108]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:29 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-dab12954-94e4-4559-8361-82b2839552ef tempest-VolumesActionsTest-1281671309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.320s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:29 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-dab12954-94e4-4559-8361-82b2839552ef tempest-VolumesActionsTest-1281671309 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:23:29 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d4203e22-dad9-4109-9e41-a3a4438eae1a tempest-VolumesDeleteCascade-209937010 None] Lock "cinder-quobyte-8e72bbc0-9911-4094-b13d-d503bac50acf" released by "delete_volume" :: held 1.029s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:23:29 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-dab12954-94e4-4559-8361-82b2839552ef tempest-VolumesActionsTest-1281671309 None] Deleted volume successfully. Aug 05 10:23:29 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-dab12954-94e4-4559-8361-82b2839552ef tempest-VolumesActionsTest-1281671309 None] Lock "cinder-e7777e90-04e3-49b2-ab72-c9818ac32814-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:23:29 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-d4203e22-dad9-4109-9e41-a3a4438eae1a tempest-VolumesDeleteCascade-209937010 None] Created reservations ['ecfc9c42-8059-4baa-8c76-aa64ade8049c', '2948303c-2fa9-4fd6-97eb-b3ef604f1209', 'c451707a-5bce-4f3d-9272-abf09e562219', 'dccb6f25-2d83-43a8-908a-362d243a656d'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:23:29 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-d4203e22-dad9-4109-9e41-a3a4438eae1a tempest-VolumesDeleteCascade-209937010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:23:29 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-d4203e22-dad9-4109-9e41-a3a4438eae1a tempest-VolumesDeleteCascade-209937010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:23:29 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-d4203e22-dad9-4109-9e41-a3a4438eae1a tempest-VolumesDeleteCascade-209937010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:23:29 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-d4203e22-dad9-4109-9e41-a3a4438eae1a tempest-VolumesDeleteCascade-209937010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:23:29 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-d4203e22-dad9-4109-9e41-a3a4438eae1a tempest-VolumesDeleteCascade-209937010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:23:29 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d4203e22-dad9-4109-9e41-a3a4438eae1a tempest-VolumesDeleteCascade-209937010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:29 devstack sudo[100118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:23:29 devstack sudo[100118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:29 devstack sudo[100114]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:29 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5c960ca2-7b78-4fe7-8e59-50c810105a72 tempest-VolumesTransfersV357Test-881422573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f504e0cc-185a-4871-8dc3-ed8337636414" returned: 0 in 0.401s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:29 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-5c960ca2-7b78-4fe7-8e59-50c810105a72 tempest-VolumesTransfersV357Test-881422573 None] Lock "cinder-quobyte-f504e0cc-185a-4871-8dc3-ed8337636414" released by "delete_volume" :: held 1.013s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:23:29 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-5c960ca2-7b78-4fe7-8e59-50c810105a72 tempest-VolumesTransfersV357Test-881422573 None] Created reservations ['c0c69c01-655f-44c6-abdb-ed19a5242d7d', 'dd000d51-609a-4825-ad55-68b589249886', 'e4286db8-2d54-47e2-9dc7-e5462bf4e74e', '80566919-496c-412b-9f5a-8a11be68cc1a'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:23:29 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5c960ca2-7b78-4fe7-8e59-50c810105a72 tempest-VolumesTransfersV357Test-881422573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:23:29 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5c960ca2-7b78-4fe7-8e59-50c810105a72 tempest-VolumesTransfersV357Test-881422573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:23:29 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-5c960ca2-7b78-4fe7-8e59-50c810105a72 tempest-VolumesTransfersV357Test-881422573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:23:29 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-5c960ca2-7b78-4fe7-8e59-50c810105a72 tempest-VolumesTransfersV357Test-881422573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:23:29 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5c960ca2-7b78-4fe7-8e59-50c810105a72 tempest-VolumesTransfersV357Test-881422573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:23:29 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5c960ca2-7b78-4fe7-8e59-50c810105a72 tempest-VolumesTransfersV357Test-881422573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:29 devstack sudo[100121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:23:29 devstack sudo[100121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:29 devstack sudo[100118]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:29 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d4203e22-dad9-4109-9e41-a3a4438eae1a tempest-VolumesDeleteCascade-209937010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.291s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:29 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-d4203e22-dad9-4109-9e41-a3a4438eae1a tempest-VolumesDeleteCascade-209937010 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:23:29 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-d4203e22-dad9-4109-9e41-a3a4438eae1a tempest-VolumesDeleteCascade-209937010 None] Deleted volume successfully. Aug 05 10:23:29 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d4203e22-dad9-4109-9e41-a3a4438eae1a tempest-VolumesDeleteCascade-209937010 None] Lock "cinder-8e72bbc0-9911-4094-b13d-d503bac50acf-delete_volume" released by "delete_volume" :: held 6.046s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:23:29 devstack sudo[100121]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:29 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5c960ca2-7b78-4fe7-8e59-50c810105a72 tempest-VolumesTransfersV357Test-881422573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.283s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:29 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-5c960ca2-7b78-4fe7-8e59-50c810105a72 tempest-VolumesTransfersV357Test-881422573 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:23:29 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-5c960ca2-7b78-4fe7-8e59-50c810105a72 tempest-VolumesTransfersV357Test-881422573 None] Deleted volume successfully. Aug 05 10:23:29 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-5c960ca2-7b78-4fe7-8e59-50c810105a72 tempest-VolumesTransfersV357Test-881422573 None] Lock "cinder-f504e0cc-185a-4871-8dc3-ed8337636414-delete_volume" released by "delete_volume" :: held 1.548s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:23:31 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-2158da5e-65d1-4f6c-a6b9-3132f20dc993 tempest-VolumesDeleteCascade-209937010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:23:31 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2158da5e-65d1-4f6c-a6b9-3132f20dc993 tempest-VolumesDeleteCascade-209937010 None] Flow 'volume_create_manager' (04b0565d-cf61-43a8-9a86-b89cdac3b8a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:23:31 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2158da5e-65d1-4f6c-a6b9-3132f20dc993 tempest-VolumesDeleteCascade-209937010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24c57b34-7115-4f29-94eb-3130d36b8c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:31 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2158da5e-65d1-4f6c-a6b9-3132f20dc993 tempest-VolumesDeleteCascade-209937010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24c57b34-7115-4f29-94eb-3130d36b8c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:23:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1725637980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34eacdcf-4fde-492d-8bb5-63951c2ddb86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5eb090a71f14c278530d309ba2d85ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:23:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:23:31Z,use_quota=True,user_id='bee3dc2926dc4e56acaa771d12c6ad8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:31 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2158da5e-65d1-4f6c-a6b9-3132f20dc993 tempest-VolumesDeleteCascade-209937010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a00a89fc-4b67-45ea-a1af-60ced199630a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:31 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2158da5e-65d1-4f6c-a6b9-3132f20dc993 tempest-VolumesDeleteCascade-209937010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a00a89fc-4b67-45ea-a1af-60ced199630a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:31 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2158da5e-65d1-4f6c-a6b9-3132f20dc993 tempest-VolumesDeleteCascade-209937010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf93b4dc-2f1e-4028-8581-76b8e3816d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:31 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2158da5e-65d1-4f6c-a6b9-3132f20dc993 tempest-VolumesDeleteCascade-209937010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf93b4dc-2f1e-4028-8581-76b8e3816d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34eacdcf-4fde-492d-8bb5-63951c2ddb86', 'volume_name': 'volume-34eacdcf-4fde-492d-8bb5-63951c2ddb86', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:31 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2158da5e-65d1-4f6c-a6b9-3132f20dc993 tempest-VolumesDeleteCascade-209937010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (233843f1-99fc-4667-8516-80f8c5af0420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:31 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2158da5e-65d1-4f6c-a6b9-3132f20dc993 tempest-VolumesDeleteCascade-209937010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (233843f1-99fc-4667-8516-80f8c5af0420) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:31 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2158da5e-65d1-4f6c-a6b9-3132f20dc993 tempest-VolumesDeleteCascade-209937010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7db008b1-c6b5-4753-bf3b-94dd3a5d2741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:31 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-2158da5e-65d1-4f6c-a6b9-3132f20dc993 tempest-VolumesDeleteCascade-209937010 None] Volume 34eacdcf-4fde-492d-8bb5-63951c2ddb86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34eacdcf-4fde-492d-8bb5-63951c2ddb86', 'volume_size': 1} Aug 05 10:23:31 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2158da5e-65d1-4f6c-a6b9-3132f20dc993 tempest-VolumesDeleteCascade-209937010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:23:31 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2158da5e-65d1-4f6c-a6b9-3132f20dc993 tempest-VolumesDeleteCascade-209937010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:23:31 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-2158da5e-65d1-4f6c-a6b9-3132f20dc993 tempest-VolumesDeleteCascade-209937010 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:23:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1725637980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34eacdcf-4fde-492d-8bb5-63951c2ddb86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5eb090a71f14c278530d309ba2d85ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:23:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:23:31Z,use_quota=True,user_id='bee3dc2926dc4e56acaa771d12c6ad8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:23:31 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-2158da5e-65d1-4f6c-a6b9-3132f20dc993 tempest-VolumesDeleteCascade-209937010 None] Creating volume 34eacdcf-4fde-492d-8bb5-63951c2ddb86 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:23:31 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2158da5e-65d1-4f6c-a6b9-3132f20dc993 tempest-VolumesDeleteCascade-209937010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:23:31 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2158da5e-65d1-4f6c-a6b9-3132f20dc993 tempest-VolumesDeleteCascade-209937010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:23:31 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-2158da5e-65d1-4f6c-a6b9-3132f20dc993 tempest-VolumesDeleteCascade-209937010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:23:31 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-2158da5e-65d1-4f6c-a6b9-3132f20dc993 tempest-VolumesDeleteCascade-209937010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:23:31 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2158da5e-65d1-4f6c-a6b9-3132f20dc993 tempest-VolumesDeleteCascade-209937010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:23:31 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-2158da5e-65d1-4f6c-a6b9-3132f20dc993 tempest-VolumesDeleteCascade-209937010 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:23:31 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-2158da5e-65d1-4f6c-a6b9-3132f20dc993 tempest-VolumesDeleteCascade-209937010 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:23:31 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2158da5e-65d1-4f6c-a6b9-3132f20dc993 tempest-VolumesDeleteCascade-209937010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-34eacdcf-4fde-492d-8bb5-63951c2ddb86 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:31 devstack sudo[100125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-34eacdcf-4fde-492d-8bb5-63951c2ddb86 1073741824 Aug 05 10:23:31 devstack sudo[100125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:31 devstack sudo[100125]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:31 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2158da5e-65d1-4f6c-a6b9-3132f20dc993 tempest-VolumesDeleteCascade-209937010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-34eacdcf-4fde-492d-8bb5-63951c2ddb86 1073741824" returned: 0 in 0.714s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:31 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2158da5e-65d1-4f6c-a6b9-3132f20dc993 tempest-VolumesDeleteCascade-209937010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-34eacdcf-4fde-492d-8bb5-63951c2ddb86 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:31 devstack sudo[100131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-34eacdcf-4fde-492d-8bb5-63951c2ddb86 Aug 05 10:23:31 devstack sudo[100131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:32 devstack sudo[100131]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:32 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2158da5e-65d1-4f6c-a6b9-3132f20dc993 tempest-VolumesDeleteCascade-209937010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-34eacdcf-4fde-492d-8bb5-63951c2ddb86" returned: 0 in 0.281s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:32 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-2158da5e-65d1-4f6c-a6b9-3132f20dc993 tempest-VolumesDeleteCascade-209937010 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:23:32 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2158da5e-65d1-4f6c-a6b9-3132f20dc993 tempest-VolumesDeleteCascade-209937010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:23:32 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2158da5e-65d1-4f6c-a6b9-3132f20dc993 tempest-VolumesDeleteCascade-209937010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7db008b1-c6b5-4753-bf3b-94dd3a5d2741) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34eacdcf-4fde-492d-8bb5-63951c2ddb86', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:32 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2158da5e-65d1-4f6c-a6b9-3132f20dc993 tempest-VolumesDeleteCascade-209937010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d761af74-6dce-4cef-8b1a-09cdb5942b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:32 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-2158da5e-65d1-4f6c-a6b9-3132f20dc993 tempest-VolumesDeleteCascade-209937010 None] Volume volume-34eacdcf-4fde-492d-8bb5-63951c2ddb86 (34eacdcf-4fde-492d-8bb5-63951c2ddb86): created successfully Aug 05 10:23:32 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2158da5e-65d1-4f6c-a6b9-3132f20dc993 tempest-VolumesDeleteCascade-209937010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d761af74-6dce-4cef-8b1a-09cdb5942b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:32 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2158da5e-65d1-4f6c-a6b9-3132f20dc993 tempest-VolumesDeleteCascade-209937010 None] Flow 'volume_create_manager' (04b0565d-cf61-43a8-9a86-b89cdac3b8a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:23:32 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-2158da5e-65d1-4f6c-a6b9-3132f20dc993 tempest-VolumesDeleteCascade-209937010 None] Created volume successfully. Aug 05 10:23:33 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-ac16f27d-e5cf-4e40-a39e-32fd0e91052e tempest-VolumesDeleteCascade-209937010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:23:33 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-ac16f27d-e5cf-4e40-a39e-32fd0e91052e tempest-VolumesDeleteCascade-209937010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:23:33 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-ac16f27d-e5cf-4e40-a39e-32fd0e91052e tempest-VolumesDeleteCascade-209937010 None] Creating offline snapshot cb10bc45-296c-4714-bd13-59bbafb79014 of volume 34eacdcf-4fde-492d-8bb5-63951c2ddb86 {{(pid=88613) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:23:33 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[9972cd19-7dfb-4777-89dc-cc806712c1ad]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:23:33 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ac16f27d-e5cf-4e40-a39e-32fd0e91052e tempest-VolumesDeleteCascade-209937010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-34eacdcf-4fde-492d-8bb5-63951c2ddb86 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:33 devstack sudo[100138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-34eacdcf-4fde-492d-8bb5-63951c2ddb86 Aug 05 10:23:33 devstack sudo[100138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:33 devstack sudo[100138]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:33 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ac16f27d-e5cf-4e40-a39e-32fd0e91052e tempest-VolumesDeleteCascade-209937010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-34eacdcf-4fde-492d-8bb5-63951c2ddb86" returned: 0 in 0.463s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:33 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ac16f27d-e5cf-4e40-a39e-32fd0e91052e tempest-VolumesDeleteCascade-209937010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-34eacdcf-4fde-492d-8bb5-63951c2ddb86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-34eacdcf-4fde-492d-8bb5-63951c2ddb86.cb10bc45-296c-4714-bd13-59bbafb79014 1G {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:33 devstack sudo[100143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-34eacdcf-4fde-492d-8bb5-63951c2ddb86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-34eacdcf-4fde-492d-8bb5-63951c2ddb86.cb10bc45-296c-4714-bd13-59bbafb79014 1G Aug 05 10:23:33 devstack sudo[100143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:34 devstack sudo[100143]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:34 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ac16f27d-e5cf-4e40-a39e-32fd0e91052e tempest-VolumesDeleteCascade-209937010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-34eacdcf-4fde-492d-8bb5-63951c2ddb86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-34eacdcf-4fde-492d-8bb5-63951c2ddb86.cb10bc45-296c-4714-bd13-59bbafb79014 1G" returned: 0 in 0.507s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:34 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ac16f27d-e5cf-4e40-a39e-32fd0e91052e tempest-VolumesDeleteCascade-209937010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34eacdcf-4fde-492d-8bb5-63951c2ddb86 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-34eacdcf-4fde-492d-8bb5-63951c2ddb86.cb10bc45-296c-4714-bd13-59bbafb79014 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:34 devstack sudo[100151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34eacdcf-4fde-492d-8bb5-63951c2ddb86 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-34eacdcf-4fde-492d-8bb5-63951c2ddb86.cb10bc45-296c-4714-bd13-59bbafb79014 Aug 05 10:23:34 devstack sudo[100151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:34 devstack sudo[100151]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:34 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ac16f27d-e5cf-4e40-a39e-32fd0e91052e tempest-VolumesDeleteCascade-209937010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34eacdcf-4fde-492d-8bb5-63951c2ddb86 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-34eacdcf-4fde-492d-8bb5-63951c2ddb86.cb10bc45-296c-4714-bd13-59bbafb79014" returned: 0 in 0.435s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:34 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-ac16f27d-e5cf-4e40-a39e-32fd0e91052e tempest-VolumesDeleteCascade-209937010 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-34eacdcf-4fde-492d-8bb5-63951c2ddb86.cb10bc45-296c-4714-bd13-59bbafb79014 is being set with open permissions: ugo+rw Aug 05 10:23:34 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ac16f27d-e5cf-4e40-a39e-32fd0e91052e tempest-VolumesDeleteCascade-209937010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-34eacdcf-4fde-492d-8bb5-63951c2ddb86.cb10bc45-296c-4714-bd13-59bbafb79014 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:34 devstack sudo[100156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-34eacdcf-4fde-492d-8bb5-63951c2ddb86.cb10bc45-296c-4714-bd13-59bbafb79014 Aug 05 10:23:34 devstack sudo[100156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:35 devstack sudo[100156]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:35 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ac16f27d-e5cf-4e40-a39e-32fd0e91052e tempest-VolumesDeleteCascade-209937010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-34eacdcf-4fde-492d-8bb5-63951c2ddb86.cb10bc45-296c-4714-bd13-59bbafb79014" returned: 0 in 0.278s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:35 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ac16f27d-e5cf-4e40-a39e-32fd0e91052e tempest-VolumesDeleteCascade-209937010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-34eacdcf-4fde-492d-8bb5-63951c2ddb86.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:35 devstack sudo[100159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-34eacdcf-4fde-492d-8bb5-63951c2ddb86.info Aug 05 10:23:35 devstack sudo[100159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:35 devstack sudo[100159]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:35 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ac16f27d-e5cf-4e40-a39e-32fd0e91052e tempest-VolumesDeleteCascade-209937010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-34eacdcf-4fde-492d-8bb5-63951c2ddb86.info" returned: 0 in 0.294s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:35 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-ac16f27d-e5cf-4e40-a39e-32fd0e91052e tempest-VolumesDeleteCascade-209937010 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-34eacdcf-4fde-492d-8bb5-63951c2ddb86.info is being set with open permissions: ugo+rw Aug 05 10:23:35 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ac16f27d-e5cf-4e40-a39e-32fd0e91052e tempest-VolumesDeleteCascade-209937010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-34eacdcf-4fde-492d-8bb5-63951c2ddb86.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:35 devstack sudo[100162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-34eacdcf-4fde-492d-8bb5-63951c2ddb86.info Aug 05 10:23:35 devstack sudo[100162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:35 devstack sudo[100162]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:35 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ac16f27d-e5cf-4e40-a39e-32fd0e91052e tempest-VolumesDeleteCascade-209937010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-34eacdcf-4fde-492d-8bb5-63951c2ddb86.info" returned: 0 in 0.318s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:35 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-ac16f27d-e5cf-4e40-a39e-32fd0e91052e tempest-VolumesDeleteCascade-209937010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.436s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:23:35 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-ac16f27d-e5cf-4e40-a39e-32fd0e91052e tempest-VolumesDeleteCascade-209937010 None] Create snapshot completed successfully Aug 05 10:23:37 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e76fae3-bcc5-4899-8366-e213365e0cf3 tempest-VolumesDeleteCascade-209937010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:23:37 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1e76fae3-bcc5-4899-8366-e213365e0cf3 tempest-VolumesDeleteCascade-209937010 None] Flow 'volume_create_manager' (235c86cf-1736-4a20-82fa-08f3d093a65f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:23:37 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1e76fae3-bcc5-4899-8366-e213365e0cf3 tempest-VolumesDeleteCascade-209937010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecf2059d-af9d-470e-b813-c5d02271cf21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:37 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1e76fae3-bcc5-4899-8366-e213365e0cf3 tempest-VolumesDeleteCascade-209937010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecf2059d-af9d-470e-b813-c5d02271cf21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:23:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1003142981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c283b89f-6ca8-47d5-b986-92b8b6e7c7be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5eb090a71f14c278530d309ba2d85ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:23:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=cb10bc45-296c-4714-bd13-59bbafb79014,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:23:37Z,use_quota=True,user_id='bee3dc2926dc4e56acaa771d12c6ad8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:37 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1e76fae3-bcc5-4899-8366-e213365e0cf3 tempest-VolumesDeleteCascade-209937010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b7cd99a-c5e9-40c5-beb5-783d1a5d6086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:37 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1e76fae3-bcc5-4899-8366-e213365e0cf3 tempest-VolumesDeleteCascade-209937010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b7cd99a-c5e9-40c5-beb5-783d1a5d6086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:37 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1e76fae3-bcc5-4899-8366-e213365e0cf3 tempest-VolumesDeleteCascade-209937010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcd6d097-d00e-44d4-bd73-d9cdf5b90222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:37 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1e76fae3-bcc5-4899-8366-e213365e0cf3 tempest-VolumesDeleteCascade-209937010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcd6d097-d00e-44d4-bd73-d9cdf5b90222) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c283b89f-6ca8-47d5-b986-92b8b6e7c7be', 'volume_name': 'volume-c283b89f-6ca8-47d5-b986-92b8b6e7c7be', 'volume_size': 1, 'snapshot_id': 'cb10bc45-296c-4714-bd13-59bbafb79014'}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:37 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1e76fae3-bcc5-4899-8366-e213365e0cf3 tempest-VolumesDeleteCascade-209937010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28c39c68-8f42-4514-a0de-f86339213bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:37 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1e76fae3-bcc5-4899-8366-e213365e0cf3 tempest-VolumesDeleteCascade-209937010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28c39c68-8f42-4514-a0de-f86339213bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:37 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1e76fae3-bcc5-4899-8366-e213365e0cf3 tempest-VolumesDeleteCascade-209937010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b787af34-9d03-432f-89e7-6288156fb5a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:37 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-1e76fae3-bcc5-4899-8366-e213365e0cf3 tempest-VolumesDeleteCascade-209937010 None] Volume c283b89f-6ca8-47d5-b986-92b8b6e7c7be: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c283b89f-6ca8-47d5-b986-92b8b6e7c7be', 'volume_size': 1, 'snapshot_id': 'cb10bc45-296c-4714-bd13-59bbafb79014'} Aug 05 10:23:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-1e76fae3-bcc5-4899-8366-e213365e0cf3 tempest-VolumesDeleteCascade-209937010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:23:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-1e76fae3-bcc5-4899-8366-e213365e0cf3 tempest-VolumesDeleteCascade-209937010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:23:37 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-1e76fae3-bcc5-4899-8366-e213365e0cf3 tempest-VolumesDeleteCascade-209937010 None] Acquiring lock "cinder-quobyte-cb10bc45-296c-4714-bd13-59bbafb79014-c283b89f-6ca8-47d5-b986-92b8b6e7c7be" by "_create_volume_from_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:23:37 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-1e76fae3-bcc5-4899-8366-e213365e0cf3 tempest-VolumesDeleteCascade-209937010 None] Lock "cinder-quobyte-cb10bc45-296c-4714-bd13-59bbafb79014-c283b89f-6ca8-47d5-b986-92b8b6e7c7be" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:23:37 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-1e76fae3-bcc5-4899-8366-e213365e0cf3 tempest-VolumesDeleteCascade-209937010 None] Creating volume c283b89f-6ca8-47d5-b986-92b8b6e7c7be from snapshot cb10bc45-296c-4714-bd13-59bbafb79014 {{(pid=88613) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 05 10:23:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-1e76fae3-bcc5-4899-8366-e213365e0cf3 tempest-VolumesDeleteCascade-209937010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:23:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-1e76fae3-bcc5-4899-8366-e213365e0cf3 tempest-VolumesDeleteCascade-209937010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:23:37 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-1e76fae3-bcc5-4899-8366-e213365e0cf3 tempest-VolumesDeleteCascade-209937010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:23:37 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-1e76fae3-bcc5-4899-8366-e213365e0cf3 tempest-VolumesDeleteCascade-209937010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:23:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-1e76fae3-bcc5-4899-8366-e213365e0cf3 tempest-VolumesDeleteCascade-209937010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:23:37 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-1e76fae3-bcc5-4899-8366-e213365e0cf3 tempest-VolumesDeleteCascade-209937010 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:23:37 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-1e76fae3-bcc5-4899-8366-e213365e0cf3 tempest-VolumesDeleteCascade-209937010 None] Acquiring lock "cinder-quobyte-c283b89f-6ca8-47d5-b986-92b8b6e7c7be" by "_copy_volume_from_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:23:37 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-1e76fae3-bcc5-4899-8366-e213365e0cf3 tempest-VolumesDeleteCascade-209937010 None] Lock "cinder-quobyte-c283b89f-6ca8-47d5-b986-92b8b6e7c7be" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:23:37 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-1e76fae3-bcc5-4899-8366-e213365e0cf3 tempest-VolumesDeleteCascade-209937010 None] snapshot: cb10bc45-296c-4714-bd13-59bbafb79014, volume: c283b89f-6ca8-47d5-b986-92b8b6e7c7be, {{(pid=88613) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 05 10:23:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-1e76fae3-bcc5-4899-8366-e213365e0cf3 tempest-VolumesDeleteCascade-209937010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:23:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-1e76fae3-bcc5-4899-8366-e213365e0cf3 tempest-VolumesDeleteCascade-209937010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:23:37 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-1e76fae3-bcc5-4899-8366-e213365e0cf3 tempest-VolumesDeleteCascade-209937010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:23:37 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-1e76fae3-bcc5-4899-8366-e213365e0cf3 tempest-VolumesDeleteCascade-209937010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:23:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-1e76fae3-bcc5-4899-8366-e213365e0cf3 tempest-VolumesDeleteCascade-209937010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:23:37 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e20b5f-a4c8-43c2-902c-51cfbd171034]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:23:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1e76fae3-bcc5-4899-8366-e213365e0cf3 tempest-VolumesDeleteCascade-209937010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-34eacdcf-4fde-492d-8bb5-63951c2ddb86.cb10bc45-296c-4714-bd13-59bbafb79014 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:37 devstack sudo[100167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-34eacdcf-4fde-492d-8bb5-63951c2ddb86.cb10bc45-296c-4714-bd13-59bbafb79014 Aug 05 10:23:37 devstack sudo[100167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:38 devstack sudo[100167]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:38 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1e76fae3-bcc5-4899-8366-e213365e0cf3 tempest-VolumesDeleteCascade-209937010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-34eacdcf-4fde-492d-8bb5-63951c2ddb86.cb10bc45-296c-4714-bd13-59bbafb79014" returned: 0 in 0.615s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:38 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-1e76fae3-bcc5-4899-8366-e213365e0cf3 tempest-VolumesDeleteCascade-209937010 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34eacdcf-4fde-492d-8bb5-63951c2ddb86(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88613) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:23:38 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[1128d934-829b-40da-a94e-1f613224586b]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:23:38 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1e76fae3-bcc5-4899-8366-e213365e0cf3 tempest-VolumesDeleteCascade-209937010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-34eacdcf-4fde-492d-8bb5-63951c2ddb86 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:38 devstack sudo[100174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-34eacdcf-4fde-492d-8bb5-63951c2ddb86 Aug 05 10:23:38 devstack sudo[100174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:38 devstack sudo[100174]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:38 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1e76fae3-bcc5-4899-8366-e213365e0cf3 tempest-VolumesDeleteCascade-209937010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-34eacdcf-4fde-492d-8bb5-63951c2ddb86" returned: 0 in 0.553s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:38 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-1e76fae3-bcc5-4899-8366-e213365e0cf3 tempest-VolumesDeleteCascade-209937010 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-34eacdcf-4fde-492d-8bb5-63951c2ddb86 {{(pid=88613) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 05 10:23:38 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-1e76fae3-bcc5-4899-8366-e213365e0cf3 tempest-VolumesDeleteCascade-209937010 None] Creating direct copy from snapshot {{(pid=88613) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 05 10:23:38 devstack cinder-volume[88613]: DEBUG cinder.utils [None req-1e76fae3-bcc5-4899-8366-e213365e0cf3 tempest-VolumesDeleteCascade-209937010 None] Path /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-c283b89f-6ca8-47d5-b986-92b8b6e7c7be not found in is_blk_device check {{(pid=88613) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 05 10:23:38 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1e76fae3-bcc5-4899-8366-e213365e0cf3 tempest-VolumesDeleteCascade-209937010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-34eacdcf-4fde-492d-8bb5-63951c2ddb86 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-c283b89f-6ca8-47d5-b986-92b8b6e7c7be {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:38 devstack sudo[100179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-34eacdcf-4fde-492d-8bb5-63951c2ddb86 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-c283b89f-6ca8-47d5-b986-92b8b6e7c7be Aug 05 10:23:38 devstack sudo[100179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:44 devstack sudo[100179]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1e76fae3-bcc5-4899-8366-e213365e0cf3 tempest-VolumesDeleteCascade-209937010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-34eacdcf-4fde-492d-8bb5-63951c2ddb86 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-c283b89f-6ca8-47d5-b986-92b8b6e7c7be" returned: 0 in 6.104s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:44 devstack cinder-volume[88613]: DEBUG cinder.image.image_utils [None req-1e76fae3-bcc5-4899-8366-e213365e0cf3 tempest-VolumesDeleteCascade-209937010 None] Image conversion details: src /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-34eacdcf-4fde-492d-8bb5-63951c2ddb86, size 1024.00 MB, duration 6.11 sec, destination /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-c283b89f-6ca8-47d5-b986-92b8b6e7c7be {{(pid=88613) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 10:23:44 devstack cinder-volume[88613]: INFO cinder.image.image_utils [None req-1e76fae3-bcc5-4899-8366-e213365e0cf3 tempest-VolumesDeleteCascade-209937010 None] Converted 1024.00 MB image at 167.63 MB/s Aug 05 10:23:44 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-1e76fae3-bcc5-4899-8366-e213365e0cf3 tempest-VolumesDeleteCascade-209937010 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-c283b89f-6ca8-47d5-b986-92b8b6e7c7be is being set with open permissions: ugo+rw Aug 05 10:23:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1e76fae3-bcc5-4899-8366-e213365e0cf3 tempest-VolumesDeleteCascade-209937010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-c283b89f-6ca8-47d5-b986-92b8b6e7c7be {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:44 devstack sudo[100194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-c283b89f-6ca8-47d5-b986-92b8b6e7c7be Aug 05 10:23:44 devstack sudo[100194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:45 devstack sudo[100194]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:45 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1e76fae3-bcc5-4899-8366-e213365e0cf3 tempest-VolumesDeleteCascade-209937010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-c283b89f-6ca8-47d5-b986-92b8b6e7c7be" returned: 0 in 0.364s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:45 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-1e76fae3-bcc5-4899-8366-e213365e0cf3 tempest-VolumesDeleteCascade-209937010 None] Lock "cinder-quobyte-c283b89f-6ca8-47d5-b986-92b8b6e7c7be" released by "_copy_volume_from_snapshot" :: held 7.803s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:23:45 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-1e76fae3-bcc5-4899-8366-e213365e0cf3 tempest-VolumesDeleteCascade-209937010 None] Lock "cinder-quobyte-cb10bc45-296c-4714-bd13-59bbafb79014-c283b89f-6ca8-47d5-b986-92b8b6e7c7be" released by "_create_volume_from_snapshot" :: held 7.883s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:23:45 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-1e76fae3-bcc5-4899-8366-e213365e0cf3 tempest-VolumesDeleteCascade-209937010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.902s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:23:45 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1e76fae3-bcc5-4899-8366-e213365e0cf3 tempest-VolumesDeleteCascade-209937010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b787af34-9d03-432f-89e7-6288156fb5a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c283b89f-6ca8-47d5-b986-92b8b6e7c7be', 'volume_size': 1, 'snapshot_id': 'cb10bc45-296c-4714-bd13-59bbafb79014'}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:45 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1e76fae3-bcc5-4899-8366-e213365e0cf3 tempest-VolumesDeleteCascade-209937010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7034646f-0d2d-48c0-bde4-1be3fbd7943f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:45 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-1e76fae3-bcc5-4899-8366-e213365e0cf3 tempest-VolumesDeleteCascade-209937010 None] Volume volume-c283b89f-6ca8-47d5-b986-92b8b6e7c7be (c283b89f-6ca8-47d5-b986-92b8b6e7c7be): created successfully Aug 05 10:23:45 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1e76fae3-bcc5-4899-8366-e213365e0cf3 tempest-VolumesDeleteCascade-209937010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7034646f-0d2d-48c0-bde4-1be3fbd7943f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:45 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1e76fae3-bcc5-4899-8366-e213365e0cf3 tempest-VolumesDeleteCascade-209937010 None] Flow 'volume_create_manager' (235c86cf-1736-4a20-82fa-08f3d093a65f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:23:45 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-1e76fae3-bcc5-4899-8366-e213365e0cf3 tempest-VolumesDeleteCascade-209937010 None] Created volume successfully. Aug 05 10:23:46 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-4b42024a-9ce0-4ff0-8d0f-7070a3a2f452 tempest-VolumesDeleteCascade-209937010 None] Acquiring lock "cinder-34eacdcf-4fde-492d-8bb5-63951c2ddb86-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:23:46 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-4b42024a-9ce0-4ff0-8d0f-7070a3a2f452 tempest-VolumesDeleteCascade-209937010 None] Lock "cinder-34eacdcf-4fde-492d-8bb5-63951c2ddb86-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:23:46 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-4b42024a-9ce0-4ff0-8d0f-7070a3a2f452 tempest-VolumesDeleteCascade-209937010 None] Performing cascade delete. {{(pid=88613) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Aug 05 10:23:46 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-4b42024a-9ce0-4ff0-8d0f-7070a3a2f452 tempest-VolumesDeleteCascade-209937010 None] Acquiring lock "cinder-cb10bc45-296c-4714-bd13-59bbafb79014-delete_snapshot" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:23:46 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-4b42024a-9ce0-4ff0-8d0f-7070a3a2f452 tempest-VolumesDeleteCascade-209937010 None] Lock "cinder-cb10bc45-296c-4714-bd13-59bbafb79014-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:23:46 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-4b42024a-9ce0-4ff0-8d0f-7070a3a2f452 tempest-VolumesDeleteCascade-209937010 None] Acquiring lock "cinder-quobyte-34eacdcf-4fde-492d-8bb5-63951c2ddb86" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:23:46 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-4b42024a-9ce0-4ff0-8d0f-7070a3a2f452 tempest-VolumesDeleteCascade-209937010 None] Lock "cinder-quobyte-34eacdcf-4fde-492d-8bb5-63951c2ddb86" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:23:46 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-4b42024a-9ce0-4ff0-8d0f-7070a3a2f452 tempest-VolumesDeleteCascade-209937010 None] Acquiring lock "cinder-quobyte-cb10bc45-296c-4714-bd13-59bbafb79014" by "_delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:23:46 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-4b42024a-9ce0-4ff0-8d0f-7070a3a2f452 tempest-VolumesDeleteCascade-209937010 None] Lock "cinder-quobyte-cb10bc45-296c-4714-bd13-59bbafb79014" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:23:46 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-4b42024a-9ce0-4ff0-8d0f-7070a3a2f452 tempest-VolumesDeleteCascade-209937010 None] Deleting offline snapshot cb10bc45-296c-4714-bd13-59bbafb79014 of volume 34eacdcf-4fde-492d-8bb5-63951c2ddb86 {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:23:46 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-4b42024a-9ce0-4ff0-8d0f-7070a3a2f452 tempest-VolumesDeleteCascade-209937010 None] snapshot_file for this snap is: volume-34eacdcf-4fde-492d-8bb5-63951c2ddb86.cb10bc45-296c-4714-bd13-59bbafb79014 {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:23:46 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2096a2f-7691-4332-b22b-3d63f4c58f05]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:23:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4b42024a-9ce0-4ff0-8d0f-7070a3a2f452 tempest-VolumesDeleteCascade-209937010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-34eacdcf-4fde-492d-8bb5-63951c2ddb86.cb10bc45-296c-4714-bd13-59bbafb79014 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:46 devstack sudo[100197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-34eacdcf-4fde-492d-8bb5-63951c2ddb86.cb10bc45-296c-4714-bd13-59bbafb79014 Aug 05 10:23:46 devstack sudo[100197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:47 devstack sudo[100197]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:47 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4b42024a-9ce0-4ff0-8d0f-7070a3a2f452 tempest-VolumesDeleteCascade-209937010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-34eacdcf-4fde-492d-8bb5-63951c2ddb86.cb10bc45-296c-4714-bd13-59bbafb79014" returned: 0 in 0.433s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:47 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-4b42024a-9ce0-4ff0-8d0f-7070a3a2f452 tempest-VolumesDeleteCascade-209937010 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34eacdcf-4fde-492d-8bb5-63951c2ddb86(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88613) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:23:47 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb28f909-f0db-49d8-8aa3-3ab2eec0fc45]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:23:47 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4b42024a-9ce0-4ff0-8d0f-7070a3a2f452 tempest-VolumesDeleteCascade-209937010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-34eacdcf-4fde-492d-8bb5-63951c2ddb86 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:47 devstack sudo[100202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-34eacdcf-4fde-492d-8bb5-63951c2ddb86 Aug 05 10:23:47 devstack sudo[100202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:47 devstack sudo[100202]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:47 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4b42024a-9ce0-4ff0-8d0f-7070a3a2f452 tempest-VolumesDeleteCascade-209937010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-34eacdcf-4fde-492d-8bb5-63951c2ddb86" returned: 0 in 0.599s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:47 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4b42024a-9ce0-4ff0-8d0f-7070a3a2f452 tempest-VolumesDeleteCascade-209937010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-34eacdcf-4fde-492d-8bb5-63951c2ddb86.cb10bc45-296c-4714-bd13-59bbafb79014 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:47 devstack sudo[100207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-34eacdcf-4fde-492d-8bb5-63951c2ddb86.cb10bc45-296c-4714-bd13-59bbafb79014 Aug 05 10:23:47 devstack sudo[100207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:48 devstack sudo[100207]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:48 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4b42024a-9ce0-4ff0-8d0f-7070a3a2f452 tempest-VolumesDeleteCascade-209937010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-34eacdcf-4fde-492d-8bb5-63951c2ddb86.cb10bc45-296c-4714-bd13-59bbafb79014" returned: 0 in 0.391s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:48 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4b42024a-9ce0-4ff0-8d0f-7070a3a2f452 tempest-VolumesDeleteCascade-209937010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-34eacdcf-4fde-492d-8bb5-63951c2ddb86.cb10bc45-296c-4714-bd13-59bbafb79014 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:48 devstack sudo[100213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-34eacdcf-4fde-492d-8bb5-63951c2ddb86.cb10bc45-296c-4714-bd13-59bbafb79014 Aug 05 10:23:48 devstack sudo[100213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:48 devstack sudo[100213]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:48 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4b42024a-9ce0-4ff0-8d0f-7070a3a2f452 tempest-VolumesDeleteCascade-209937010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-34eacdcf-4fde-492d-8bb5-63951c2ddb86.cb10bc45-296c-4714-bd13-59bbafb79014" returned: 0 in 0.375s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:48 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-4b42024a-9ce0-4ff0-8d0f-7070a3a2f452 tempest-VolumesDeleteCascade-209937010 None] Lock "cinder-quobyte-cb10bc45-296c-4714-bd13-59bbafb79014" released by "_delete_snapshot" :: held 1.922s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:23:48 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-4b42024a-9ce0-4ff0-8d0f-7070a3a2f452 tempest-VolumesDeleteCascade-209937010 None] Lock "cinder-quobyte-34eacdcf-4fde-492d-8bb5-63951c2ddb86" released by "delete_snapshot" :: held 1.953s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:23:48 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-4b42024a-9ce0-4ff0-8d0f-7070a3a2f452 tempest-VolumesDeleteCascade-209937010 None] Created reservations ['6524de52-468d-4068-a3d9-d8afeec431ae', '0d003018-0875-4eaf-a7a6-93e87c4c0bab', '37912dd3-534d-48ac-855c-eb99aded5eff', '35587227-7497-48f0-ad39-fc7ddf5c6467'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:23:48 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-4b42024a-9ce0-4ff0-8d0f-7070a3a2f452 tempest-VolumesDeleteCascade-209937010 None] Delete snapshot completed successfully. Aug 05 10:23:48 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-4b42024a-9ce0-4ff0-8d0f-7070a3a2f452 tempest-VolumesDeleteCascade-209937010 None] Lock "cinder-cb10bc45-296c-4714-bd13-59bbafb79014-delete_snapshot" released by "delete_snapshot" :: held 2.142s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:23:48 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-4b42024a-9ce0-4ff0-8d0f-7070a3a2f452 tempest-VolumesDeleteCascade-209937010 None] Snapshots deleted, issuing volume delete {{(pid=88613) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Aug 05 10:23:48 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-4b42024a-9ce0-4ff0-8d0f-7070a3a2f452 tempest-VolumesDeleteCascade-209937010 None] Acquiring lock "cinder-quobyte-34eacdcf-4fde-492d-8bb5-63951c2ddb86" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:23:48 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-4b42024a-9ce0-4ff0-8d0f-7070a3a2f452 tempest-VolumesDeleteCascade-209937010 None] Lock "cinder-quobyte-34eacdcf-4fde-492d-8bb5-63951c2ddb86" acquired by "delete_volume" :: waited 0.032s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:23:48 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[392cbe39-0339-43e7-94a3-2d39737a4c7f]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:23:48 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4b42024a-9ce0-4ff0-8d0f-7070a3a2f452 tempest-VolumesDeleteCascade-209937010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-34eacdcf-4fde-492d-8bb5-63951c2ddb86 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:48 devstack sudo[100216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-34eacdcf-4fde-492d-8bb5-63951c2ddb86 Aug 05 10:23:48 devstack sudo[100216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:49 devstack sudo[100216]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4b42024a-9ce0-4ff0-8d0f-7070a3a2f452 tempest-VolumesDeleteCascade-209937010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-34eacdcf-4fde-492d-8bb5-63951c2ddb86" returned: 0 in 0.417s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4b42024a-9ce0-4ff0-8d0f-7070a3a2f452 tempest-VolumesDeleteCascade-209937010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-34eacdcf-4fde-492d-8bb5-63951c2ddb86 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:49 devstack sudo[100221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-34eacdcf-4fde-492d-8bb5-63951c2ddb86 Aug 05 10:23:49 devstack sudo[100221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:49 devstack sudo[100221]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4b42024a-9ce0-4ff0-8d0f-7070a3a2f452 tempest-VolumesDeleteCascade-209937010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-34eacdcf-4fde-492d-8bb5-63951c2ddb86" returned: 0 in 0.350s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:49 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-4b42024a-9ce0-4ff0-8d0f-7070a3a2f452 tempest-VolumesDeleteCascade-209937010 None] Lock "cinder-quobyte-34eacdcf-4fde-492d-8bb5-63951c2ddb86" released by "delete_volume" :: held 0.858s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:23:49 devstack cinder-volume[88613]: DEBUG dbcounter [-] [88613] Writing DB stats cinder:SELECT=153,cinder:INSERT=58,cinder:UPDATE=188,cinder:DELETE=13 {{(pid=88613) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:23:49 devstack cinder-volume[88613]: DEBUG dbcounter [-] [88613] Writing DB stats cinder:UPDATE=204,cinder:SELECT=169,cinder:DELETE=20,cinder:INSERT=37 {{(pid=88613) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:23:49 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-4b42024a-9ce0-4ff0-8d0f-7070a3a2f452 tempest-VolumesDeleteCascade-209937010 None] Created reservations ['2493b67c-f56e-4b9f-a8f3-4e95c8fa51e5', '33b6c666-8797-4b52-b6be-06bd382a0006', 'def52ec0-7ef1-4408-a13f-9f4be647ec18', '3695daf9-bd70-4588-b83d-b4f1d78bea9c'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:23:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-4b42024a-9ce0-4ff0-8d0f-7070a3a2f452 tempest-VolumesDeleteCascade-209937010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:23:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-4b42024a-9ce0-4ff0-8d0f-7070a3a2f452 tempest-VolumesDeleteCascade-209937010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:23:49 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-4b42024a-9ce0-4ff0-8d0f-7070a3a2f452 tempest-VolumesDeleteCascade-209937010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:23:49 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-4b42024a-9ce0-4ff0-8d0f-7070a3a2f452 tempest-VolumesDeleteCascade-209937010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:23:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-4b42024a-9ce0-4ff0-8d0f-7070a3a2f452 tempest-VolumesDeleteCascade-209937010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:23:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4b42024a-9ce0-4ff0-8d0f-7070a3a2f452 tempest-VolumesDeleteCascade-209937010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:49 devstack sudo[100224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:23:49 devstack sudo[100224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:49 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-38861b1e-f5e4-422b-9ada-f22ad302fb26 tempest-VolumesDeleteCascade-209937010 None] Acquiring lock "cinder-c283b89f-6ca8-47d5-b986-92b8b6e7c7be-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:23:49 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-38861b1e-f5e4-422b-9ada-f22ad302fb26 tempest-VolumesDeleteCascade-209937010 None] Lock "cinder-c283b89f-6ca8-47d5-b986-92b8b6e7c7be-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:23:50 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-38861b1e-f5e4-422b-9ada-f22ad302fb26 tempest-VolumesDeleteCascade-209937010 None] Acquiring lock "cinder-quobyte-c283b89f-6ca8-47d5-b986-92b8b6e7c7be" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:23:50 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-38861b1e-f5e4-422b-9ada-f22ad302fb26 tempest-VolumesDeleteCascade-209937010 None] Lock "cinder-quobyte-c283b89f-6ca8-47d5-b986-92b8b6e7c7be" acquired by "delete_volume" :: waited 0.026s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:23:50 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[614bc0e1-92c4-4e93-9cfa-219af0f2ca8e]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:23:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-38861b1e-f5e4-422b-9ada-f22ad302fb26 tempest-VolumesDeleteCascade-209937010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-c283b89f-6ca8-47d5-b986-92b8b6e7c7be {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:50 devstack sudo[100224]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4b42024a-9ce0-4ff0-8d0f-7070a3a2f452 tempest-VolumesDeleteCascade-209937010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.401s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:50 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-4b42024a-9ce0-4ff0-8d0f-7070a3a2f452 tempest-VolumesDeleteCascade-209937010 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:23:50 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-4b42024a-9ce0-4ff0-8d0f-7070a3a2f452 tempest-VolumesDeleteCascade-209937010 None] Deleted volume successfully. Aug 05 10:23:50 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-4b42024a-9ce0-4ff0-8d0f-7070a3a2f452 tempest-VolumesDeleteCascade-209937010 None] Lock "cinder-34eacdcf-4fde-492d-8bb5-63951c2ddb86-delete_volume" released by "delete_volume" :: held 3.734s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:23:50 devstack sudo[100227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-c283b89f-6ca8-47d5-b986-92b8b6e7c7be Aug 05 10:23:50 devstack sudo[100227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:50 devstack sudo[100227]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-38861b1e-f5e4-422b-9ada-f22ad302fb26 tempest-VolumesDeleteCascade-209937010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-c283b89f-6ca8-47d5-b986-92b8b6e7c7be" returned: 0 in 0.503s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-38861b1e-f5e4-422b-9ada-f22ad302fb26 tempest-VolumesDeleteCascade-209937010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-c283b89f-6ca8-47d5-b986-92b8b6e7c7be {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:50 devstack sudo[100233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-c283b89f-6ca8-47d5-b986-92b8b6e7c7be Aug 05 10:23:50 devstack sudo[100233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:50 devstack sudo[100233]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-38861b1e-f5e4-422b-9ada-f22ad302fb26 tempest-VolumesDeleteCascade-209937010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-c283b89f-6ca8-47d5-b986-92b8b6e7c7be" returned: 0 in 0.307s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:50 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-38861b1e-f5e4-422b-9ada-f22ad302fb26 tempest-VolumesDeleteCascade-209937010 None] Lock "cinder-quobyte-c283b89f-6ca8-47d5-b986-92b8b6e7c7be" released by "delete_volume" :: held 0.880s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:23:51 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-38861b1e-f5e4-422b-9ada-f22ad302fb26 tempest-VolumesDeleteCascade-209937010 None] Created reservations ['e564a4c8-9d81-4e87-b0f5-f07798a46e0b', '6dac4aa6-63ac-41db-bd68-be9c52602f8a', 'c8e4f702-59e7-469d-a565-e15b11ba9ab0', '0ca905df-6ada-46e6-98f5-7fa512549f71'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:23:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-38861b1e-f5e4-422b-9ada-f22ad302fb26 tempest-VolumesDeleteCascade-209937010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:23:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-38861b1e-f5e4-422b-9ada-f22ad302fb26 tempest-VolumesDeleteCascade-209937010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:23:51 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-38861b1e-f5e4-422b-9ada-f22ad302fb26 tempest-VolumesDeleteCascade-209937010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:23:51 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-38861b1e-f5e4-422b-9ada-f22ad302fb26 tempest-VolumesDeleteCascade-209937010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:23:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-38861b1e-f5e4-422b-9ada-f22ad302fb26 tempest-VolumesDeleteCascade-209937010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:23:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-38861b1e-f5e4-422b-9ada-f22ad302fb26 tempest-VolumesDeleteCascade-209937010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:51 devstack sudo[100236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:23:51 devstack sudo[100236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:51 devstack sudo[100236]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-38861b1e-f5e4-422b-9ada-f22ad302fb26 tempest-VolumesDeleteCascade-209937010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.412s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:51 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-38861b1e-f5e4-422b-9ada-f22ad302fb26 tempest-VolumesDeleteCascade-209937010 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:23:51 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-38861b1e-f5e4-422b-9ada-f22ad302fb26 tempest-VolumesDeleteCascade-209937010 None] Deleted volume successfully. Aug 05 10:23:51 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-38861b1e-f5e4-422b-9ada-f22ad302fb26 tempest-VolumesDeleteCascade-209937010 None] Lock "cinder-c283b89f-6ca8-47d5-b986-92b8b6e7c7be-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:23:53 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-c832a27d-68e3-4e69-a3f0-c20d806067af tempest-VolumesCloneTest-1094391728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:23:53 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c832a27d-68e3-4e69-a3f0-c20d806067af tempest-VolumesCloneTest-1094391728 None] Flow 'volume_create_manager' (e71109f3-1b55-4946-8a4e-0e62c278fa6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:23:53 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c832a27d-68e3-4e69-a3f0-c20d806067af tempest-VolumesCloneTest-1094391728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ea76de3-5dea-417a-898b-2040918378ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:53 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c832a27d-68e3-4e69-a3f0-c20d806067af tempest-VolumesCloneTest-1094391728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ea76de3-5dea-417a-898b-2040918378ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:23:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1863387018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a074f852-e545-423a-8786-f0567fbaccf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1358992dfb434701b053586a92d6b1f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:23:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:23:53Z,use_quota=True,user_id='fb99d7ca844f4a2b8c33ec8f720de50a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:53 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c832a27d-68e3-4e69-a3f0-c20d806067af tempest-VolumesCloneTest-1094391728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cfb2e20-5f1b-4d71-b7e7-c44c37b41e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:53 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c832a27d-68e3-4e69-a3f0-c20d806067af tempest-VolumesCloneTest-1094391728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cfb2e20-5f1b-4d71-b7e7-c44c37b41e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:53 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c832a27d-68e3-4e69-a3f0-c20d806067af tempest-VolumesCloneTest-1094391728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c253a47b-cd6f-465a-bd2c-78f0710e66e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:53 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c832a27d-68e3-4e69-a3f0-c20d806067af tempest-VolumesCloneTest-1094391728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c253a47b-cd6f-465a-bd2c-78f0710e66e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a074f852-e545-423a-8786-f0567fbaccf5', 'volume_name': 'volume-a074f852-e545-423a-8786-f0567fbaccf5', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:53 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c832a27d-68e3-4e69-a3f0-c20d806067af tempest-VolumesCloneTest-1094391728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acad6afe-f69b-47b1-83cd-e7b67f844d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:53 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c832a27d-68e3-4e69-a3f0-c20d806067af tempest-VolumesCloneTest-1094391728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acad6afe-f69b-47b1-83cd-e7b67f844d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:53 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c832a27d-68e3-4e69-a3f0-c20d806067af tempest-VolumesCloneTest-1094391728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7190605-b2a5-42fc-b46f-85614cd9d4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:53 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-c832a27d-68e3-4e69-a3f0-c20d806067af tempest-VolumesCloneTest-1094391728 None] Volume a074f852-e545-423a-8786-f0567fbaccf5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a074f852-e545-423a-8786-f0567fbaccf5', 'volume_size': 1} Aug 05 10:23:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c832a27d-68e3-4e69-a3f0-c20d806067af tempest-VolumesCloneTest-1094391728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:23:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c832a27d-68e3-4e69-a3f0-c20d806067af tempest-VolumesCloneTest-1094391728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:23:53 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-c832a27d-68e3-4e69-a3f0-c20d806067af tempest-VolumesCloneTest-1094391728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:23:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1863387018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a074f852-e545-423a-8786-f0567fbaccf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1358992dfb434701b053586a92d6b1f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:23:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:23:53Z,use_quota=True,user_id='fb99d7ca844f4a2b8c33ec8f720de50a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:23:53 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-c832a27d-68e3-4e69-a3f0-c20d806067af tempest-VolumesCloneTest-1094391728 None] Creating volume a074f852-e545-423a-8786-f0567fbaccf5 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:23:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c832a27d-68e3-4e69-a3f0-c20d806067af tempest-VolumesCloneTest-1094391728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:23:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c832a27d-68e3-4e69-a3f0-c20d806067af tempest-VolumesCloneTest-1094391728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:23:53 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-c832a27d-68e3-4e69-a3f0-c20d806067af tempest-VolumesCloneTest-1094391728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:23:53 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-c832a27d-68e3-4e69-a3f0-c20d806067af tempest-VolumesCloneTest-1094391728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:23:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c832a27d-68e3-4e69-a3f0-c20d806067af tempest-VolumesCloneTest-1094391728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:23:53 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-c832a27d-68e3-4e69-a3f0-c20d806067af tempest-VolumesCloneTest-1094391728 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:23:53 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-c832a27d-68e3-4e69-a3f0-c20d806067af tempest-VolumesCloneTest-1094391728 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:23:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c832a27d-68e3-4e69-a3f0-c20d806067af tempest-VolumesCloneTest-1094391728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a074f852-e545-423a-8786-f0567fbaccf5 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:53 devstack sudo[100253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a074f852-e545-423a-8786-f0567fbaccf5 1073741824 Aug 05 10:23:53 devstack sudo[100253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:53 devstack sudo[100253]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c832a27d-68e3-4e69-a3f0-c20d806067af tempest-VolumesCloneTest-1094391728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a074f852-e545-423a-8786-f0567fbaccf5 1073741824" returned: 0 in 0.535s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c832a27d-68e3-4e69-a3f0-c20d806067af tempest-VolumesCloneTest-1094391728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a074f852-e545-423a-8786-f0567fbaccf5 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:53 devstack sudo[100280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a074f852-e545-423a-8786-f0567fbaccf5 Aug 05 10:23:53 devstack sudo[100280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:54 devstack sudo[100280]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c832a27d-68e3-4e69-a3f0-c20d806067af tempest-VolumesCloneTest-1094391728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a074f852-e545-423a-8786-f0567fbaccf5" returned: 0 in 0.398s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:54 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-c832a27d-68e3-4e69-a3f0-c20d806067af tempest-VolumesCloneTest-1094391728 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:23:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c832a27d-68e3-4e69-a3f0-c20d806067af tempest-VolumesCloneTest-1094391728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:23:54 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c832a27d-68e3-4e69-a3f0-c20d806067af tempest-VolumesCloneTest-1094391728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7190605-b2a5-42fc-b46f-85614cd9d4f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a074f852-e545-423a-8786-f0567fbaccf5', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:54 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c832a27d-68e3-4e69-a3f0-c20d806067af tempest-VolumesCloneTest-1094391728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09443217-5efa-4722-8ab6-4556fc114598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:54 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-c832a27d-68e3-4e69-a3f0-c20d806067af tempest-VolumesCloneTest-1094391728 None] Volume volume-a074f852-e545-423a-8786-f0567fbaccf5 (a074f852-e545-423a-8786-f0567fbaccf5): created successfully Aug 05 10:23:54 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c832a27d-68e3-4e69-a3f0-c20d806067af tempest-VolumesCloneTest-1094391728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09443217-5efa-4722-8ab6-4556fc114598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:54 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c832a27d-68e3-4e69-a3f0-c20d806067af tempest-VolumesCloneTest-1094391728 None] Flow 'volume_create_manager' (e71109f3-1b55-4946-8a4e-0e62c278fa6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:23:54 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-c832a27d-68e3-4e69-a3f0-c20d806067af tempest-VolumesCloneTest-1094391728 None] Created volume successfully. Aug 05 10:23:55 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-84d0078a-8b72-4b8b-a14a-181ab242eede tempest-VolumesCloneTest-1094391728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:23:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-84d0078a-8b72-4b8b-a14a-181ab242eede tempest-VolumesCloneTest-1094391728 None] Flow 'volume_create_manager' (4f6b9513-a09f-467e-84a9-e2f9add507a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:23:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-84d0078a-8b72-4b8b-a14a-181ab242eede tempest-VolumesCloneTest-1094391728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09b713bb-ee7e-4cdd-a076-3d10dbecf0fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-84d0078a-8b72-4b8b-a14a-181ab242eede tempest-VolumesCloneTest-1094391728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09b713bb-ee7e-4cdd-a076-3d10dbecf0fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:23:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-775353293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=903011ec-c71d-40ae-b4de-584bb92b6390,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1358992dfb434701b053586a92d6b1f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:23:56Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=a074f852-e545-423a-8786-f0567fbaccf5,status='creating',terminated_at=None,updated_at=2026-08-05T08:23:56Z,use_quota=True,user_id='fb99d7ca844f4a2b8c33ec8f720de50a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-84d0078a-8b72-4b8b-a14a-181ab242eede tempest-VolumesCloneTest-1094391728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (915949cc-4727-47ad-b38f-aa270dd01677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-84d0078a-8b72-4b8b-a14a-181ab242eede tempest-VolumesCloneTest-1094391728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (915949cc-4727-47ad-b38f-aa270dd01677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-84d0078a-8b72-4b8b-a14a-181ab242eede tempest-VolumesCloneTest-1094391728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9aead24c-4466-4c82-af56-aa743a224ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-84d0078a-8b72-4b8b-a14a-181ab242eede tempest-VolumesCloneTest-1094391728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9aead24c-4466-4c82-af56-aa743a224ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '903011ec-c71d-40ae-b4de-584bb92b6390', 'volume_name': 'volume-903011ec-c71d-40ae-b4de-584bb92b6390', 'volume_size': 2, 'source_volid': 'a074f852-e545-423a-8786-f0567fbaccf5', 'source_volstatus': 'available'}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-84d0078a-8b72-4b8b-a14a-181ab242eede tempest-VolumesCloneTest-1094391728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (694c9ce7-0450-43e3-a8c8-3d546e0b4491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-84d0078a-8b72-4b8b-a14a-181ab242eede tempest-VolumesCloneTest-1094391728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (694c9ce7-0450-43e3-a8c8-3d546e0b4491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-84d0078a-8b72-4b8b-a14a-181ab242eede tempest-VolumesCloneTest-1094391728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4433977a-b25a-4db5-b986-fbb85c8015b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:56 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-84d0078a-8b72-4b8b-a14a-181ab242eede tempest-VolumesCloneTest-1094391728 None] Volume 903011ec-c71d-40ae-b4de-584bb92b6390: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-903011ec-c71d-40ae-b4de-584bb92b6390', 'volume_size': 2, 'source_volid': 'a074f852-e545-423a-8786-f0567fbaccf5', 'source_volstatus': 'available'} Aug 05 10:23:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-84d0078a-8b72-4b8b-a14a-181ab242eede tempest-VolumesCloneTest-1094391728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:23:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-84d0078a-8b72-4b8b-a14a-181ab242eede tempest-VolumesCloneTest-1094391728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:23:56 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-84d0078a-8b72-4b8b-a14a-181ab242eede tempest-VolumesCloneTest-1094391728 None] Cloning volume a074f852-e545-423a-8786-f0567fbaccf5 to volume 903011ec-c71d-40ae-b4de-584bb92b6390 Aug 05 10:23:56 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-84d0078a-8b72-4b8b-a14a-181ab242eede tempest-VolumesCloneTest-1094391728 None] Creating offline snapshot cb75f5c3-2054-4416-8cbe-4f481aa1ee18 of volume a074f852-e545-423a-8786-f0567fbaccf5 {{(pid=88613) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:23:56 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd4cab23-763e-40d9-9057-a01ea23eb52b]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:23:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-84d0078a-8b72-4b8b-a14a-181ab242eede tempest-VolumesCloneTest-1094391728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a074f852-e545-423a-8786-f0567fbaccf5 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:56 devstack sudo[100285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a074f852-e545-423a-8786-f0567fbaccf5 Aug 05 10:23:56 devstack sudo[100285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:56 devstack sudo[100285]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-84d0078a-8b72-4b8b-a14a-181ab242eede tempest-VolumesCloneTest-1094391728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a074f852-e545-423a-8786-f0567fbaccf5" returned: 0 in 0.561s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-84d0078a-8b72-4b8b-a14a-181ab242eede tempest-VolumesCloneTest-1094391728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a074f852-e545-423a-8786-f0567fbaccf5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a074f852-e545-423a-8786-f0567fbaccf5.cb75f5c3-2054-4416-8cbe-4f481aa1ee18 1G {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:56 devstack sudo[100290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a074f852-e545-423a-8786-f0567fbaccf5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a074f852-e545-423a-8786-f0567fbaccf5.cb75f5c3-2054-4416-8cbe-4f481aa1ee18 1G Aug 05 10:23:56 devstack sudo[100290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:57 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-1eb142c0-b756-46ca-af6a-493c213ba8d1 tempest-VolumesActionsTest-508274144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:23:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1eb142c0-b756-46ca-af6a-493c213ba8d1 tempest-VolumesActionsTest-508274144 None] Flow 'volume_create_manager' (8423df9c-0f5c-4d90-8e03-1d2e4d172ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:23:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1eb142c0-b756-46ca-af6a-493c213ba8d1 tempest-VolumesActionsTest-508274144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3181f7b-0291-496f-b7b1-7fe0ac75cd2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1eb142c0-b756-46ca-af6a-493c213ba8d1 tempest-VolumesActionsTest-508274144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3181f7b-0291-496f-b7b1-7fe0ac75cd2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:23:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1349091057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce011fe7-2b40-453b-9a5f-a8f03f3662d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cf93a39567d4267a465652c8215f69f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:23:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:23:57Z,use_quota=True,user_id='c08941f3ffc5447c9fbcda8fb2dd2db8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1eb142c0-b756-46ca-af6a-493c213ba8d1 tempest-VolumesActionsTest-508274144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50fec3f1-07db-41a0-a218-967e8f796603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1eb142c0-b756-46ca-af6a-493c213ba8d1 tempest-VolumesActionsTest-508274144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50fec3f1-07db-41a0-a218-967e8f796603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1eb142c0-b756-46ca-af6a-493c213ba8d1 tempest-VolumesActionsTest-508274144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b70526ea-8f45-40d6-b3fd-99f1fd2c4d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1eb142c0-b756-46ca-af6a-493c213ba8d1 tempest-VolumesActionsTest-508274144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b70526ea-8f45-40d6-b3fd-99f1fd2c4d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce011fe7-2b40-453b-9a5f-a8f03f3662d2', 'volume_name': 'volume-ce011fe7-2b40-453b-9a5f-a8f03f3662d2', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1eb142c0-b756-46ca-af6a-493c213ba8d1 tempest-VolumesActionsTest-508274144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9b66e6a-aac3-4d23-8e24-987716fc56ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1eb142c0-b756-46ca-af6a-493c213ba8d1 tempest-VolumesActionsTest-508274144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9b66e6a-aac3-4d23-8e24-987716fc56ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:23:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1eb142c0-b756-46ca-af6a-493c213ba8d1 tempest-VolumesActionsTest-508274144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a00c7bc-3b84-4a86-9469-73dd82748f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:23:57 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-1eb142c0-b756-46ca-af6a-493c213ba8d1 tempest-VolumesActionsTest-508274144 None] Volume ce011fe7-2b40-453b-9a5f-a8f03f3662d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce011fe7-2b40-453b-9a5f-a8f03f3662d2', 'volume_size': 1} Aug 05 10:23:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-1eb142c0-b756-46ca-af6a-493c213ba8d1 tempest-VolumesActionsTest-508274144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:23:57 devstack sudo[100290]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-84d0078a-8b72-4b8b-a14a-181ab242eede tempest-VolumesCloneTest-1094391728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a074f852-e545-423a-8786-f0567fbaccf5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a074f852-e545-423a-8786-f0567fbaccf5.cb75f5c3-2054-4416-8cbe-4f481aa1ee18 1G" returned: 0 in 0.868s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-84d0078a-8b72-4b8b-a14a-181ab242eede tempest-VolumesCloneTest-1094391728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a074f852-e545-423a-8786-f0567fbaccf5 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a074f852-e545-423a-8786-f0567fbaccf5.cb75f5c3-2054-4416-8cbe-4f481aa1ee18 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:57 devstack sudo[100297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a074f852-e545-423a-8786-f0567fbaccf5 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a074f852-e545-423a-8786-f0567fbaccf5.cb75f5c3-2054-4416-8cbe-4f481aa1ee18 Aug 05 10:23:57 devstack sudo[100297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:58 devstack sudo[100297]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-84d0078a-8b72-4b8b-a14a-181ab242eede tempest-VolumesCloneTest-1094391728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a074f852-e545-423a-8786-f0567fbaccf5 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a074f852-e545-423a-8786-f0567fbaccf5.cb75f5c3-2054-4416-8cbe-4f481aa1ee18" returned: 0 in 0.397s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:58 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-84d0078a-8b72-4b8b-a14a-181ab242eede tempest-VolumesCloneTest-1094391728 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a074f852-e545-423a-8786-f0567fbaccf5.cb75f5c3-2054-4416-8cbe-4f481aa1ee18 is being set with open permissions: ugo+rw Aug 05 10:23:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-84d0078a-8b72-4b8b-a14a-181ab242eede tempest-VolumesCloneTest-1094391728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a074f852-e545-423a-8786-f0567fbaccf5.cb75f5c3-2054-4416-8cbe-4f481aa1ee18 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:58 devstack sudo[100302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a074f852-e545-423a-8786-f0567fbaccf5.cb75f5c3-2054-4416-8cbe-4f481aa1ee18 Aug 05 10:23:58 devstack sudo[100302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:58 devstack sudo[100302]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-84d0078a-8b72-4b8b-a14a-181ab242eede tempest-VolumesCloneTest-1094391728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a074f852-e545-423a-8786-f0567fbaccf5.cb75f5c3-2054-4416-8cbe-4f481aa1ee18" returned: 0 in 0.356s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-84d0078a-8b72-4b8b-a14a-181ab242eede tempest-VolumesCloneTest-1094391728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a074f852-e545-423a-8786-f0567fbaccf5.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:58 devstack sudo[100305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a074f852-e545-423a-8786-f0567fbaccf5.info Aug 05 10:23:58 devstack sudo[100305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:58 devstack sudo[100305]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-84d0078a-8b72-4b8b-a14a-181ab242eede tempest-VolumesCloneTest-1094391728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a074f852-e545-423a-8786-f0567fbaccf5.info" returned: 0 in 0.313s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:58 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-84d0078a-8b72-4b8b-a14a-181ab242eede tempest-VolumesCloneTest-1094391728 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a074f852-e545-423a-8786-f0567fbaccf5.info is being set with open permissions: ugo+rw Aug 05 10:23:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-84d0078a-8b72-4b8b-a14a-181ab242eede tempest-VolumesCloneTest-1094391728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a074f852-e545-423a-8786-f0567fbaccf5.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:58 devstack sudo[100308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a074f852-e545-423a-8786-f0567fbaccf5.info Aug 05 10:23:58 devstack sudo[100308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:59 devstack sudo[100308]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-84d0078a-8b72-4b8b-a14a-181ab242eede tempest-VolumesCloneTest-1094391728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a074f852-e545-423a-8786-f0567fbaccf5.info" returned: 0 in 0.269s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:59 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-84d0078a-8b72-4b8b-a14a-181ab242eede tempest-VolumesCloneTest-1094391728 None] Acquiring lock "cinder-quobyte-903011ec-c71d-40ae-b4de-584bb92b6390" by "_copy_volume_from_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:23:59 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-84d0078a-8b72-4b8b-a14a-181ab242eede tempest-VolumesCloneTest-1094391728 None] Lock "cinder-quobyte-903011ec-c71d-40ae-b4de-584bb92b6390" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:23:59 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-84d0078a-8b72-4b8b-a14a-181ab242eede tempest-VolumesCloneTest-1094391728 None] snapshot: cb75f5c3-2054-4416-8cbe-4f481aa1ee18, volume: 903011ec-c71d-40ae-b4de-584bb92b6390, {{(pid=88613) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 05 10:23:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-84d0078a-8b72-4b8b-a14a-181ab242eede tempest-VolumesCloneTest-1094391728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:23:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-84d0078a-8b72-4b8b-a14a-181ab242eede tempest-VolumesCloneTest-1094391728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:23:59 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-84d0078a-8b72-4b8b-a14a-181ab242eede tempest-VolumesCloneTest-1094391728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:23:59 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-84d0078a-8b72-4b8b-a14a-181ab242eede tempest-VolumesCloneTest-1094391728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:23:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-84d0078a-8b72-4b8b-a14a-181ab242eede tempest-VolumesCloneTest-1094391728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:23:59 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[430170e6-84e0-43a5-97d3-062f8a5f7394]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:23:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-84d0078a-8b72-4b8b-a14a-181ab242eede tempest-VolumesCloneTest-1094391728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a074f852-e545-423a-8786-f0567fbaccf5.cb75f5c3-2054-4416-8cbe-4f481aa1ee18 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:59 devstack sudo[100311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a074f852-e545-423a-8786-f0567fbaccf5.cb75f5c3-2054-4416-8cbe-4f481aa1ee18 Aug 05 10:23:59 devstack sudo[100311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:59 devstack sudo[100311]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-84d0078a-8b72-4b8b-a14a-181ab242eede tempest-VolumesCloneTest-1094391728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a074f852-e545-423a-8786-f0567fbaccf5.cb75f5c3-2054-4416-8cbe-4f481aa1ee18" returned: 0 in 0.476s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:59 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-84d0078a-8b72-4b8b-a14a-181ab242eede tempest-VolumesCloneTest-1094391728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a074f852-e545-423a-8786-f0567fbaccf5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88613) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:23:59 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[335c93c0-54ec-4fa8-90e8-96640c99ba23]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:23:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-84d0078a-8b72-4b8b-a14a-181ab242eede tempest-VolumesCloneTest-1094391728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a074f852-e545-423a-8786-f0567fbaccf5 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:59 devstack sudo[100316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a074f852-e545-423a-8786-f0567fbaccf5 Aug 05 10:23:59 devstack sudo[100316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:24:00 devstack sudo[100316]: pam_unix(sudo:session): session closed for user root Aug 05 10:24:00 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-84d0078a-8b72-4b8b-a14a-181ab242eede tempest-VolumesCloneTest-1094391728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a074f852-e545-423a-8786-f0567fbaccf5" returned: 0 in 0.388s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:24:00 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-84d0078a-8b72-4b8b-a14a-181ab242eede tempest-VolumesCloneTest-1094391728 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a074f852-e545-423a-8786-f0567fbaccf5 {{(pid=88613) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 05 10:24:00 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-84d0078a-8b72-4b8b-a14a-181ab242eede tempest-VolumesCloneTest-1094391728 None] Creating direct copy from snapshot {{(pid=88613) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 05 10:24:00 devstack cinder-volume[88613]: DEBUG cinder.utils [None req-84d0078a-8b72-4b8b-a14a-181ab242eede tempest-VolumesCloneTest-1094391728 None] Path /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-903011ec-c71d-40ae-b4de-584bb92b6390 not found in is_blk_device check {{(pid=88613) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 05 10:24:00 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-84d0078a-8b72-4b8b-a14a-181ab242eede tempest-VolumesCloneTest-1094391728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a074f852-e545-423a-8786-f0567fbaccf5 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-903011ec-c71d-40ae-b4de-584bb92b6390 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:24:00 devstack sudo[100321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a074f852-e545-423a-8786-f0567fbaccf5 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-903011ec-c71d-40ae-b4de-584bb92b6390 Aug 05 10:24:00 devstack sudo[100321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:24:03 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b49d578-2cc8-4e40-954c-3ce5c79d5274 tempest-VolumesTransfersTest-259572135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:24:03 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-8b49d578-2cc8-4e40-954c-3ce5c79d5274 tempest-VolumesTransfersTest-259572135 None] Flow 'volume_create_manager' (4da1f3b0-0698-4007-9fb9-fb8da64cae42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:24:03 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-8b49d578-2cc8-4e40-954c-3ce5c79d5274 tempest-VolumesTransfersTest-259572135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e38c1a8-2c81-4780-8382-e3f342333f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:24:03 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-8b49d578-2cc8-4e40-954c-3ce5c79d5274 tempest-VolumesTransfersTest-259572135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e38c1a8-2c81-4780-8382-e3f342333f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:24:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1824059242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2879751-961c-45d4-90fb-2d9959c66fe8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07101d560f21429faf5b6251c3fb8c72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:24:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:24:04Z,use_quota=True,user_id='80669be143e445829a9a6814de02ccd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:24:03 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-8b49d578-2cc8-4e40-954c-3ce5c79d5274 tempest-VolumesTransfersTest-259572135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ca727bd-6028-4ce4-a3ab-d3d55eeee88b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:24:03 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-8b49d578-2cc8-4e40-954c-3ce5c79d5274 tempest-VolumesTransfersTest-259572135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ca727bd-6028-4ce4-a3ab-d3d55eeee88b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:24:03 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-8b49d578-2cc8-4e40-954c-3ce5c79d5274 tempest-VolumesTransfersTest-259572135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bab38df8-0508-4856-bb9f-2863298d09a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:24:03 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-8b49d578-2cc8-4e40-954c-3ce5c79d5274 tempest-VolumesTransfersTest-259572135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bab38df8-0508-4856-bb9f-2863298d09a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2879751-961c-45d4-90fb-2d9959c66fe8', 'volume_name': 'volume-b2879751-961c-45d4-90fb-2d9959c66fe8', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:24:03 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-8b49d578-2cc8-4e40-954c-3ce5c79d5274 tempest-VolumesTransfersTest-259572135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08d62010-b2c2-447b-b390-29e220b2a68c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:24:03 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-8b49d578-2cc8-4e40-954c-3ce5c79d5274 tempest-VolumesTransfersTest-259572135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08d62010-b2c2-447b-b390-29e220b2a68c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:24:03 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-8b49d578-2cc8-4e40-954c-3ce5c79d5274 tempest-VolumesTransfersTest-259572135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f42ef93b-6f48-4733-930e-d1f6d4fb41c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:24:03 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-8b49d578-2cc8-4e40-954c-3ce5c79d5274 tempest-VolumesTransfersTest-259572135 None] Volume b2879751-961c-45d4-90fb-2d9959c66fe8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2879751-961c-45d4-90fb-2d9959c66fe8', 'volume_size': 1} Aug 05 10:24:03 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-8b49d578-2cc8-4e40-954c-3ce5c79d5274 tempest-VolumesTransfersTest-259572135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:24:05 devstack sudo[100321]: pam_unix(sudo:session): session closed for user root Aug 05 10:24:05 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-84d0078a-8b72-4b8b-a14a-181ab242eede tempest-VolumesCloneTest-1094391728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a074f852-e545-423a-8786-f0567fbaccf5 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-903011ec-c71d-40ae-b4de-584bb92b6390" returned: 0 in 5.478s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:24:05 devstack cinder-volume[88613]: DEBUG cinder.image.image_utils [None req-84d0078a-8b72-4b8b-a14a-181ab242eede tempest-VolumesCloneTest-1094391728 None] Image conversion details: src /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a074f852-e545-423a-8786-f0567fbaccf5, size 1024.00 MB, duration 5.48 sec, destination /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-903011ec-c71d-40ae-b4de-584bb92b6390 {{(pid=88613) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 10:24:05 devstack cinder-volume[88613]: INFO cinder.image.image_utils [None req-84d0078a-8b72-4b8b-a14a-181ab242eede tempest-VolumesCloneTest-1094391728 None] Converted 1024.00 MB image at 186.90 MB/s Aug 05 10:24:05 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-84d0078a-8b72-4b8b-a14a-181ab242eede tempest-VolumesCloneTest-1094391728 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-903011ec-c71d-40ae-b4de-584bb92b6390 is being set with open permissions: ugo+rw Aug 05 10:24:05 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-84d0078a-8b72-4b8b-a14a-181ab242eede tempest-VolumesCloneTest-1094391728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-903011ec-c71d-40ae-b4de-584bb92b6390 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:24:05 devstack sudo[100335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-903011ec-c71d-40ae-b4de-584bb92b6390 Aug 05 10:24:05 devstack sudo[100335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:24:05 devstack sudo[100335]: pam_unix(sudo:session): session closed for user root Aug 05 10:24:05 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-84d0078a-8b72-4b8b-a14a-181ab242eede tempest-VolumesCloneTest-1094391728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-903011ec-c71d-40ae-b4de-584bb92b6390" returned: 0 in 0.378s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:24:05 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-84d0078a-8b72-4b8b-a14a-181ab242eede tempest-VolumesCloneTest-1094391728 None] Lock "cinder-quobyte-903011ec-c71d-40ae-b4de-584bb92b6390" released by "_copy_volume_from_snapshot" :: held 6.836s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:24:05 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-84d0078a-8b72-4b8b-a14a-181ab242eede tempest-VolumesCloneTest-1094391728 None] Acquiring lock "cinder-quobyte-cb75f5c3-2054-4416-8cbe-4f481aa1ee18" by "_delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:24:06 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-84d0078a-8b72-4b8b-a14a-181ab242eede tempest-VolumesCloneTest-1094391728 None] Lock "cinder-quobyte-cb75f5c3-2054-4416-8cbe-4f481aa1ee18" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:24:06 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-84d0078a-8b72-4b8b-a14a-181ab242eede tempest-VolumesCloneTest-1094391728 None] Deleting offline snapshot cb75f5c3-2054-4416-8cbe-4f481aa1ee18 of volume a074f852-e545-423a-8786-f0567fbaccf5 {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:24:06 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-84d0078a-8b72-4b8b-a14a-181ab242eede tempest-VolumesCloneTest-1094391728 None] snapshot_file for this snap is: volume-a074f852-e545-423a-8786-f0567fbaccf5.cb75f5c3-2054-4416-8cbe-4f481aa1ee18 {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:24:06 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[519614e2-2639-413d-8d84-ad205d1bfdff]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:24:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-84d0078a-8b72-4b8b-a14a-181ab242eede tempest-VolumesCloneTest-1094391728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a074f852-e545-423a-8786-f0567fbaccf5.cb75f5c3-2054-4416-8cbe-4f481aa1ee18 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:24:06 devstack sudo[100338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a074f852-e545-423a-8786-f0567fbaccf5.cb75f5c3-2054-4416-8cbe-4f481aa1ee18 Aug 05 10:24:06 devstack sudo[100338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:24:06 devstack sudo[100338]: pam_unix(sudo:session): session closed for user root Aug 05 10:24:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-84d0078a-8b72-4b8b-a14a-181ab242eede tempest-VolumesCloneTest-1094391728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a074f852-e545-423a-8786-f0567fbaccf5.cb75f5c3-2054-4416-8cbe-4f481aa1ee18" returned: 0 in 0.375s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:24:06 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-84d0078a-8b72-4b8b-a14a-181ab242eede tempest-VolumesCloneTest-1094391728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a074f852-e545-423a-8786-f0567fbaccf5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88613) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:24:06 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[7874d632-1c30-4301-b17f-b5b99d0f6b1f]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:24:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-84d0078a-8b72-4b8b-a14a-181ab242eede tempest-VolumesCloneTest-1094391728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a074f852-e545-423a-8786-f0567fbaccf5 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:24:06 devstack sudo[100343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a074f852-e545-423a-8786-f0567fbaccf5 Aug 05 10:24:06 devstack sudo[100343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:24:07 devstack sudo[100343]: pam_unix(sudo:session): session closed for user root Aug 05 10:24:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-84d0078a-8b72-4b8b-a14a-181ab242eede tempest-VolumesCloneTest-1094391728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a074f852-e545-423a-8786-f0567fbaccf5" returned: 0 in 0.600s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:24:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-84d0078a-8b72-4b8b-a14a-181ab242eede tempest-VolumesCloneTest-1094391728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a074f852-e545-423a-8786-f0567fbaccf5.cb75f5c3-2054-4416-8cbe-4f481aa1ee18 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:24:07 devstack sudo[100349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a074f852-e545-423a-8786-f0567fbaccf5.cb75f5c3-2054-4416-8cbe-4f481aa1ee18 Aug 05 10:24:07 devstack sudo[100349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:24:07 devstack sudo[100349]: pam_unix(sudo:session): session closed for user root Aug 05 10:24:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-84d0078a-8b72-4b8b-a14a-181ab242eede tempest-VolumesCloneTest-1094391728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a074f852-e545-423a-8786-f0567fbaccf5.cb75f5c3-2054-4416-8cbe-4f481aa1ee18" returned: 0 in 0.386s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:24:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-84d0078a-8b72-4b8b-a14a-181ab242eede tempest-VolumesCloneTest-1094391728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a074f852-e545-423a-8786-f0567fbaccf5.cb75f5c3-2054-4416-8cbe-4f481aa1ee18 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:24:07 devstack sudo[100355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a074f852-e545-423a-8786-f0567fbaccf5.cb75f5c3-2054-4416-8cbe-4f481aa1ee18 Aug 05 10:24:07 devstack sudo[100355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:24:07 devstack sudo[100355]: pam_unix(sudo:session): session closed for user root Aug 05 10:24:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-84d0078a-8b72-4b8b-a14a-181ab242eede tempest-VolumesCloneTest-1094391728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a074f852-e545-423a-8786-f0567fbaccf5.cb75f5c3-2054-4416-8cbe-4f481aa1ee18" returned: 0 in 0.261s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:24:07 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-84d0078a-8b72-4b8b-a14a-181ab242eede tempest-VolumesCloneTest-1094391728 None] Lock "cinder-quobyte-cb75f5c3-2054-4416-8cbe-4f481aa1ee18" released by "_delete_snapshot" :: held 1.765s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:24:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-84d0078a-8b72-4b8b-a14a-181ab242eede tempest-VolumesCloneTest-1094391728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.641s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:24:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-1eb142c0-b756-46ca-af6a-493c213ba8d1 tempest-VolumesActionsTest-508274144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.332s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:24:07 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-1eb142c0-b756-46ca-af6a-493c213ba8d1 tempest-VolumesActionsTest-508274144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:23:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1349091057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce011fe7-2b40-453b-9a5f-a8f03f3662d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cf93a39567d4267a465652c8215f69f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:23:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:23:57Z,use_quota=True,user_id='c08941f3ffc5447c9fbcda8fb2dd2db8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:24:07 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-1eb142c0-b756-46ca-af6a-493c213ba8d1 tempest-VolumesActionsTest-508274144 None] Creating volume ce011fe7-2b40-453b-9a5f-a8f03f3662d2 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:24:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-1eb142c0-b756-46ca-af6a-493c213ba8d1 tempest-VolumesActionsTest-508274144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:24:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-1eb142c0-b756-46ca-af6a-493c213ba8d1 tempest-VolumesActionsTest-508274144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:24:07 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-1eb142c0-b756-46ca-af6a-493c213ba8d1 tempest-VolumesActionsTest-508274144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:24:07 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-1eb142c0-b756-46ca-af6a-493c213ba8d1 tempest-VolumesActionsTest-508274144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:24:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-1eb142c0-b756-46ca-af6a-493c213ba8d1 tempest-VolumesActionsTest-508274144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:24:07 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-1eb142c0-b756-46ca-af6a-493c213ba8d1 tempest-VolumesActionsTest-508274144 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:24:07 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-1eb142c0-b756-46ca-af6a-493c213ba8d1 tempest-VolumesActionsTest-508274144 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:24:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1eb142c0-b756-46ca-af6a-493c213ba8d1 tempest-VolumesActionsTest-508274144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ce011fe7-2b40-453b-9a5f-a8f03f3662d2 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:24:07 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-84d0078a-8b72-4b8b-a14a-181ab242eede tempest-VolumesCloneTest-1094391728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4433977a-b25a-4db5-b986-fbb85c8015b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-903011ec-c71d-40ae-b4de-584bb92b6390', 'volume_size': 2, 'source_volid': 'a074f852-e545-423a-8786-f0567fbaccf5', 'source_volstatus': 'available'}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:24:07 devstack sudo[100364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ce011fe7-2b40-453b-9a5f-a8f03f3662d2 1073741824 Aug 05 10:24:07 devstack sudo[100364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:24:07 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-84d0078a-8b72-4b8b-a14a-181ab242eede tempest-VolumesCloneTest-1094391728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12cb6447-b01a-44f3-b2b8-dd0df7204da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:24:07 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-84d0078a-8b72-4b8b-a14a-181ab242eede tempest-VolumesCloneTest-1094391728 None] Volume volume-903011ec-c71d-40ae-b4de-584bb92b6390 (903011ec-c71d-40ae-b4de-584bb92b6390): created successfully Aug 05 10:24:07 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-84d0078a-8b72-4b8b-a14a-181ab242eede tempest-VolumesCloneTest-1094391728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12cb6447-b01a-44f3-b2b8-dd0df7204da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:24:07 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-84d0078a-8b72-4b8b-a14a-181ab242eede tempest-VolumesCloneTest-1094391728 None] Flow 'volume_create_manager' (4f6b9513-a09f-467e-84a9-e2f9add507a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:24:07 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-84d0078a-8b72-4b8b-a14a-181ab242eede tempest-VolumesCloneTest-1094391728 None] Created volume successfully. Aug 05 10:24:08 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-7159c729-3056-4eac-a00d-00eb792186fc tempest-VolumesCloneTest-1094391728 None] Acquiring lock "cinder-903011ec-c71d-40ae-b4de-584bb92b6390-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:24:08 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-7159c729-3056-4eac-a00d-00eb792186fc tempest-VolumesCloneTest-1094391728 None] Lock "cinder-903011ec-c71d-40ae-b4de-584bb92b6390-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:24:08 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-7159c729-3056-4eac-a00d-00eb792186fc tempest-VolumesCloneTest-1094391728 None] Acquiring lock "cinder-quobyte-903011ec-c71d-40ae-b4de-584bb92b6390" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:24:08 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-7159c729-3056-4eac-a00d-00eb792186fc tempest-VolumesCloneTest-1094391728 None] Lock "cinder-quobyte-903011ec-c71d-40ae-b4de-584bb92b6390" acquired by "delete_volume" :: waited 0.020s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:24:08 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f07a71-c724-4fa6-857d-63df0df699fa]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:24:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7159c729-3056-4eac-a00d-00eb792186fc tempest-VolumesCloneTest-1094391728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-903011ec-c71d-40ae-b4de-584bb92b6390 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:24:08 devstack sudo[100364]: pam_unix(sudo:session): session closed for user root Aug 05 10:24:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1eb142c0-b756-46ca-af6a-493c213ba8d1 tempest-VolumesActionsTest-508274144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ce011fe7-2b40-453b-9a5f-a8f03f3662d2 1073741824" returned: 0 in 0.616s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:24:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1eb142c0-b756-46ca-af6a-493c213ba8d1 tempest-VolumesActionsTest-508274144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ce011fe7-2b40-453b-9a5f-a8f03f3662d2 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:24:08 devstack sudo[100371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ce011fe7-2b40-453b-9a5f-a8f03f3662d2 Aug 05 10:24:08 devstack sudo[100371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:24:08 devstack sudo[100370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-903011ec-c71d-40ae-b4de-584bb92b6390 Aug 05 10:24:08 devstack sudo[100370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:24:08 devstack sudo[100371]: pam_unix(sudo:session): session closed for user root Aug 05 10:24:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1eb142c0-b756-46ca-af6a-493c213ba8d1 tempest-VolumesActionsTest-508274144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ce011fe7-2b40-453b-9a5f-a8f03f3662d2" returned: 0 in 0.287s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:24:08 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-1eb142c0-b756-46ca-af6a-493c213ba8d1 tempest-VolumesActionsTest-508274144 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:24:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-1eb142c0-b756-46ca-af6a-493c213ba8d1 tempest-VolumesActionsTest-508274144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:24:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-8b49d578-2cc8-4e40-954c-3ce5c79d5274 tempest-VolumesTransfersTest-259572135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.013s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:24:08 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-8b49d578-2cc8-4e40-954c-3ce5c79d5274 tempest-VolumesTransfersTest-259572135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:24:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1824059242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2879751-961c-45d4-90fb-2d9959c66fe8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07101d560f21429faf5b6251c3fb8c72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:24:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:24:04Z,use_quota=True,user_id='80669be143e445829a9a6814de02ccd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:24:08 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-8b49d578-2cc8-4e40-954c-3ce5c79d5274 tempest-VolumesTransfersTest-259572135 None] Creating volume b2879751-961c-45d4-90fb-2d9959c66fe8 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:24:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-8b49d578-2cc8-4e40-954c-3ce5c79d5274 tempest-VolumesTransfersTest-259572135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:24:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-8b49d578-2cc8-4e40-954c-3ce5c79d5274 tempest-VolumesTransfersTest-259572135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:24:08 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-8b49d578-2cc8-4e40-954c-3ce5c79d5274 tempest-VolumesTransfersTest-259572135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:24:08 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-8b49d578-2cc8-4e40-954c-3ce5c79d5274 tempest-VolumesTransfersTest-259572135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:24:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-8b49d578-2cc8-4e40-954c-3ce5c79d5274 tempest-VolumesTransfersTest-259572135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:24:08 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-8b49d578-2cc8-4e40-954c-3ce5c79d5274 tempest-VolumesTransfersTest-259572135 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:24:08 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-8b49d578-2cc8-4e40-954c-3ce5c79d5274 tempest-VolumesTransfersTest-259572135 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:24:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-8b49d578-2cc8-4e40-954c-3ce5c79d5274 tempest-VolumesTransfersTest-259572135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-b2879751-961c-45d4-90fb-2d9959c66fe8 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:24:08 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1eb142c0-b756-46ca-af6a-493c213ba8d1 tempest-VolumesActionsTest-508274144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a00c7bc-3b84-4a86-9469-73dd82748f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce011fe7-2b40-453b-9a5f-a8f03f3662d2', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:24:08 devstack sudo[100378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-b2879751-961c-45d4-90fb-2d9959c66fe8 1073741824 Aug 05 10:24:08 devstack sudo[100378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:24:08 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1eb142c0-b756-46ca-af6a-493c213ba8d1 tempest-VolumesActionsTest-508274144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d4ce6e4-b9be-4fbc-a704-b5fe950af0dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:24:08 devstack sudo[100370]: pam_unix(sudo:session): session closed for user root Aug 05 10:24:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7159c729-3056-4eac-a00d-00eb792186fc tempest-VolumesCloneTest-1094391728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-903011ec-c71d-40ae-b4de-584bb92b6390" returned: 0 in 0.484s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:24:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7159c729-3056-4eac-a00d-00eb792186fc tempest-VolumesCloneTest-1094391728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-903011ec-c71d-40ae-b4de-584bb92b6390 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:24:08 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-1eb142c0-b756-46ca-af6a-493c213ba8d1 tempest-VolumesActionsTest-508274144 None] Volume volume-ce011fe7-2b40-453b-9a5f-a8f03f3662d2 (ce011fe7-2b40-453b-9a5f-a8f03f3662d2): created successfully Aug 05 10:24:08 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1eb142c0-b756-46ca-af6a-493c213ba8d1 tempest-VolumesActionsTest-508274144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d4ce6e4-b9be-4fbc-a704-b5fe950af0dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:24:08 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1eb142c0-b756-46ca-af6a-493c213ba8d1 tempest-VolumesActionsTest-508274144 None] Flow 'volume_create_manager' (8423df9c-0f5c-4d90-8e03-1d2e4d172ad9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:24:08 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-1eb142c0-b756-46ca-af6a-493c213ba8d1 tempest-VolumesActionsTest-508274144 None] Created volume successfully. Aug 05 10:24:08 devstack sudo[100380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-903011ec-c71d-40ae-b4de-584bb92b6390 Aug 05 10:24:08 devstack sudo[100380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:24:09 devstack sudo[100380]: pam_unix(sudo:session): session closed for user root Aug 05 10:24:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7159c729-3056-4eac-a00d-00eb792186fc tempest-VolumesCloneTest-1094391728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-903011ec-c71d-40ae-b4de-584bb92b6390" returned: 0 in 0.322s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:24:09 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-7159c729-3056-4eac-a00d-00eb792186fc tempest-VolumesCloneTest-1094391728 None] Lock "cinder-quobyte-903011ec-c71d-40ae-b4de-584bb92b6390" released by "delete_volume" :: held 0.864s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:24:09 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-7159c729-3056-4eac-a00d-00eb792186fc tempest-VolumesCloneTest-1094391728 None] Created reservations ['c3166b5c-f24d-4c9b-bbb2-4a439e3853bb', '6e6b30b8-855b-4896-ad0b-7f49c181cc27', 'c0588ec3-eee4-4684-bac0-0695a7f1d9b8', 'aad64fc3-0bee-4a81-a318-2ca5f96a00db'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:24:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-7159c729-3056-4eac-a00d-00eb792186fc tempest-VolumesCloneTest-1094391728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:24:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-7159c729-3056-4eac-a00d-00eb792186fc tempest-VolumesCloneTest-1094391728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:24:09 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-7159c729-3056-4eac-a00d-00eb792186fc tempest-VolumesCloneTest-1094391728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:24:09 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-7159c729-3056-4eac-a00d-00eb792186fc tempest-VolumesCloneTest-1094391728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:24:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-7159c729-3056-4eac-a00d-00eb792186fc tempest-VolumesCloneTest-1094391728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:24:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7159c729-3056-4eac-a00d-00eb792186fc tempest-VolumesCloneTest-1094391728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:24:09 devstack sudo[100387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:24:09 devstack sudo[100387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:24:09 devstack sudo[100378]: pam_unix(sudo:session): session closed for user root Aug 05 10:24:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-8b49d578-2cc8-4e40-954c-3ce5c79d5274 tempest-VolumesTransfersTest-259572135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-b2879751-961c-45d4-90fb-2d9959c66fe8 1073741824" returned: 0 in 0.740s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:24:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-8b49d578-2cc8-4e40-954c-3ce5c79d5274 tempest-VolumesTransfersTest-259572135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-b2879751-961c-45d4-90fb-2d9959c66fe8 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:24:09 devstack sudo[100389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-b2879751-961c-45d4-90fb-2d9959c66fe8 Aug 05 10:24:09 devstack sudo[100389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:24:09 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-1d717dfa-de98-4b36-97d5-5f6abd64f6f8 tempest-VolumesCloneTest-1094391728 None] Acquiring lock "cinder-a074f852-e545-423a-8786-f0567fbaccf5-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:24:09 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-1d717dfa-de98-4b36-97d5-5f6abd64f6f8 tempest-VolumesCloneTest-1094391728 None] Lock "cinder-a074f852-e545-423a-8786-f0567fbaccf5-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:24:09 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-1d717dfa-de98-4b36-97d5-5f6abd64f6f8 tempest-VolumesCloneTest-1094391728 None] Acquiring lock "cinder-quobyte-a074f852-e545-423a-8786-f0567fbaccf5" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:24:09 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-1d717dfa-de98-4b36-97d5-5f6abd64f6f8 tempest-VolumesCloneTest-1094391728 None] Lock "cinder-quobyte-a074f852-e545-423a-8786-f0567fbaccf5" acquired by "delete_volume" :: waited 0.021s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:24:09 devstack sudo[100387]: pam_unix(sudo:session): session closed for user root Aug 05 10:24:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7159c729-3056-4eac-a00d-00eb792186fc tempest-VolumesCloneTest-1094391728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.500s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:24:09 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-7159c729-3056-4eac-a00d-00eb792186fc tempest-VolumesCloneTest-1094391728 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:24:09 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-7159c729-3056-4eac-a00d-00eb792186fc tempest-VolumesCloneTest-1094391728 None] Deleted volume successfully. Aug 05 10:24:09 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e460fcf-0603-4d93-b90b-716829a479cb]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:24:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1d717dfa-de98-4b36-97d5-5f6abd64f6f8 tempest-VolumesCloneTest-1094391728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a074f852-e545-423a-8786-f0567fbaccf5 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:24:09 devstack sudo[100389]: pam_unix(sudo:session): session closed for user root Aug 05 10:24:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-8b49d578-2cc8-4e40-954c-3ce5c79d5274 tempest-VolumesTransfersTest-259572135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-b2879751-961c-45d4-90fb-2d9959c66fe8" returned: 0 in 0.344s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:24:09 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-8b49d578-2cc8-4e40-954c-3ce5c79d5274 tempest-VolumesTransfersTest-259572135 None] <== create_volume: return (1156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:24:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-8b49d578-2cc8-4e40-954c-3ce5c79d5274 tempest-VolumesTransfersTest-259572135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:24:09 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-8b49d578-2cc8-4e40-954c-3ce5c79d5274 tempest-VolumesTransfersTest-259572135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f42ef93b-6f48-4733-930e-d1f6d4fb41c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2879751-961c-45d4-90fb-2d9959c66fe8', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:24:10 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-8b49d578-2cc8-4e40-954c-3ce5c79d5274 tempest-VolumesTransfersTest-259572135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6d191d7-3e10-4868-93ae-a0fa41f39c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:24:10 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-7159c729-3056-4eac-a00d-00eb792186fc tempest-VolumesCloneTest-1094391728 None] Lock "cinder-903011ec-c71d-40ae-b4de-584bb92b6390-delete_volume" released by "delete_volume" :: held 1.744s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:24:10 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-8b49d578-2cc8-4e40-954c-3ce5c79d5274 tempest-VolumesTransfersTest-259572135 None] Volume volume-b2879751-961c-45d4-90fb-2d9959c66fe8 (b2879751-961c-45d4-90fb-2d9959c66fe8): created successfully Aug 05 10:24:10 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-8b49d578-2cc8-4e40-954c-3ce5c79d5274 tempest-VolumesTransfersTest-259572135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6d191d7-3e10-4868-93ae-a0fa41f39c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:24:10 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-8b49d578-2cc8-4e40-954c-3ce5c79d5274 tempest-VolumesTransfersTest-259572135 None] Flow 'volume_create_manager' (4da1f3b0-0698-4007-9fb9-fb8da64cae42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:24:10 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-8b49d578-2cc8-4e40-954c-3ce5c79d5274 tempest-VolumesTransfersTest-259572135 None] Created volume successfully. Aug 05 10:24:10 devstack sudo[100393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a074f852-e545-423a-8786-f0567fbaccf5 Aug 05 10:24:10 devstack sudo[100393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:24:10 devstack sudo[100393]: pam_unix(sudo:session): session closed for user root Aug 05 10:24:10 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1d717dfa-de98-4b36-97d5-5f6abd64f6f8 tempest-VolumesCloneTest-1094391728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a074f852-e545-423a-8786-f0567fbaccf5" returned: 0 in 0.443s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:24:10 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1d717dfa-de98-4b36-97d5-5f6abd64f6f8 tempest-VolumesCloneTest-1094391728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a074f852-e545-423a-8786-f0567fbaccf5 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:24:10 devstack sudo[100398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a074f852-e545-423a-8786-f0567fbaccf5 Aug 05 10:24:10 devstack sudo[100398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:24:10 devstack sudo[100398]: pam_unix(sudo:session): session closed for user root Aug 05 10:24:10 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1d717dfa-de98-4b36-97d5-5f6abd64f6f8 tempest-VolumesCloneTest-1094391728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a074f852-e545-423a-8786-f0567fbaccf5" returned: 0 in 0.359s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:24:10 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-1d717dfa-de98-4b36-97d5-5f6abd64f6f8 tempest-VolumesCloneTest-1094391728 None] Lock "cinder-quobyte-a074f852-e545-423a-8786-f0567fbaccf5" released by "delete_volume" :: held 0.906s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:24:10 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-1d717dfa-de98-4b36-97d5-5f6abd64f6f8 tempest-VolumesCloneTest-1094391728 None] Created reservations ['ea977809-46ad-4379-a205-c2ddebd19c45', '2866ff42-7a68-474a-aa41-002a138b0458', '8ad899b9-a1e9-4dac-be75-91100e00ec83', 'a735b471-6616-4752-99f7-bd62cb9fdc8f'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:24:10 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-1d717dfa-de98-4b36-97d5-5f6abd64f6f8 tempest-VolumesCloneTest-1094391728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:24:10 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-1d717dfa-de98-4b36-97d5-5f6abd64f6f8 tempest-VolumesCloneTest-1094391728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:24:10 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-1d717dfa-de98-4b36-97d5-5f6abd64f6f8 tempest-VolumesCloneTest-1094391728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:24:10 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-1d717dfa-de98-4b36-97d5-5f6abd64f6f8 tempest-VolumesCloneTest-1094391728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:24:10 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-1d717dfa-de98-4b36-97d5-5f6abd64f6f8 tempest-VolumesCloneTest-1094391728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:24:10 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1d717dfa-de98-4b36-97d5-5f6abd64f6f8 tempest-VolumesCloneTest-1094391728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:24:11 devstack sudo[100401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:24:11 devstack sudo[100401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:24:11 devstack sudo[100401]: pam_unix(sudo:session): session closed for user root Aug 05 10:24:11 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1d717dfa-de98-4b36-97d5-5f6abd64f6f8 tempest-VolumesCloneTest-1094391728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.472s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:24:11 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-1d717dfa-de98-4b36-97d5-5f6abd64f6f8 tempest-VolumesCloneTest-1094391728 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:24:11 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-1d717dfa-de98-4b36-97d5-5f6abd64f6f8 tempest-VolumesCloneTest-1094391728 None] Deleted volume successfully. Aug 05 10:24:11 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-1d717dfa-de98-4b36-97d5-5f6abd64f6f8 tempest-VolumesCloneTest-1094391728 None] Lock "cinder-a074f852-e545-423a-8786-f0567fbaccf5-delete_volume" released by "delete_volume" :: held 1.776s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:24:12 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-1ff124ac-18f0-42a1-9b4f-5a6cd404ddc0 tempest-VolumesTransfersTest-1573958554 None] Transfer volume completed successfully. Aug 05 10:24:13 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8a409f5-cd9b-40ba-ac63-8afbe954de17 tempest-TestImageHashVerification-1004884271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:24:13 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d8a409f5-cd9b-40ba-ac63-8afbe954de17 tempest-TestImageHashVerification-1004884271 None] Flow 'volume_create_manager' (c5a84d87-4f52-4c74-a031-986331bcc8cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:24:13 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d8a409f5-cd9b-40ba-ac63-8afbe954de17 tempest-TestImageHashVerification-1004884271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60fbf483-f816-44dd-a0fc-ee6df692f6c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:24:13 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d8a409f5-cd9b-40ba-ac63-8afbe954de17 tempest-TestImageHashVerification-1004884271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60fbf483-f816-44dd-a0fc-ee6df692f6c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:24:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1776096603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faa4440d-4879-496d-8a48-ee1a95cb15cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d33783e4b68473c82e438d7ecb00aa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:24:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:24:13Z,use_quota=True,user_id='93e14e3e209d4ca5a88f13a8fad62e53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:24:13 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d8a409f5-cd9b-40ba-ac63-8afbe954de17 tempest-TestImageHashVerification-1004884271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16412d3b-19ff-4bcf-858c-da3184b371f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:24:13 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d8a409f5-cd9b-40ba-ac63-8afbe954de17 tempest-TestImageHashVerification-1004884271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16412d3b-19ff-4bcf-858c-da3184b371f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:24:13 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d8a409f5-cd9b-40ba-ac63-8afbe954de17 tempest-TestImageHashVerification-1004884271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adf63adc-e138-4788-9fef-727200bd6e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:24:13 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d8a409f5-cd9b-40ba-ac63-8afbe954de17 tempest-TestImageHashVerification-1004884271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adf63adc-e138-4788-9fef-727200bd6e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'faa4440d-4879-496d-8a48-ee1a95cb15cd', 'volume_name': 'volume-faa4440d-4879-496d-8a48-ee1a95cb15cd', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:24:13 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d8a409f5-cd9b-40ba-ac63-8afbe954de17 tempest-TestImageHashVerification-1004884271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3b277df-45b5-4bf5-ab40-786c105f7e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:24:13 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d8a409f5-cd9b-40ba-ac63-8afbe954de17 tempest-TestImageHashVerification-1004884271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3b277df-45b5-4bf5-ab40-786c105f7e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:24:13 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d8a409f5-cd9b-40ba-ac63-8afbe954de17 tempest-TestImageHashVerification-1004884271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (569a518e-709a-4e50-944b-cd16c703b58b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:24:13 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-d8a409f5-cd9b-40ba-ac63-8afbe954de17 tempest-TestImageHashVerification-1004884271 None] Volume faa4440d-4879-496d-8a48-ee1a95cb15cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-faa4440d-4879-496d-8a48-ee1a95cb15cd', 'volume_size': 1} Aug 05 10:24:13 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-d8a409f5-cd9b-40ba-ac63-8afbe954de17 tempest-TestImageHashVerification-1004884271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:24:13 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-d8a409f5-cd9b-40ba-ac63-8afbe954de17 tempest-TestImageHashVerification-1004884271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:24:13 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-d8a409f5-cd9b-40ba-ac63-8afbe954de17 tempest-TestImageHashVerification-1004884271 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:24:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1776096603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faa4440d-4879-496d-8a48-ee1a95cb15cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d33783e4b68473c82e438d7ecb00aa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:24:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:24:13Z,use_quota=True,user_id='93e14e3e209d4ca5a88f13a8fad62e53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:24:13 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-d8a409f5-cd9b-40ba-ac63-8afbe954de17 tempest-TestImageHashVerification-1004884271 None] Creating volume faa4440d-4879-496d-8a48-ee1a95cb15cd {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:24:13 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-d8a409f5-cd9b-40ba-ac63-8afbe954de17 tempest-TestImageHashVerification-1004884271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:24:13 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-d8a409f5-cd9b-40ba-ac63-8afbe954de17 tempest-TestImageHashVerification-1004884271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:24:13 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-d8a409f5-cd9b-40ba-ac63-8afbe954de17 tempest-TestImageHashVerification-1004884271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:24:13 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-d8a409f5-cd9b-40ba-ac63-8afbe954de17 tempest-TestImageHashVerification-1004884271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:24:13 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-d8a409f5-cd9b-40ba-ac63-8afbe954de17 tempest-TestImageHashVerification-1004884271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:24:13 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-d8a409f5-cd9b-40ba-ac63-8afbe954de17 tempest-TestImageHashVerification-1004884271 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:24:13 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-d8a409f5-cd9b-40ba-ac63-8afbe954de17 tempest-TestImageHashVerification-1004884271 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:24:13 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d8a409f5-cd9b-40ba-ac63-8afbe954de17 tempest-TestImageHashVerification-1004884271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-faa4440d-4879-496d-8a48-ee1a95cb15cd 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:24:13 devstack sudo[100407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-faa4440d-4879-496d-8a48-ee1a95cb15cd 1073741824 Aug 05 10:24:13 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-914e6acc-f8d8-4210-904b-25c2da7d6da5 tempest-VolumesTransfersTest-2044677266 None] Acquiring lock "cinder-b2879751-961c-45d4-90fb-2d9959c66fe8-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:24:13 devstack sudo[100407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:24:13 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-914e6acc-f8d8-4210-904b-25c2da7d6da5 tempest-VolumesTransfersTest-2044677266 None] Lock "cinder-b2879751-961c-45d4-90fb-2d9959c66fe8-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:24:13 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-914e6acc-f8d8-4210-904b-25c2da7d6da5 tempest-VolumesTransfersTest-2044677266 None] Acquiring lock "cinder-quobyte-b2879751-961c-45d4-90fb-2d9959c66fe8" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:24:13 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-914e6acc-f8d8-4210-904b-25c2da7d6da5 tempest-VolumesTransfersTest-2044677266 None] Lock "cinder-quobyte-b2879751-961c-45d4-90fb-2d9959c66fe8" acquired by "delete_volume" :: waited 0.020s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:24:13 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc29806-8429-411d-9ee7-5fd0bc90746c]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:24:13 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-914e6acc-f8d8-4210-904b-25c2da7d6da5 tempest-VolumesTransfersTest-2044677266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-b2879751-961c-45d4-90fb-2d9959c66fe8 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:24:13 devstack sudo[100409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-b2879751-961c-45d4-90fb-2d9959c66fe8 Aug 05 10:24:13 devstack sudo[100409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:24:13 devstack sudo[100407]: pam_unix(sudo:session): session closed for user root Aug 05 10:24:13 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d8a409f5-cd9b-40ba-ac63-8afbe954de17 tempest-TestImageHashVerification-1004884271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-faa4440d-4879-496d-8a48-ee1a95cb15cd 1073741824" returned: 0 in 0.647s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:24:13 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d8a409f5-cd9b-40ba-ac63-8afbe954de17 tempest-TestImageHashVerification-1004884271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-faa4440d-4879-496d-8a48-ee1a95cb15cd {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:24:13 devstack sudo[100417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-faa4440d-4879-496d-8a48-ee1a95cb15cd Aug 05 10:24:13 devstack sudo[100417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:24:13 devstack sudo[100409]: pam_unix(sudo:session): session closed for user root Aug 05 10:24:13 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-914e6acc-f8d8-4210-904b-25c2da7d6da5 tempest-VolumesTransfersTest-2044677266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-b2879751-961c-45d4-90fb-2d9959c66fe8" returned: 0 in 0.624s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:24:13 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-914e6acc-f8d8-4210-904b-25c2da7d6da5 tempest-VolumesTransfersTest-2044677266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-b2879751-961c-45d4-90fb-2d9959c66fe8 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:24:14 devstack sudo[100421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-b2879751-961c-45d4-90fb-2d9959c66fe8 Aug 05 10:24:14 devstack sudo[100421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:24:14 devstack sudo[100417]: pam_unix(sudo:session): session closed for user root Aug 05 10:24:14 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d8a409f5-cd9b-40ba-ac63-8afbe954de17 tempest-TestImageHashVerification-1004884271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-faa4440d-4879-496d-8a48-ee1a95cb15cd" returned: 0 in 0.429s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:24:14 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-d8a409f5-cd9b-40ba-ac63-8afbe954de17 tempest-TestImageHashVerification-1004884271 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:24:14 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-d8a409f5-cd9b-40ba-ac63-8afbe954de17 tempest-TestImageHashVerification-1004884271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:24:14 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d8a409f5-cd9b-40ba-ac63-8afbe954de17 tempest-TestImageHashVerification-1004884271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (569a518e-709a-4e50-944b-cd16c703b58b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-faa4440d-4879-496d-8a48-ee1a95cb15cd', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:24:14 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d8a409f5-cd9b-40ba-ac63-8afbe954de17 tempest-TestImageHashVerification-1004884271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (557938eb-f837-46d5-9259-07cfac760a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:24:14 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-d8a409f5-cd9b-40ba-ac63-8afbe954de17 tempest-TestImageHashVerification-1004884271 None] Volume volume-faa4440d-4879-496d-8a48-ee1a95cb15cd (faa4440d-4879-496d-8a48-ee1a95cb15cd): created successfully Aug 05 10:24:14 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d8a409f5-cd9b-40ba-ac63-8afbe954de17 tempest-TestImageHashVerification-1004884271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (557938eb-f837-46d5-9259-07cfac760a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:24:14 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d8a409f5-cd9b-40ba-ac63-8afbe954de17 tempest-TestImageHashVerification-1004884271 None] Flow 'volume_create_manager' (c5a84d87-4f52-4c74-a031-986331bcc8cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:24:14 devstack sudo[100421]: pam_unix(sudo:session): session closed for user root Aug 05 10:24:14 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-914e6acc-f8d8-4210-904b-25c2da7d6da5 tempest-VolumesTransfersTest-2044677266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-b2879751-961c-45d4-90fb-2d9959c66fe8" returned: 0 in 0.369s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:24:14 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-d8a409f5-cd9b-40ba-ac63-8afbe954de17 tempest-TestImageHashVerification-1004884271 None] Created volume successfully. Aug 05 10:24:14 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-914e6acc-f8d8-4210-904b-25c2da7d6da5 tempest-VolumesTransfersTest-2044677266 None] Lock "cinder-quobyte-b2879751-961c-45d4-90fb-2d9959c66fe8" released by "delete_volume" :: held 1.069s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:24:14 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-914e6acc-f8d8-4210-904b-25c2da7d6da5 tempest-VolumesTransfersTest-2044677266 None] Created reservations ['2e9825bb-a2d7-49e2-9eca-923ef0b92179', '7ea09250-1a4c-4b34-8d8c-cb7219257a05', 'c62456fe-f1c9-4eff-a0d8-4eb641ef3ac1', '7a3d677d-546a-4f26-ae34-0b28a1edba3d'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:24:14 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-914e6acc-f8d8-4210-904b-25c2da7d6da5 tempest-VolumesTransfersTest-2044677266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:24:14 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-914e6acc-f8d8-4210-904b-25c2da7d6da5 tempest-VolumesTransfersTest-2044677266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:24:14 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-914e6acc-f8d8-4210-904b-25c2da7d6da5 tempest-VolumesTransfersTest-2044677266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:24:14 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-914e6acc-f8d8-4210-904b-25c2da7d6da5 tempest-VolumesTransfersTest-2044677266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:24:14 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-914e6acc-f8d8-4210-904b-25c2da7d6da5 tempest-VolumesTransfersTest-2044677266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:24:14 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-914e6acc-f8d8-4210-904b-25c2da7d6da5 tempest-VolumesTransfersTest-2044677266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:24:14 devstack sudo[100426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:24:14 devstack sudo[100426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:24:14 devstack sudo[100426]: pam_unix(sudo:session): session closed for user root Aug 05 10:24:14 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-914e6acc-f8d8-4210-904b-25c2da7d6da5 tempest-VolumesTransfersTest-2044677266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.344s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:24:14 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-914e6acc-f8d8-4210-904b-25c2da7d6da5 tempest-VolumesTransfersTest-2044677266 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:24:14 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-914e6acc-f8d8-4210-904b-25c2da7d6da5 tempest-VolumesTransfersTest-2044677266 None] Deleted volume successfully. Aug 05 10:24:15 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-914e6acc-f8d8-4210-904b-25c2da7d6da5 tempest-VolumesTransfersTest-2044677266 None] Lock "cinder-b2879751-961c-45d4-90fb-2d9959c66fe8-delete_volume" released by "delete_volume" :: held 1.856s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:24:16 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-b240b0e1-e469-491b-ad34-192358497278 tempest-VolumesTransfersTest-259572135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:24:16 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-b240b0e1-e469-491b-ad34-192358497278 tempest-VolumesTransfersTest-259572135 None] Flow 'volume_create_manager' (1d4c1160-5f40-4a9b-8125-3c20e9067eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:24:16 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-b240b0e1-e469-491b-ad34-192358497278 tempest-VolumesTransfersTest-259572135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27bd6d72-6f55-4721-a651-6ea1868d97ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:24:16 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-b240b0e1-e469-491b-ad34-192358497278 tempest-VolumesTransfersTest-259572135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27bd6d72-6f55-4721-a651-6ea1868d97ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:24:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2121891297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ba7459e-cfe8-42c4-a181-df6c67352444,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07101d560f21429faf5b6251c3fb8c72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:24:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:24:16Z,use_quota=True,user_id='80669be143e445829a9a6814de02ccd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:24:16 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-b240b0e1-e469-491b-ad34-192358497278 tempest-VolumesTransfersTest-259572135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bd4bf72-b142-4c08-bf2e-28fcbddc9cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:24:16 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-b240b0e1-e469-491b-ad34-192358497278 tempest-VolumesTransfersTest-259572135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bd4bf72-b142-4c08-bf2e-28fcbddc9cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:24:16 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-b240b0e1-e469-491b-ad34-192358497278 tempest-VolumesTransfersTest-259572135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (679bb22b-cc3a-487b-bcc5-b10d41d6d3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:24:16 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-b240b0e1-e469-491b-ad34-192358497278 tempest-VolumesTransfersTest-259572135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (679bb22b-cc3a-487b-bcc5-b10d41d6d3f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ba7459e-cfe8-42c4-a181-df6c67352444', 'volume_name': 'volume-1ba7459e-cfe8-42c4-a181-df6c67352444', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:24:16 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-b240b0e1-e469-491b-ad34-192358497278 tempest-VolumesTransfersTest-259572135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42549688-c25e-4851-8c9b-e57fd0eebd14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:24:16 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-b240b0e1-e469-491b-ad34-192358497278 tempest-VolumesTransfersTest-259572135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42549688-c25e-4851-8c9b-e57fd0eebd14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:24:16 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-b240b0e1-e469-491b-ad34-192358497278 tempest-VolumesTransfersTest-259572135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc07e6c1-a114-4f21-9898-d012975e47fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:24:16 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-b240b0e1-e469-491b-ad34-192358497278 tempest-VolumesTransfersTest-259572135 None] Volume 1ba7459e-cfe8-42c4-a181-df6c67352444: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ba7459e-cfe8-42c4-a181-df6c67352444', 'volume_size': 1} Aug 05 10:24:16 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-b240b0e1-e469-491b-ad34-192358497278 tempest-VolumesTransfersTest-259572135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:24:16 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-b240b0e1-e469-491b-ad34-192358497278 tempest-VolumesTransfersTest-259572135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:24:16 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-b240b0e1-e469-491b-ad34-192358497278 tempest-VolumesTransfersTest-259572135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:24:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2121891297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ba7459e-cfe8-42c4-a181-df6c67352444,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07101d560f21429faf5b6251c3fb8c72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:24:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:24:16Z,use_quota=True,user_id='80669be143e445829a9a6814de02ccd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:24:16 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-b240b0e1-e469-491b-ad34-192358497278 tempest-VolumesTransfersTest-259572135 None] Creating volume 1ba7459e-cfe8-42c4-a181-df6c67352444 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:24:16 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-b240b0e1-e469-491b-ad34-192358497278 tempest-VolumesTransfersTest-259572135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:24:16 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-b240b0e1-e469-491b-ad34-192358497278 tempest-VolumesTransfersTest-259572135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:24:16 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-b240b0e1-e469-491b-ad34-192358497278 tempest-VolumesTransfersTest-259572135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:24:16 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-b240b0e1-e469-491b-ad34-192358497278 tempest-VolumesTransfersTest-259572135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:24:16 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-b240b0e1-e469-491b-ad34-192358497278 tempest-VolumesTransfersTest-259572135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:24:16 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-b240b0e1-e469-491b-ad34-192358497278 tempest-VolumesTransfersTest-259572135 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:24:16 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-b240b0e1-e469-491b-ad34-192358497278 tempest-VolumesTransfersTest-259572135 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:24:16 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b240b0e1-e469-491b-ad34-192358497278 tempest-VolumesTransfersTest-259572135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1ba7459e-cfe8-42c4-a181-df6c67352444 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:24:16 devstack sudo[100451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1ba7459e-cfe8-42c4-a181-df6c67352444 1073741824 Aug 05 10:24:16 devstack sudo[100451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:24:16 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5c79b4be-505b-49cf-8fc8-9ced39a49379 tempest-TestImageHashVerification-1004884271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:24:16 devstack sudo[100451]: pam_unix(sudo:session): session closed for user root Aug 05 10:24:16 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b240b0e1-e469-491b-ad34-192358497278 tempest-VolumesTransfersTest-259572135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1ba7459e-cfe8-42c4-a181-df6c67352444 1073741824" returned: 0 in 0.593s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:24:16 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b240b0e1-e469-491b-ad34-192358497278 tempest-VolumesTransfersTest-259572135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1ba7459e-cfe8-42c4-a181-df6c67352444 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:24:16 devstack sudo[100457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1ba7459e-cfe8-42c4-a181-df6c67352444 Aug 05 10:24:16 devstack sudo[100457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:24:17 devstack sudo[100457]: pam_unix(sudo:session): session closed for user root Aug 05 10:24:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b240b0e1-e469-491b-ad34-192358497278 tempest-VolumesTransfersTest-259572135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1ba7459e-cfe8-42c4-a181-df6c67352444" returned: 0 in 0.356s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:24:17 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-b240b0e1-e469-491b-ad34-192358497278 tempest-VolumesTransfersTest-259572135 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:24:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-b240b0e1-e469-491b-ad34-192358497278 tempest-VolumesTransfersTest-259572135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:24:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5c79b4be-505b-49cf-8fc8-9ced39a49379 tempest-TestImageHashVerification-1004884271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.769s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:24:17 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-b240b0e1-e469-491b-ad34-192358497278 tempest-VolumesTransfersTest-259572135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc07e6c1-a114-4f21-9898-d012975e47fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ba7459e-cfe8-42c4-a181-df6c67352444', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:24:17 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-b240b0e1-e469-491b-ad34-192358497278 tempest-VolumesTransfersTest-259572135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1754e334-da8c-4a94-8f30-9482d0afed9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:24:17 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a08c23-06a6-4710-9fac-02c29313daf5]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:24:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5c79b4be-505b-49cf-8fc8-9ced39a49379 tempest-TestImageHashVerification-1004884271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-faa4440d-4879-496d-8a48-ee1a95cb15cd {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:24:17 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-b240b0e1-e469-491b-ad34-192358497278 tempest-VolumesTransfersTest-259572135 None] Volume volume-1ba7459e-cfe8-42c4-a181-df6c67352444 (1ba7459e-cfe8-42c4-a181-df6c67352444): created successfully Aug 05 10:24:17 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-b240b0e1-e469-491b-ad34-192358497278 tempest-VolumesTransfersTest-259572135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1754e334-da8c-4a94-8f30-9482d0afed9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:24:17 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-b240b0e1-e469-491b-ad34-192358497278 tempest-VolumesTransfersTest-259572135 None] Flow 'volume_create_manager' (1d4c1160-5f40-4a9b-8125-3c20e9067eb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:24:17 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-b240b0e1-e469-491b-ad34-192358497278 tempest-VolumesTransfersTest-259572135 None] Created volume successfully. Aug 05 10:24:17 devstack sudo[100461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-faa4440d-4879-496d-8a48-ee1a95cb15cd Aug 05 10:24:17 devstack sudo[100461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:24:17 devstack sudo[100461]: pam_unix(sudo:session): session closed for user root Aug 05 10:24:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5c79b4be-505b-49cf-8fc8-9ced39a49379 tempest-TestImageHashVerification-1004884271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-faa4440d-4879-496d-8a48-ee1a95cb15cd" returned: 0 in 0.507s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:24:17 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[5606b5a9-5f2d-4bc0-85d0-d3d932519376]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:24:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5c79b4be-505b-49cf-8fc8-9ced39a49379 tempest-TestImageHashVerification-1004884271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-faa4440d-4879-496d-8a48-ee1a95cb15cd {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:24:17 devstack sudo[100475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-faa4440d-4879-496d-8a48-ee1a95cb15cd Aug 05 10:24:17 devstack sudo[100475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:24:18 devstack sudo[100475]: pam_unix(sudo:session): session closed for user root Aug 05 10:24:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5c79b4be-505b-49cf-8fc8-9ced39a49379 tempest-TestImageHashVerification-1004884271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-faa4440d-4879-496d-8a48-ee1a95cb15cd" returned: 0 in 0.772s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:24:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5c79b4be-505b-49cf-8fc8-9ced39a49379 tempest-TestImageHashVerification-1004884271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-faa4440d-4879-496d-8a48-ee1a95cb15cd /opt/stack/data/cinder/conversion/faa4440d-4879-496d-8a48-ee1a95cb15cd.temp_image.ee784be2-4d1f-4935-83c3-a969c6183dee95fsdq8r.img {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:24:18 devstack sudo[100516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-faa4440d-4879-496d-8a48-ee1a95cb15cd /opt/stack/data/cinder/conversion/faa4440d-4879-496d-8a48-ee1a95cb15cd.temp_image.ee784be2-4d1f-4935-83c3-a969c6183dee95fsdq8r.img Aug 05 10:24:18 devstack sudo[100516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:24:18 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-2cc4607d-17be-4de2-9016-57eaa1db14b4 tempest-VolumesTransfersTest-2044677266 None] Acquiring lock "cinder-1ba7459e-cfe8-42c4-a181-df6c67352444-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:24:19 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-2cc4607d-17be-4de2-9016-57eaa1db14b4 tempest-VolumesTransfersTest-2044677266 None] Lock "cinder-1ba7459e-cfe8-42c4-a181-df6c67352444-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:24:19 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-2cc4607d-17be-4de2-9016-57eaa1db14b4 tempest-VolumesTransfersTest-2044677266 None] Acquiring lock "cinder-quobyte-1ba7459e-cfe8-42c4-a181-df6c67352444" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:24:19 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-2cc4607d-17be-4de2-9016-57eaa1db14b4 tempest-VolumesTransfersTest-2044677266 None] Lock "cinder-quobyte-1ba7459e-cfe8-42c4-a181-df6c67352444" acquired by "delete_volume" :: waited 0.024s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:24:19 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fdad848-b514-4bc3-be3f-074b8448c3fd]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:24:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2cc4607d-17be-4de2-9016-57eaa1db14b4 tempest-VolumesTransfersTest-2044677266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1ba7459e-cfe8-42c4-a181-df6c67352444 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:24:19 devstack sudo[100544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1ba7459e-cfe8-42c4-a181-df6c67352444 Aug 05 10:24:19 devstack sudo[100544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:24:20 devstack sudo[100544]: pam_unix(sudo:session): session closed for user root Aug 05 10:24:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2cc4607d-17be-4de2-9016-57eaa1db14b4 tempest-VolumesTransfersTest-2044677266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1ba7459e-cfe8-42c4-a181-df6c67352444" returned: 0 in 0.948s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:24:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2cc4607d-17be-4de2-9016-57eaa1db14b4 tempest-VolumesTransfersTest-2044677266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1ba7459e-cfe8-42c4-a181-df6c67352444 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:24:20 devstack sudo[100571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1ba7459e-cfe8-42c4-a181-df6c67352444 Aug 05 10:24:20 devstack sudo[100571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:24:20 devstack sudo[100571]: pam_unix(sudo:session): session closed for user root Aug 05 10:24:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2cc4607d-17be-4de2-9016-57eaa1db14b4 tempest-VolumesTransfersTest-2044677266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1ba7459e-cfe8-42c4-a181-df6c67352444" returned: 0 in 0.604s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:24:20 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-2cc4607d-17be-4de2-9016-57eaa1db14b4 tempest-VolumesTransfersTest-2044677266 None] Lock "cinder-quobyte-1ba7459e-cfe8-42c4-a181-df6c67352444" released by "delete_volume" :: held 1.658s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:24:20 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-2cc4607d-17be-4de2-9016-57eaa1db14b4 tempest-VolumesTransfersTest-2044677266 None] Created reservations ['ca47345b-94ad-437c-8478-3cfb2c78978e', '5a6e81db-4206-4a95-a61f-5bcd854d745b', '8e10e168-d0fd-41ad-bf8e-32aa5a061db4', 'ca11b7c5-9626-4895-8909-da8ae8ebab03'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:24:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2cc4607d-17be-4de2-9016-57eaa1db14b4 tempest-VolumesTransfersTest-2044677266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:24:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2cc4607d-17be-4de2-9016-57eaa1db14b4 tempest-VolumesTransfersTest-2044677266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:24:21 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-2cc4607d-17be-4de2-9016-57eaa1db14b4 tempest-VolumesTransfersTest-2044677266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:24:21 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-2cc4607d-17be-4de2-9016-57eaa1db14b4 tempest-VolumesTransfersTest-2044677266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:24:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2cc4607d-17be-4de2-9016-57eaa1db14b4 tempest-VolumesTransfersTest-2044677266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:24:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2cc4607d-17be-4de2-9016-57eaa1db14b4 tempest-VolumesTransfersTest-2044677266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:24:21 devstack sudo[100574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:24:21 devstack sudo[100574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:24:21 devstack cinder-volume[88613]: DEBUG oslo_service.periodic_task [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88613) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:24:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:24:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:24:21 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:24:21 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:24:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:24:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:24:22 devstack sudo[100578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:24:22 devstack sudo[100578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:24:22 devstack sudo[100574]: pam_unix(sudo:session): session closed for user root Aug 05 10:24:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2cc4607d-17be-4de2-9016-57eaa1db14b4 tempest-VolumesTransfersTest-2044677266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 1.215s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:24:22 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-2cc4607d-17be-4de2-9016-57eaa1db14b4 tempest-VolumesTransfersTest-2044677266 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:24:22 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-2cc4607d-17be-4de2-9016-57eaa1db14b4 tempest-VolumesTransfersTest-2044677266 None] Deleted volume successfully. Aug 05 10:24:22 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-2cc4607d-17be-4de2-9016-57eaa1db14b4 tempest-VolumesTransfersTest-2044677266 None] Lock "cinder-1ba7459e-cfe8-42c4-a181-df6c67352444-delete_volume" released by "delete_volume" :: held 3.704s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:24:22 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-2412557e-ab42-4fb9-aaf9-ee21f3906000 tempest-VolumesSnapshotListTestJSON-1551204288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:24:22 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2412557e-ab42-4fb9-aaf9-ee21f3906000 tempest-VolumesSnapshotListTestJSON-1551204288 None] Flow 'volume_create_manager' (b31ba6df-de68-48ac-92ba-6ced0db74d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:24:22 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2412557e-ab42-4fb9-aaf9-ee21f3906000 tempest-VolumesSnapshotListTestJSON-1551204288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c65633d6-8402-4ea7-8d72-2e7f3ecc0d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:24:22 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2412557e-ab42-4fb9-aaf9-ee21f3906000 tempest-VolumesSnapshotListTestJSON-1551204288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c65633d6-8402-4ea7-8d72-2e7f3ecc0d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:24:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-195190327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7372aaad-6cff-4967-9e24-7d937657b1a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aaa4a70e2c843c0b6e61661f0369bd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:24:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:24:23Z,use_quota=True,user_id='0566a1d115494e699609d87aa746ef1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:24:22 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2412557e-ab42-4fb9-aaf9-ee21f3906000 tempest-VolumesSnapshotListTestJSON-1551204288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c99e31f5-748b-48be-a29d-722dd8da8b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:24:22 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2412557e-ab42-4fb9-aaf9-ee21f3906000 tempest-VolumesSnapshotListTestJSON-1551204288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c99e31f5-748b-48be-a29d-722dd8da8b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:24:22 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2412557e-ab42-4fb9-aaf9-ee21f3906000 tempest-VolumesSnapshotListTestJSON-1551204288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91c9db7b-09f4-4c62-b20a-46f3abb26f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:24:22 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2412557e-ab42-4fb9-aaf9-ee21f3906000 tempest-VolumesSnapshotListTestJSON-1551204288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91c9db7b-09f4-4c62-b20a-46f3abb26f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7372aaad-6cff-4967-9e24-7d937657b1a9', 'volume_name': 'volume-7372aaad-6cff-4967-9e24-7d937657b1a9', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:24:22 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2412557e-ab42-4fb9-aaf9-ee21f3906000 tempest-VolumesSnapshotListTestJSON-1551204288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad196dd6-384a-49d0-b7e8-476160a37b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:24:22 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2412557e-ab42-4fb9-aaf9-ee21f3906000 tempest-VolumesSnapshotListTestJSON-1551204288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad196dd6-384a-49d0-b7e8-476160a37b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:24:22 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2412557e-ab42-4fb9-aaf9-ee21f3906000 tempest-VolumesSnapshotListTestJSON-1551204288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8942bf96-282f-4ab8-958e-78757f28e6f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:24:22 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-2412557e-ab42-4fb9-aaf9-ee21f3906000 tempest-VolumesSnapshotListTestJSON-1551204288 None] Volume 7372aaad-6cff-4967-9e24-7d937657b1a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7372aaad-6cff-4967-9e24-7d937657b1a9', 'volume_size': 1} Aug 05 10:24:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2412557e-ab42-4fb9-aaf9-ee21f3906000 tempest-VolumesSnapshotListTestJSON-1551204288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:24:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 1.197s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:24:23 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:24:23 devstack sudo[100578]: pam_unix(sudo:session): session closed for user root Aug 05 10:24:23 devstack cinder-volume[88613]: DEBUG oslo_service.periodic_task [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Running periodic task VolumeManager._thread_info {{(pid=88613) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:24:23 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] thread count: 28 {{(pid=88613) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 10:24:23 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] thread info: [<_MainThread(MainThread, started 126173666128000)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88613) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 10:24:24 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d56431d4-4d1e-4d5a-830d-6d522a61bd70 tempest-VolumesActionsTest-508274144 None] Acquiring lock "cinder-ce011fe7-2b40-453b-9a5f-a8f03f3662d2" by "attach_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:24:24 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d56431d4-4d1e-4d5a-830d-6d522a61bd70 tempest-VolumesActionsTest-508274144 None] Lock "cinder-ce011fe7-2b40-453b-9a5f-a8f03f3662d2" acquired by "attach_volume" :: waited 0.064s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:24:24 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-d56431d4-4d1e-4d5a-830d-6d522a61bd70 tempest-VolumesActionsTest-508274144 None] Attaching volume ce011fe7-2b40-453b-9a5f-a8f03f3662d2 to instance faf084a5-e1fc-4908-bfbe-3a21bcd31de4 at mountpoint /dev/vdb on host None. Aug 05 10:24:24 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-d56431d4-4d1e-4d5a-830d-6d522a61bd70 tempest-VolumesActionsTest-508274144 None] Attach volume completed successfully. Aug 05 10:24:24 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d56431d4-4d1e-4d5a-830d-6d522a61bd70 tempest-VolumesActionsTest-508274144 None] Lock "cinder-ce011fe7-2b40-453b-9a5f-a8f03f3662d2" released by "attach_volume" :: held 0.343s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:24:25 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-13b40b51-b283-4d60-ad29-1f4125654826 tempest-VolumesActionsTest-508274144 None] Acquiring lock "cinder-ce011fe7-2b40-453b-9a5f-a8f03f3662d2-detach_volume" by "detach_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:24:25 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-13b40b51-b283-4d60-ad29-1f4125654826 tempest-VolumesActionsTest-508274144 None] Lock "cinder-ce011fe7-2b40-453b-9a5f-a8f03f3662d2-detach_volume" acquired by "detach_volume" :: waited 0.067s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:24:25 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-13b40b51-b283-4d60-ad29-1f4125654826 tempest-VolumesActionsTest-508274144 None] Detaching volume ce011fe7-2b40-453b-9a5f-a8f03f3662d2 from instance faf084a5-e1fc-4908-bfbe-3a21bcd31de4. Aug 05 10:24:25 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-13b40b51-b283-4d60-ad29-1f4125654826 tempest-VolumesActionsTest-508274144 None] Detach volume completed successfully. Aug 05 10:24:25 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-13b40b51-b283-4d60-ad29-1f4125654826 tempest-VolumesActionsTest-508274144 None] Lock "cinder-ce011fe7-2b40-453b-9a5f-a8f03f3662d2-detach_volume" released by "detach_volume" :: held 0.295s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:24:26 devstack sudo[100516]: pam_unix(sudo:session): session closed for user root Aug 05 10:24:26 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5c79b4be-505b-49cf-8fc8-9ced39a49379 tempest-TestImageHashVerification-1004884271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-faa4440d-4879-496d-8a48-ee1a95cb15cd /opt/stack/data/cinder/conversion/faa4440d-4879-496d-8a48-ee1a95cb15cd.temp_image.ee784be2-4d1f-4935-83c3-a969c6183dee95fsdq8r.img" returned: 0 in 7.556s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:24:26 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[40bbcdde-b16a-479c-a534-c8304be19bc4]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:24:26 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5c79b4be-505b-49cf-8fc8-9ced39a49379 tempest-TestImageHashVerification-1004884271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-faa4440d-4879-496d-8a48-ee1a95cb15cd {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:24:26 devstack sudo[100583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-faa4440d-4879-496d-8a48-ee1a95cb15cd Aug 05 10:24:26 devstack sudo[100583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:24:26 devstack sudo[100583]: pam_unix(sudo:session): session closed for user root Aug 05 10:24:26 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5c79b4be-505b-49cf-8fc8-9ced39a49379 tempest-TestImageHashVerification-1004884271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-faa4440d-4879-496d-8a48-ee1a95cb15cd" returned: 0 in 0.741s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:24:26 devstack cinder-volume[88613]: DEBUG cinder.image.image_utils [None req-5c79b4be-505b-49cf-8fc8-9ced39a49379 tempest-TestImageHashVerification-1004884271 None] Image conversion details: src /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-faa4440d-4879-496d-8a48-ee1a95cb15cd, size 1024.00 MB, duration 7.56 sec, destination /opt/stack/data/cinder/conversion/faa4440d-4879-496d-8a48-ee1a95cb15cd.temp_image.ee784be2-4d1f-4935-83c3-a969c6183dee95fsdq8r.img {{(pid=88613) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 10:24:26 devstack cinder-volume[88613]: INFO cinder.image.image_utils [None req-5c79b4be-505b-49cf-8fc8-9ced39a49379 tempest-TestImageHashVerification-1004884271 None] Converted 1024.00 MB image at 135.51 MB/s Aug 05 10:24:26 devstack cinder-volume[88613]: DEBUG cinder.image.image_utils [None req-5c79b4be-505b-49cf-8fc8-9ced39a49379 tempest-TestImageHashVerification-1004884271 None] ee784be2-4d1f-4935-83c3-a969c6183dee was raw, no need to convert to raw {{(pid=88613) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Aug 05 10:24:34 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-abbe90b8-efce-439d-a01d-a3ac559041ae tempest-VolumesTransfersV355Test-950682207 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:24:34 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-abbe90b8-efce-439d-a01d-a3ac559041ae tempest-VolumesTransfersV355Test-950682207 None] Flow 'volume_create_manager' (7fbbf15c-ae0d-4f8a-a16b-0c2572a79010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:24:34 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-abbe90b8-efce-439d-a01d-a3ac559041ae tempest-VolumesTransfersV355Test-950682207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d437df85-e858-4bfc-a0b2-67280014ec82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:24:34 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-abbe90b8-efce-439d-a01d-a3ac559041ae tempest-VolumesTransfersV355Test-950682207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d437df85-e858-4bfc-a0b2-67280014ec82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:24:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-169769592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c23c6e66-802e-4c6e-9918-00910a6b4abc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='375fdab5c07a4ccdb299289940f4dbac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:24:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:24:35Z,use_quota=True,user_id='242fc8027f554c88945926af1017656d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:24:34 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-abbe90b8-efce-439d-a01d-a3ac559041ae tempest-VolumesTransfersV355Test-950682207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (269cf3b3-7fbc-4f46-9f02-aafdb98b57dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:24:34 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-abbe90b8-efce-439d-a01d-a3ac559041ae tempest-VolumesTransfersV355Test-950682207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (269cf3b3-7fbc-4f46-9f02-aafdb98b57dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:24:34 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-abbe90b8-efce-439d-a01d-a3ac559041ae tempest-VolumesTransfersV355Test-950682207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3aa2b532-e550-46d9-85a3-4d7872531263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:24:34 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-abbe90b8-efce-439d-a01d-a3ac559041ae tempest-VolumesTransfersV355Test-950682207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3aa2b532-e550-46d9-85a3-4d7872531263) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c23c6e66-802e-4c6e-9918-00910a6b4abc', 'volume_name': 'volume-c23c6e66-802e-4c6e-9918-00910a6b4abc', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:24:34 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-abbe90b8-efce-439d-a01d-a3ac559041ae tempest-VolumesTransfersV355Test-950682207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7683c52d-f1c7-4138-9be1-56f8a1193be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:24:34 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-abbe90b8-efce-439d-a01d-a3ac559041ae tempest-VolumesTransfersV355Test-950682207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7683c52d-f1c7-4138-9be1-56f8a1193be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:24:34 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-abbe90b8-efce-439d-a01d-a3ac559041ae tempest-VolumesTransfersV355Test-950682207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c6e9454-0366-4d66-af13-b0c3e7fc8079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:24:34 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-abbe90b8-efce-439d-a01d-a3ac559041ae tempest-VolumesTransfersV355Test-950682207 None] Volume c23c6e66-802e-4c6e-9918-00910a6b4abc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c23c6e66-802e-4c6e-9918-00910a6b4abc', 'volume_size': 1} Aug 05 10:24:34 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-abbe90b8-efce-439d-a01d-a3ac559041ae tempest-VolumesTransfersV355Test-950682207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:24:41 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-b3c2e41d-aa4c-4843-a3ec-7904a6cf4b25 tempest-VolumesActionsTest-508274144 None] Acquiring lock "cinder-ce011fe7-2b40-453b-9a5f-a8f03f3662d2" by "attach_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:24:41 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-b3c2e41d-aa4c-4843-a3ec-7904a6cf4b25 tempest-VolumesActionsTest-508274144 None] Lock "cinder-ce011fe7-2b40-453b-9a5f-a8f03f3662d2" acquired by "attach_volume" :: waited 0.023s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:24:41 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-b3c2e41d-aa4c-4843-a3ec-7904a6cf4b25 tempest-VolumesActionsTest-508274144 None] Attaching volume ce011fe7-2b40-453b-9a5f-a8f03f3662d2 to instance 975dc818-9640-44d3-8a55-3af12009d5f6 at mountpoint /dev/vdb on host None. Aug 05 10:24:41 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-b3c2e41d-aa4c-4843-a3ec-7904a6cf4b25 tempest-VolumesActionsTest-508274144 None] Attach volume completed successfully. Aug 05 10:24:41 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-b3c2e41d-aa4c-4843-a3ec-7904a6cf4b25 tempest-VolumesActionsTest-508274144 None] Lock "cinder-ce011fe7-2b40-453b-9a5f-a8f03f3662d2" released by "attach_volume" :: held 0.134s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:24:41 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-cbf7af5f-9cde-420f-81b6-544bb3062eee tempest-VolumesActionsTest-508274144 None] Acquiring lock "cinder-ce011fe7-2b40-453b-9a5f-a8f03f3662d2-detach_volume" by "detach_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:24:41 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-cbf7af5f-9cde-420f-81b6-544bb3062eee tempest-VolumesActionsTest-508274144 None] Lock "cinder-ce011fe7-2b40-453b-9a5f-a8f03f3662d2-detach_volume" acquired by "detach_volume" :: waited 0.034s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:24:41 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-cbf7af5f-9cde-420f-81b6-544bb3062eee tempest-VolumesActionsTest-508274144 None] Detaching volume ce011fe7-2b40-453b-9a5f-a8f03f3662d2 from instance 975dc818-9640-44d3-8a55-3af12009d5f6. Aug 05 10:24:41 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-cbf7af5f-9cde-420f-81b6-544bb3062eee tempest-VolumesActionsTest-508274144 None] Detach volume completed successfully. Aug 05 10:24:41 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-cbf7af5f-9cde-420f-81b6-544bb3062eee tempest-VolumesActionsTest-508274144 None] Lock "cinder-ce011fe7-2b40-453b-9a5f-a8f03f3662d2-detach_volume" released by "detach_volume" :: held 0.095s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:24:48 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-1dfd71b1-7579-4d86-a87f-6292acf8c98e tempest-VolumesActionsTest-508274144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:24:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5c79b4be-505b-49cf-8fc8-9ced39a49379 tempest-TestImageHashVerification-1004884271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 33.435s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:24:50 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5c79b4be-505b-49cf-8fc8-9ced39a49379 tempest-TestImageHashVerification-1004884271 None] Uploaded volume to glance image-id: ee784be2-4d1f-4935-83c3-a969c6183dee. {{(pid=88613) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 05 10:24:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2412557e-ab42-4fb9-aaf9-ee21f3906000 tempest-VolumesSnapshotListTestJSON-1551204288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 27.678s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:24:50 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-2412557e-ab42-4fb9-aaf9-ee21f3906000 tempest-VolumesSnapshotListTestJSON-1551204288 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:24:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-195190327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7372aaad-6cff-4967-9e24-7d937657b1a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aaa4a70e2c843c0b6e61661f0369bd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:24:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:24:23Z,use_quota=True,user_id='0566a1d115494e699609d87aa746ef1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:24:50 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-2412557e-ab42-4fb9-aaf9-ee21f3906000 tempest-VolumesSnapshotListTestJSON-1551204288 None] Creating volume 7372aaad-6cff-4967-9e24-7d937657b1a9 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:24:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2412557e-ab42-4fb9-aaf9-ee21f3906000 tempest-VolumesSnapshotListTestJSON-1551204288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:24:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2412557e-ab42-4fb9-aaf9-ee21f3906000 tempest-VolumesSnapshotListTestJSON-1551204288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:24:50 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-2412557e-ab42-4fb9-aaf9-ee21f3906000 tempest-VolumesSnapshotListTestJSON-1551204288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:24:50 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-2412557e-ab42-4fb9-aaf9-ee21f3906000 tempest-VolumesSnapshotListTestJSON-1551204288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:24:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2412557e-ab42-4fb9-aaf9-ee21f3906000 tempest-VolumesSnapshotListTestJSON-1551204288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:24:50 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-2412557e-ab42-4fb9-aaf9-ee21f3906000 tempest-VolumesSnapshotListTestJSON-1551204288 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:24:50 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-2412557e-ab42-4fb9-aaf9-ee21f3906000 tempest-VolumesSnapshotListTestJSON-1551204288 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:24:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2412557e-ab42-4fb9-aaf9-ee21f3906000 tempest-VolumesSnapshotListTestJSON-1551204288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:24:50 devstack cinder-volume[88613]: DEBUG dbcounter [-] [88613] Writing DB stats cinder:UPDATE=69,cinder:SELECT=64,cinder:DELETE=6,cinder:INSERT=21 {{(pid=88613) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:24:50 devstack cinder-volume[88613]: DEBUG dbcounter [-] [88613] Writing DB stats cinder:SELECT=59,cinder:INSERT=15,cinder:UPDATE=81,cinder:DELETE=6 {{(pid=88613) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:24:50 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-5c79b4be-505b-49cf-8fc8-9ced39a49379 tempest-TestImageHashVerification-1004884271 None] Copy volume to image completed successfully. Aug 05 10:24:50 devstack sudo[100746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9 1073741824 Aug 05 10:24:50 devstack sudo[100746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:24:51 devstack sudo[100746]: pam_unix(sudo:session): session closed for user root Aug 05 10:24:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2412557e-ab42-4fb9-aaf9-ee21f3906000 tempest-VolumesSnapshotListTestJSON-1551204288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9 1073741824" returned: 0 in 0.455s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:24:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2412557e-ab42-4fb9-aaf9-ee21f3906000 tempest-VolumesSnapshotListTestJSON-1551204288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:24:51 devstack sudo[100752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9 Aug 05 10:24:51 devstack sudo[100752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:24:51 devstack sudo[100752]: pam_unix(sudo:session): session closed for user root Aug 05 10:24:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2412557e-ab42-4fb9-aaf9-ee21f3906000 tempest-VolumesSnapshotListTestJSON-1551204288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9" returned: 0 in 0.262s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:24:51 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-2412557e-ab42-4fb9-aaf9-ee21f3906000 tempest-VolumesSnapshotListTestJSON-1551204288 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:24:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2412557e-ab42-4fb9-aaf9-ee21f3906000 tempest-VolumesSnapshotListTestJSON-1551204288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:24:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-abbe90b8-efce-439d-a01d-a3ac559041ae tempest-VolumesTransfersV355Test-950682207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.577s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:24:51 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-abbe90b8-efce-439d-a01d-a3ac559041ae tempest-VolumesTransfersV355Test-950682207 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:24:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-169769592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c23c6e66-802e-4c6e-9918-00910a6b4abc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='375fdab5c07a4ccdb299289940f4dbac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:24:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:24:35Z,use_quota=True,user_id='242fc8027f554c88945926af1017656d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:24:51 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-abbe90b8-efce-439d-a01d-a3ac559041ae tempest-VolumesTransfersV355Test-950682207 None] Creating volume c23c6e66-802e-4c6e-9918-00910a6b4abc {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:24:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-abbe90b8-efce-439d-a01d-a3ac559041ae tempest-VolumesTransfersV355Test-950682207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:24:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-abbe90b8-efce-439d-a01d-a3ac559041ae tempest-VolumesTransfersV355Test-950682207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:24:51 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-abbe90b8-efce-439d-a01d-a3ac559041ae tempest-VolumesTransfersV355Test-950682207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:24:51 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-abbe90b8-efce-439d-a01d-a3ac559041ae tempest-VolumesTransfersV355Test-950682207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:24:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-abbe90b8-efce-439d-a01d-a3ac559041ae tempest-VolumesTransfersV355Test-950682207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:24:51 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-abbe90b8-efce-439d-a01d-a3ac559041ae tempest-VolumesTransfersV355Test-950682207 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:24:51 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-abbe90b8-efce-439d-a01d-a3ac559041ae tempest-VolumesTransfersV355Test-950682207 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:24:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-abbe90b8-efce-439d-a01d-a3ac559041ae tempest-VolumesTransfersV355Test-950682207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-c23c6e66-802e-4c6e-9918-00910a6b4abc 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:24:51 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2412557e-ab42-4fb9-aaf9-ee21f3906000 tempest-VolumesSnapshotListTestJSON-1551204288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8942bf96-282f-4ab8-958e-78757f28e6f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7372aaad-6cff-4967-9e24-7d937657b1a9', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:24:51 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2412557e-ab42-4fb9-aaf9-ee21f3906000 tempest-VolumesSnapshotListTestJSON-1551204288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddba9fbe-3500-4898-bcfc-3966d3bf4f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:24:51 devstack sudo[100755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-c23c6e66-802e-4c6e-9918-00910a6b4abc 1073741824 Aug 05 10:24:51 devstack sudo[100755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:24:51 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-2412557e-ab42-4fb9-aaf9-ee21f3906000 tempest-VolumesSnapshotListTestJSON-1551204288 None] Volume volume-7372aaad-6cff-4967-9e24-7d937657b1a9 (7372aaad-6cff-4967-9e24-7d937657b1a9): created successfully Aug 05 10:24:51 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2412557e-ab42-4fb9-aaf9-ee21f3906000 tempest-VolumesSnapshotListTestJSON-1551204288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddba9fbe-3500-4898-bcfc-3966d3bf4f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:24:51 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2412557e-ab42-4fb9-aaf9-ee21f3906000 tempest-VolumesSnapshotListTestJSON-1551204288 None] Flow 'volume_create_manager' (b31ba6df-de68-48ac-92ba-6ced0db74d05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:24:51 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-2412557e-ab42-4fb9-aaf9-ee21f3906000 tempest-VolumesSnapshotListTestJSON-1551204288 None] Created volume successfully. Aug 05 10:24:51 devstack sudo[100755]: pam_unix(sudo:session): session closed for user root Aug 05 10:24:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-abbe90b8-efce-439d-a01d-a3ac559041ae tempest-VolumesTransfersV355Test-950682207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-c23c6e66-802e-4c6e-9918-00910a6b4abc 1073741824" returned: 0 in 0.454s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:24:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-abbe90b8-efce-439d-a01d-a3ac559041ae tempest-VolumesTransfersV355Test-950682207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-c23c6e66-802e-4c6e-9918-00910a6b4abc {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:24:51 devstack sudo[100761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-c23c6e66-802e-4c6e-9918-00910a6b4abc Aug 05 10:24:51 devstack sudo[100761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:24:52 devstack sudo[100761]: pam_unix(sudo:session): session closed for user root Aug 05 10:24:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-abbe90b8-efce-439d-a01d-a3ac559041ae tempest-VolumesTransfersV355Test-950682207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-c23c6e66-802e-4c6e-9918-00910a6b4abc" returned: 0 in 0.257s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:24:52 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-abbe90b8-efce-439d-a01d-a3ac559041ae tempest-VolumesTransfersV355Test-950682207 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:24:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-abbe90b8-efce-439d-a01d-a3ac559041ae tempest-VolumesTransfersV355Test-950682207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:24:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-1dfd71b1-7579-4d86-a87f-6292acf8c98e tempest-VolumesActionsTest-508274144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 3.583s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:24:52 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-abbe90b8-efce-439d-a01d-a3ac559041ae tempest-VolumesTransfersV355Test-950682207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c6e9454-0366-4d66-af13-b0c3e7fc8079) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c23c6e66-802e-4c6e-9918-00910a6b4abc', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:24:52 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-abbe90b8-efce-439d-a01d-a3ac559041ae tempest-VolumesTransfersV355Test-950682207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9721823-d463-472d-9aa7-50280b31fe3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:24:52 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3eb4135-4ae0-4003-87b7-4b95f0298875]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:24:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1dfd71b1-7579-4d86-a87f-6292acf8c98e tempest-VolumesActionsTest-508274144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ce011fe7-2b40-453b-9a5f-a8f03f3662d2 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:24:52 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-abbe90b8-efce-439d-a01d-a3ac559041ae tempest-VolumesTransfersV355Test-950682207 None] Volume volume-c23c6e66-802e-4c6e-9918-00910a6b4abc (c23c6e66-802e-4c6e-9918-00910a6b4abc): created successfully Aug 05 10:24:52 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-abbe90b8-efce-439d-a01d-a3ac559041ae tempest-VolumesTransfersV355Test-950682207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9721823-d463-472d-9aa7-50280b31fe3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:24:52 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-abbe90b8-efce-439d-a01d-a3ac559041ae tempest-VolumesTransfersV355Test-950682207 None] Flow 'volume_create_manager' (7fbbf15c-ae0d-4f8a-a16b-0c2572a79010) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:24:52 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-abbe90b8-efce-439d-a01d-a3ac559041ae tempest-VolumesTransfersV355Test-950682207 None] Created volume successfully. Aug 05 10:24:52 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-5df33de9-f1a9-4ddf-9ee9-52cbc9500dd5 tempest-TestImageHashVerification-1004884271 None] Acquiring lock "cinder-faa4440d-4879-496d-8a48-ee1a95cb15cd-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:24:52 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-5df33de9-f1a9-4ddf-9ee9-52cbc9500dd5 tempest-TestImageHashVerification-1004884271 None] Lock "cinder-faa4440d-4879-496d-8a48-ee1a95cb15cd-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:24:52 devstack sudo[100764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ce011fe7-2b40-453b-9a5f-a8f03f3662d2 Aug 05 10:24:52 devstack sudo[100764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:24:52 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-5df33de9-f1a9-4ddf-9ee9-52cbc9500dd5 tempest-TestImageHashVerification-1004884271 None] Acquiring lock "cinder-quobyte-faa4440d-4879-496d-8a48-ee1a95cb15cd" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:24:52 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-5df33de9-f1a9-4ddf-9ee9-52cbc9500dd5 tempest-TestImageHashVerification-1004884271 None] Lock "cinder-quobyte-faa4440d-4879-496d-8a48-ee1a95cb15cd" acquired by "delete_volume" :: waited 0.015s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:24:52 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ea12eb-e0c1-4508-9a93-58664ccfc5ed]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:24:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5df33de9-f1a9-4ddf-9ee9-52cbc9500dd5 tempest-TestImageHashVerification-1004884271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-faa4440d-4879-496d-8a48-ee1a95cb15cd {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:24:52 devstack sudo[100766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-faa4440d-4879-496d-8a48-ee1a95cb15cd Aug 05 10:24:52 devstack sudo[100766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:24:52 devstack sudo[100764]: pam_unix(sudo:session): session closed for user root Aug 05 10:24:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1dfd71b1-7579-4d86-a87f-6292acf8c98e tempest-VolumesActionsTest-508274144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ce011fe7-2b40-453b-9a5f-a8f03f3662d2" returned: 0 in 0.416s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:24:52 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc19618-1c39-4905-b60b-86feec1b0569]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:24:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1dfd71b1-7579-4d86-a87f-6292acf8c98e tempest-VolumesActionsTest-508274144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ce011fe7-2b40-453b-9a5f-a8f03f3662d2 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:24:52 devstack sudo[100771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ce011fe7-2b40-453b-9a5f-a8f03f3662d2 Aug 05 10:24:52 devstack sudo[100771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:24:52 devstack sudo[100766]: pam_unix(sudo:session): session closed for user root Aug 05 10:24:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5df33de9-f1a9-4ddf-9ee9-52cbc9500dd5 tempest-TestImageHashVerification-1004884271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-faa4440d-4879-496d-8a48-ee1a95cb15cd" returned: 0 in 0.423s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:24:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5df33de9-f1a9-4ddf-9ee9-52cbc9500dd5 tempest-TestImageHashVerification-1004884271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-faa4440d-4879-496d-8a48-ee1a95cb15cd {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:24:52 devstack sudo[100776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-faa4440d-4879-496d-8a48-ee1a95cb15cd Aug 05 10:24:52 devstack sudo[100776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:24:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-05578fe0-ab43-4c00-a881-9145ef979927 tempest-VolumesSnapshotListTestJSON-1551204288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:24:53 devstack sudo[100771]: pam_unix(sudo:session): session closed for user root Aug 05 10:24:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1dfd71b1-7579-4d86-a87f-6292acf8c98e tempest-VolumesActionsTest-508274144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ce011fe7-2b40-453b-9a5f-a8f03f3662d2" returned: 0 in 0.412s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:24:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1dfd71b1-7579-4d86-a87f-6292acf8c98e tempest-VolumesActionsTest-508274144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ce011fe7-2b40-453b-9a5f-a8f03f3662d2 /opt/stack/data/cinder/conversion/ce011fe7-2b40-453b-9a5f-a8f03f3662d2.temp_image.8e5ae36a-d56d-42d2-87df-628faa6cbc4eljtlo_qa.img {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:24:53 devstack sudo[100781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ce011fe7-2b40-453b-9a5f-a8f03f3662d2 /opt/stack/data/cinder/conversion/ce011fe7-2b40-453b-9a5f-a8f03f3662d2.temp_image.8e5ae36a-d56d-42d2-87df-628faa6cbc4eljtlo_qa.img Aug 05 10:24:53 devstack sudo[100781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:24:53 devstack sudo[100776]: pam_unix(sudo:session): session closed for user root Aug 05 10:24:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5df33de9-f1a9-4ddf-9ee9-52cbc9500dd5 tempest-TestImageHashVerification-1004884271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-faa4440d-4879-496d-8a48-ee1a95cb15cd" returned: 0 in 0.296s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:24:53 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-5df33de9-f1a9-4ddf-9ee9-52cbc9500dd5 tempest-TestImageHashVerification-1004884271 None] Lock "cinder-quobyte-faa4440d-4879-496d-8a48-ee1a95cb15cd" released by "delete_volume" :: held 0.764s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:24:53 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-5df33de9-f1a9-4ddf-9ee9-52cbc9500dd5 tempest-TestImageHashVerification-1004884271 None] Created reservations ['2e37455a-7f05-46ca-9792-4ef1fc09222b', '3ff50ff2-bcd5-4126-af0a-510b094291ac', '348de968-c114-4bd3-96a5-4918eb522e07', '98926a24-0ca5-4e9f-8ec6-df37c25b1d45'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:24:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5df33de9-f1a9-4ddf-9ee9-52cbc9500dd5 tempest-TestImageHashVerification-1004884271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:24:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5df33de9-f1a9-4ddf-9ee9-52cbc9500dd5 tempest-TestImageHashVerification-1004884271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:24:53 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-5df33de9-f1a9-4ddf-9ee9-52cbc9500dd5 tempest-TestImageHashVerification-1004884271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:24:53 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-5df33de9-f1a9-4ddf-9ee9-52cbc9500dd5 tempest-TestImageHashVerification-1004884271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:24:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5df33de9-f1a9-4ddf-9ee9-52cbc9500dd5 tempest-TestImageHashVerification-1004884271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:24:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5df33de9-f1a9-4ddf-9ee9-52cbc9500dd5 tempest-TestImageHashVerification-1004884271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:24:53 devstack sudo[100784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:24:53 devstack sudo[100784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:24:53 devstack sudo[100784]: pam_unix(sudo:session): session closed for user root Aug 05 10:24:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5df33de9-f1a9-4ddf-9ee9-52cbc9500dd5 tempest-TestImageHashVerification-1004884271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.528s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:24:53 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-5df33de9-f1a9-4ddf-9ee9-52cbc9500dd5 tempest-TestImageHashVerification-1004884271 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:24:53 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-5df33de9-f1a9-4ddf-9ee9-52cbc9500dd5 tempest-TestImageHashVerification-1004884271 None] Deleted volume successfully. Aug 05 10:24:53 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-5df33de9-f1a9-4ddf-9ee9-52cbc9500dd5 tempest-TestImageHashVerification-1004884271 None] Lock "cinder-faa4440d-4879-496d-8a48-ee1a95cb15cd-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:24:54 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-c15a33c0-7036-4ed0-91ae-93b49526024f tempest-VolumesTransfersV355Test-1583527615 None] Transfer volume completed successfully. Aug 05 10:24:55 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-65e413dc-9bcb-4caf-96f5-e31785a321af tempest-VolumesTransfersV355Test-1858234329 None] Acquiring lock "cinder-c23c6e66-802e-4c6e-9918-00910a6b4abc-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:24:55 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-65e413dc-9bcb-4caf-96f5-e31785a321af tempest-VolumesTransfersV355Test-1858234329 None] Lock "cinder-c23c6e66-802e-4c6e-9918-00910a6b4abc-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:24:56 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-65e413dc-9bcb-4caf-96f5-e31785a321af tempest-VolumesTransfersV355Test-1858234329 None] Acquiring lock "cinder-quobyte-c23c6e66-802e-4c6e-9918-00910a6b4abc" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:24:56 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-65e413dc-9bcb-4caf-96f5-e31785a321af tempest-VolumesTransfersV355Test-1858234329 None] Lock "cinder-quobyte-c23c6e66-802e-4c6e-9918-00910a6b4abc" acquired by "delete_volume" :: waited 0.050s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:24:56 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc87febe-ec3b-41b2-bcf5-1c0cef1b5206]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:24:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-65e413dc-9bcb-4caf-96f5-e31785a321af tempest-VolumesTransfersV355Test-1858234329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-c23c6e66-802e-4c6e-9918-00910a6b4abc {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:24:56 devstack sudo[100835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-c23c6e66-802e-4c6e-9918-00910a6b4abc Aug 05 10:24:56 devstack sudo[100835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:24:57 devstack sudo[100835]: pam_unix(sudo:session): session closed for user root Aug 05 10:24:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-65e413dc-9bcb-4caf-96f5-e31785a321af tempest-VolumesTransfersV355Test-1858234329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-c23c6e66-802e-4c6e-9918-00910a6b4abc" returned: 0 in 1.064s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:24:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-65e413dc-9bcb-4caf-96f5-e31785a321af tempest-VolumesTransfersV355Test-1858234329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-c23c6e66-802e-4c6e-9918-00910a6b4abc {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:24:57 devstack sudo[100841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-c23c6e66-802e-4c6e-9918-00910a6b4abc Aug 05 10:24:57 devstack sudo[100841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:24:58 devstack sudo[100841]: pam_unix(sudo:session): session closed for user root Aug 05 10:24:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-65e413dc-9bcb-4caf-96f5-e31785a321af tempest-VolumesTransfersV355Test-1858234329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-c23c6e66-802e-4c6e-9918-00910a6b4abc" returned: 0 in 0.745s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:24:58 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-65e413dc-9bcb-4caf-96f5-e31785a321af tempest-VolumesTransfersV355Test-1858234329 None] Lock "cinder-quobyte-c23c6e66-802e-4c6e-9918-00910a6b4abc" released by "delete_volume" :: held 1.928s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:24:58 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-65e413dc-9bcb-4caf-96f5-e31785a321af tempest-VolumesTransfersV355Test-1858234329 None] Created reservations ['3cbee029-2f6c-43d1-ae56-435b69715c48', 'd7506dba-ee49-4592-8160-807b00de8986', '4ea033c5-e7a0-4c6c-90b0-fab57418de95', '54d8798a-2e26-4b3f-b9e0-2a8acf57a99c'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:24:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-65e413dc-9bcb-4caf-96f5-e31785a321af tempest-VolumesTransfersV355Test-1858234329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:24:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-65e413dc-9bcb-4caf-96f5-e31785a321af tempest-VolumesTransfersV355Test-1858234329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:24:58 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-65e413dc-9bcb-4caf-96f5-e31785a321af tempest-VolumesTransfersV355Test-1858234329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:24:58 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-65e413dc-9bcb-4caf-96f5-e31785a321af tempest-VolumesTransfersV355Test-1858234329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:24:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-65e413dc-9bcb-4caf-96f5-e31785a321af tempest-VolumesTransfersV355Test-1858234329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:24:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-65e413dc-9bcb-4caf-96f5-e31785a321af tempest-VolumesTransfersV355Test-1858234329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:24:58 devstack sudo[100846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:24:58 devstack sudo[100846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:24:58 devstack sudo[100781]: pam_unix(sudo:session): session closed for user root Aug 05 10:24:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1dfd71b1-7579-4d86-a87f-6292acf8c98e tempest-VolumesActionsTest-508274144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ce011fe7-2b40-453b-9a5f-a8f03f3662d2 /opt/stack/data/cinder/conversion/ce011fe7-2b40-453b-9a5f-a8f03f3662d2.temp_image.8e5ae36a-d56d-42d2-87df-628faa6cbc4eljtlo_qa.img" returned: 0 in 5.725s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:24:58 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d76274-bd73-414c-9fca-52d6a0b74b5e]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:24:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1dfd71b1-7579-4d86-a87f-6292acf8c98e tempest-VolumesActionsTest-508274144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ce011fe7-2b40-453b-9a5f-a8f03f3662d2 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:24:58 devstack sudo[100846]: pam_unix(sudo:session): session closed for user root Aug 05 10:24:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-65e413dc-9bcb-4caf-96f5-e31785a321af tempest-VolumesTransfersV355Test-1858234329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.464s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:24:58 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-65e413dc-9bcb-4caf-96f5-e31785a321af tempest-VolumesTransfersV355Test-1858234329 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:24:58 devstack sudo[100848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ce011fe7-2b40-453b-9a5f-a8f03f3662d2 Aug 05 10:24:58 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-65e413dc-9bcb-4caf-96f5-e31785a321af tempest-VolumesTransfersV355Test-1858234329 None] Deleted volume successfully. Aug 05 10:24:58 devstack sudo[100848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:24:58 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-65e413dc-9bcb-4caf-96f5-e31785a321af tempest-VolumesTransfersV355Test-1858234329 None] Lock "cinder-c23c6e66-802e-4c6e-9918-00910a6b4abc-delete_volume" released by "delete_volume" :: held 3.106s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:24:59 devstack sudo[100848]: pam_unix(sudo:session): session closed for user root Aug 05 10:24:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1dfd71b1-7579-4d86-a87f-6292acf8c98e tempest-VolumesActionsTest-508274144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ce011fe7-2b40-453b-9a5f-a8f03f3662d2" returned: 0 in 0.627s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:24:59 devstack cinder-volume[88613]: DEBUG cinder.image.image_utils [None req-1dfd71b1-7579-4d86-a87f-6292acf8c98e tempest-VolumesActionsTest-508274144 None] Image conversion details: src /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ce011fe7-2b40-453b-9a5f-a8f03f3662d2, size 1024.00 MB, duration 5.73 sec, destination /opt/stack/data/cinder/conversion/ce011fe7-2b40-453b-9a5f-a8f03f3662d2.temp_image.8e5ae36a-d56d-42d2-87df-628faa6cbc4eljtlo_qa.img {{(pid=88613) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 10:24:59 devstack cinder-volume[88613]: INFO cinder.image.image_utils [None req-1dfd71b1-7579-4d86-a87f-6292acf8c98e tempest-VolumesActionsTest-508274144 None] Converted 1024.00 MB image at 178.82 MB/s Aug 05 10:24:59 devstack cinder-volume[88613]: DEBUG cinder.image.image_utils [None req-1dfd71b1-7579-4d86-a87f-6292acf8c98e tempest-VolumesActionsTest-508274144 None] 8e5ae36a-d56d-42d2-87df-628faa6cbc4e was raw, no need to convert to raw {{(pid=88613) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Aug 05 10:25:00 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-2aeecb5d-d75f-49a4-b141-d312ffde1605 tempest-VolumesTransfersV355Test-950682207 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:25:00 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2aeecb5d-d75f-49a4-b141-d312ffde1605 tempest-VolumesTransfersV355Test-950682207 None] Flow 'volume_create_manager' (25708a3d-b680-46ee-9835-ee71a5202359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:25:00 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2aeecb5d-d75f-49a4-b141-d312ffde1605 tempest-VolumesTransfersV355Test-950682207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd0d8696-82cd-40ba-9e18-5da25c4295d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:00 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2aeecb5d-d75f-49a4-b141-d312ffde1605 tempest-VolumesTransfersV355Test-950682207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd0d8696-82cd-40ba-9e18-5da25c4295d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:25:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1633542018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b2cd61a-3198-4c99-9f7f-90bfb22415a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='375fdab5c07a4ccdb299289940f4dbac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:25:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:25:00Z,use_quota=True,user_id='242fc8027f554c88945926af1017656d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:00 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2aeecb5d-d75f-49a4-b141-d312ffde1605 tempest-VolumesTransfersV355Test-950682207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a533e15-5443-4ad9-bb5c-b81d342bca83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:00 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2aeecb5d-d75f-49a4-b141-d312ffde1605 tempest-VolumesTransfersV355Test-950682207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a533e15-5443-4ad9-bb5c-b81d342bca83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:00 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2aeecb5d-d75f-49a4-b141-d312ffde1605 tempest-VolumesTransfersV355Test-950682207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61dbd8d0-4cb2-4692-bf81-808e6afed1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:00 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2aeecb5d-d75f-49a4-b141-d312ffde1605 tempest-VolumesTransfersV355Test-950682207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61dbd8d0-4cb2-4692-bf81-808e6afed1b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b2cd61a-3198-4c99-9f7f-90bfb22415a6', 'volume_name': 'volume-8b2cd61a-3198-4c99-9f7f-90bfb22415a6', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:00 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2aeecb5d-d75f-49a4-b141-d312ffde1605 tempest-VolumesTransfersV355Test-950682207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8f9b2a9-45ab-4921-815a-28a3fe099b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:00 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2aeecb5d-d75f-49a4-b141-d312ffde1605 tempest-VolumesTransfersV355Test-950682207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8f9b2a9-45ab-4921-815a-28a3fe099b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:00 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2aeecb5d-d75f-49a4-b141-d312ffde1605 tempest-VolumesTransfersV355Test-950682207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (983b7530-c184-4044-83a2-5f06d9f4204a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:00 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-2aeecb5d-d75f-49a4-b141-d312ffde1605 tempest-VolumesTransfersV355Test-950682207 None] Volume 8b2cd61a-3198-4c99-9f7f-90bfb22415a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b2cd61a-3198-4c99-9f7f-90bfb22415a6', 'volume_size': 1} Aug 05 10:25:00 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2aeecb5d-d75f-49a4-b141-d312ffde1605 tempest-VolumesTransfersV355Test-950682207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:25:08 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-65613363-5392-4b79-bf9d-fb6548292a74 tempest-CinderUnicodeTest-1731436236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:25:08 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-65613363-5392-4b79-bf9d-fb6548292a74 tempest-CinderUnicodeTest-1731436236 None] Flow 'volume_create_manager' (31720f9b-8a31-4de8-a5be-3303284996c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:25:08 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-65613363-5392-4b79-bf9d-fb6548292a74 tempest-CinderUnicodeTest-1731436236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b7f9f39-b365-49ab-a001-4dfcd25d85bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:08 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-65613363-5392-4b79-bf9d-fb6548292a74 tempest-CinderUnicodeTest-1731436236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b7f9f39-b365-49ab-a001-4dfcd25d85bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:25:08Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c12afed-044b-49a3-bf91-a6b3de8f4fdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eabc7d8bc78c44c5934c3b722ac290c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:25:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:25:08Z,use_quota=True,user_id='6751740867a040a2b463aadb3ce8b963',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:08 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-65613363-5392-4b79-bf9d-fb6548292a74 tempest-CinderUnicodeTest-1731436236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7ee037f-6fcf-40e1-9213-b6d91e01c9a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:08 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-65613363-5392-4b79-bf9d-fb6548292a74 tempest-CinderUnicodeTest-1731436236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7ee037f-6fcf-40e1-9213-b6d91e01c9a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:08 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-65613363-5392-4b79-bf9d-fb6548292a74 tempest-CinderUnicodeTest-1731436236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f6f4d6b-27be-4699-88aa-61af75da6fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:08 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-65613363-5392-4b79-bf9d-fb6548292a74 tempest-CinderUnicodeTest-1731436236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f6f4d6b-27be-4699-88aa-61af75da6fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c12afed-044b-49a3-bf91-a6b3de8f4fdf', 'volume_name': 'volume-9c12afed-044b-49a3-bf91-a6b3de8f4fdf', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:08 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-65613363-5392-4b79-bf9d-fb6548292a74 tempest-CinderUnicodeTest-1731436236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d14c03de-552a-4532-ba30-aa05e8c3d889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:08 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-65613363-5392-4b79-bf9d-fb6548292a74 tempest-CinderUnicodeTest-1731436236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d14c03de-552a-4532-ba30-aa05e8c3d889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:08 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-65613363-5392-4b79-bf9d-fb6548292a74 tempest-CinderUnicodeTest-1731436236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a87fe4d4-c1c9-4965-8fc0-45ab0241b132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:08 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-65613363-5392-4b79-bf9d-fb6548292a74 tempest-CinderUnicodeTest-1731436236 None] Volume 9c12afed-044b-49a3-bf91-a6b3de8f4fdf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c12afed-044b-49a3-bf91-a6b3de8f4fdf', 'volume_size': 1} Aug 05 10:25:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-65613363-5392-4b79-bf9d-fb6548292a74 tempest-CinderUnicodeTest-1731436236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:25:18 devstack cinder-volume[88613]: DEBUG dbcounter [-] [88613] Writing DB stats cinder:UPDATE=26,cinder:DELETE=2,cinder:SELECT=12,cinder:INSERT=5 {{(pid=88613) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:25:18 devstack cinder-volume[88613]: DEBUG dbcounter [-] [88613] Writing DB stats cinder:SELECT=20,cinder:INSERT=5,cinder:UPDATE=19,cinder:DELETE=2 {{(pid=88613) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:25:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-1dfd71b1-7579-4d86-a87f-6292acf8c98e tempest-VolumesActionsTest-508274144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 27.377s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:25:19 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1dfd71b1-7579-4d86-a87f-6292acf8c98e tempest-VolumesActionsTest-508274144 None] Uploaded volume to glance image-id: 8e5ae36a-d56d-42d2-87df-628faa6cbc4e. {{(pid=88613) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 05 10:25:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-05578fe0-ab43-4c00-a881-9145ef979927 tempest-VolumesSnapshotListTestJSON-1551204288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 26.645s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:25:19 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-05578fe0-ab43-4c00-a881-9145ef979927 tempest-VolumesSnapshotListTestJSON-1551204288 None] Creating offline snapshot 2e93e02f-a6a4-4ff6-b5c2-bc0131445433 of volume 7372aaad-6cff-4967-9e24-7d937657b1a9 {{(pid=88613) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:25:19 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-1dfd71b1-7579-4d86-a87f-6292acf8c98e tempest-VolumesActionsTest-508274144 None] Copy volume to image completed successfully. Aug 05 10:25:19 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b3ee196-d4d2-488b-a83b-5d18bbd146b9]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:25:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-05578fe0-ab43-4c00-a881-9145ef979927 tempest-VolumesSnapshotListTestJSON-1551204288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:19 devstack sudo[100871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9 Aug 05 10:25:19 devstack sudo[100871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:19 devstack sudo[100871]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-05578fe0-ab43-4c00-a881-9145ef979927 tempest-VolumesSnapshotListTestJSON-1551204288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9" returned: 0 in 0.394s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-05578fe0-ab43-4c00-a881-9145ef979927 tempest-VolumesSnapshotListTestJSON-1551204288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.2e93e02f-a6a4-4ff6-b5c2-bc0131445433 1G {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:20 devstack sudo[101119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.2e93e02f-a6a4-4ff6-b5c2-bc0131445433 1G Aug 05 10:25:20 devstack sudo[101119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:20 devstack sudo[101119]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-05578fe0-ab43-4c00-a881-9145ef979927 tempest-VolumesSnapshotListTestJSON-1551204288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.2e93e02f-a6a4-4ff6-b5c2-bc0131445433 1G" returned: 0 in 0.453s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-05578fe0-ab43-4c00-a881-9145ef979927 tempest-VolumesSnapshotListTestJSON-1551204288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7372aaad-6cff-4967-9e24-7d937657b1a9 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.2e93e02f-a6a4-4ff6-b5c2-bc0131445433 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:20 devstack sudo[101298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7372aaad-6cff-4967-9e24-7d937657b1a9 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.2e93e02f-a6a4-4ff6-b5c2-bc0131445433 Aug 05 10:25:20 devstack sudo[101298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:20 devstack sudo[101298]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-05578fe0-ab43-4c00-a881-9145ef979927 tempest-VolumesSnapshotListTestJSON-1551204288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7372aaad-6cff-4967-9e24-7d937657b1a9 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.2e93e02f-a6a4-4ff6-b5c2-bc0131445433" returned: 0 in 0.300s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:20 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-05578fe0-ab43-4c00-a881-9145ef979927 tempest-VolumesSnapshotListTestJSON-1551204288 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.2e93e02f-a6a4-4ff6-b5c2-bc0131445433 is being set with open permissions: ugo+rw Aug 05 10:25:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-05578fe0-ab43-4c00-a881-9145ef979927 tempest-VolumesSnapshotListTestJSON-1551204288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.2e93e02f-a6a4-4ff6-b5c2-bc0131445433 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:20 devstack sudo[101304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.2e93e02f-a6a4-4ff6-b5c2-bc0131445433 Aug 05 10:25:20 devstack sudo[101304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:20 devstack sudo[101304]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-05578fe0-ab43-4c00-a881-9145ef979927 tempest-VolumesSnapshotListTestJSON-1551204288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.2e93e02f-a6a4-4ff6-b5c2-bc0131445433" returned: 0 in 0.271s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-247735da-4dd5-4337-9fac-fda42401890c tempest-VolumesActionsTest-508274144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:25:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-05578fe0-ab43-4c00-a881-9145ef979927 tempest-VolumesSnapshotListTestJSON-1551204288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:21 devstack sudo[101307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.info Aug 05 10:25:21 devstack sudo[101307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:21 devstack sudo[101307]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-05578fe0-ab43-4c00-a881-9145ef979927 tempest-VolumesSnapshotListTestJSON-1551204288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.info" returned: 0 in 0.264s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:21 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-05578fe0-ab43-4c00-a881-9145ef979927 tempest-VolumesSnapshotListTestJSON-1551204288 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.info is being set with open permissions: ugo+rw Aug 05 10:25:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-05578fe0-ab43-4c00-a881-9145ef979927 tempest-VolumesSnapshotListTestJSON-1551204288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:21 devstack sudo[101310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.info Aug 05 10:25:21 devstack sudo[101310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:21 devstack sudo[101310]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-05578fe0-ab43-4c00-a881-9145ef979927 tempest-VolumesSnapshotListTestJSON-1551204288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.info" returned: 0 in 0.246s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-05578fe0-ab43-4c00-a881-9145ef979927 tempest-VolumesSnapshotListTestJSON-1551204288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.020s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:25:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2aeecb5d-d75f-49a4-b141-d312ffde1605 tempest-VolumesTransfersV355Test-950682207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 21.309s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:25:21 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-2aeecb5d-d75f-49a4-b141-d312ffde1605 tempest-VolumesTransfersV355Test-950682207 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:25:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1633542018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b2cd61a-3198-4c99-9f7f-90bfb22415a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='375fdab5c07a4ccdb299289940f4dbac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:25:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:25:00Z,use_quota=True,user_id='242fc8027f554c88945926af1017656d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:25:21 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-2aeecb5d-d75f-49a4-b141-d312ffde1605 tempest-VolumesTransfersV355Test-950682207 None] Creating volume 8b2cd61a-3198-4c99-9f7f-90bfb22415a6 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:25:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2aeecb5d-d75f-49a4-b141-d312ffde1605 tempest-VolumesTransfersV355Test-950682207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:25:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2aeecb5d-d75f-49a4-b141-d312ffde1605 tempest-VolumesTransfersV355Test-950682207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:25:21 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-2aeecb5d-d75f-49a4-b141-d312ffde1605 tempest-VolumesTransfersV355Test-950682207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:25:21 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-2aeecb5d-d75f-49a4-b141-d312ffde1605 tempest-VolumesTransfersV355Test-950682207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:25:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2aeecb5d-d75f-49a4-b141-d312ffde1605 tempest-VolumesTransfersV355Test-950682207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:25:21 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-2aeecb5d-d75f-49a4-b141-d312ffde1605 tempest-VolumesTransfersV355Test-950682207 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:25:21 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-2aeecb5d-d75f-49a4-b141-d312ffde1605 tempest-VolumesTransfersV355Test-950682207 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:25:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2aeecb5d-d75f-49a4-b141-d312ffde1605 tempest-VolumesTransfersV355Test-950682207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8b2cd61a-3198-4c99-9f7f-90bfb22415a6 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:21 devstack sudo[101313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8b2cd61a-3198-4c99-9f7f-90bfb22415a6 1073741824 Aug 05 10:25:21 devstack sudo[101313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:21 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-05578fe0-ab43-4c00-a881-9145ef979927 tempest-VolumesSnapshotListTestJSON-1551204288 None] Create snapshot completed successfully Aug 05 10:25:21 devstack cinder-volume[88613]: DEBUG oslo_service.periodic_task [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88613) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:25:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:25:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:25:21 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:25:21 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:25:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:25:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:21 devstack sudo[101315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:25:21 devstack sudo[101315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:22 devstack sudo[101315]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:22 devstack sudo[101313]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.243s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:22 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:25:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2aeecb5d-d75f-49a4-b141-d312ffde1605 tempest-VolumesTransfersV355Test-950682207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8b2cd61a-3198-4c99-9f7f-90bfb22415a6 1073741824" returned: 0 in 0.437s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:22 devstack cinder-volume[88613]: DEBUG oslo_service.periodic_task [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Running periodic task VolumeManager._thread_info {{(pid=88613) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:25:22 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] thread count: 28 {{(pid=88613) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 10:25:22 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] thread info: [<_MainThread(MainThread, started 126173666128000)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88613) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 10:25:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2aeecb5d-d75f-49a4-b141-d312ffde1605 tempest-VolumesTransfersV355Test-950682207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8b2cd61a-3198-4c99-9f7f-90bfb22415a6 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:22 devstack sudo[101321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8b2cd61a-3198-4c99-9f7f-90bfb22415a6 Aug 05 10:25:22 devstack sudo[101321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:22 devstack sudo[101321]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2aeecb5d-d75f-49a4-b141-d312ffde1605 tempest-VolumesTransfersV355Test-950682207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8b2cd61a-3198-4c99-9f7f-90bfb22415a6" returned: 0 in 0.266s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:22 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-2aeecb5d-d75f-49a4-b141-d312ffde1605 tempest-VolumesTransfersV355Test-950682207 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:25:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2aeecb5d-d75f-49a4-b141-d312ffde1605 tempest-VolumesTransfersV355Test-950682207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:25:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-65613363-5392-4b79-bf9d-fb6548292a74 tempest-CinderUnicodeTest-1731436236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.894s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:25:22 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-65613363-5392-4b79-bf9d-fb6548292a74 tempest-CinderUnicodeTest-1731436236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:25:08Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c12afed-044b-49a3-bf91-a6b3de8f4fdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eabc7d8bc78c44c5934c3b722ac290c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:25:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:25:08Z,use_quota=True,user_id='6751740867a040a2b463aadb3ce8b963',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:25:22 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-65613363-5392-4b79-bf9d-fb6548292a74 tempest-CinderUnicodeTest-1731436236 None] Creating volume 9c12afed-044b-49a3-bf91-a6b3de8f4fdf {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:25:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-65613363-5392-4b79-bf9d-fb6548292a74 tempest-CinderUnicodeTest-1731436236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:25:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-65613363-5392-4b79-bf9d-fb6548292a74 tempest-CinderUnicodeTest-1731436236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:25:22 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-65613363-5392-4b79-bf9d-fb6548292a74 tempest-CinderUnicodeTest-1731436236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:25:22 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-65613363-5392-4b79-bf9d-fb6548292a74 tempest-CinderUnicodeTest-1731436236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:25:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-65613363-5392-4b79-bf9d-fb6548292a74 tempest-CinderUnicodeTest-1731436236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:25:22 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-65613363-5392-4b79-bf9d-fb6548292a74 tempest-CinderUnicodeTest-1731436236 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:25:22 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-65613363-5392-4b79-bf9d-fb6548292a74 tempest-CinderUnicodeTest-1731436236 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:25:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-65613363-5392-4b79-bf9d-fb6548292a74 tempest-CinderUnicodeTest-1731436236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9c12afed-044b-49a3-bf91-a6b3de8f4fdf 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:22 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2aeecb5d-d75f-49a4-b141-d312ffde1605 tempest-VolumesTransfersV355Test-950682207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (983b7530-c184-4044-83a2-5f06d9f4204a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b2cd61a-3198-4c99-9f7f-90bfb22415a6', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:22 devstack sudo[101324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9c12afed-044b-49a3-bf91-a6b3de8f4fdf 1073741824 Aug 05 10:25:22 devstack sudo[101324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:22 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2aeecb5d-d75f-49a4-b141-d312ffde1605 tempest-VolumesTransfersV355Test-950682207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eecd5252-5c21-42f3-9caf-12f3b28d98bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:22 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-2aeecb5d-d75f-49a4-b141-d312ffde1605 tempest-VolumesTransfersV355Test-950682207 None] Volume volume-8b2cd61a-3198-4c99-9f7f-90bfb22415a6 (8b2cd61a-3198-4c99-9f7f-90bfb22415a6): created successfully Aug 05 10:25:22 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2aeecb5d-d75f-49a4-b141-d312ffde1605 tempest-VolumesTransfersV355Test-950682207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eecd5252-5c21-42f3-9caf-12f3b28d98bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:22 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2aeecb5d-d75f-49a4-b141-d312ffde1605 tempest-VolumesTransfersV355Test-950682207 None] Flow 'volume_create_manager' (25708a3d-b680-46ee-9835-ee71a5202359) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:25:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c9b750b0-d36b-4e35-b74e-59ed2923b0e3 tempest-VolumesSnapshotListTestJSON-1551204288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:25:22 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-2aeecb5d-d75f-49a4-b141-d312ffde1605 tempest-VolumesTransfersV355Test-950682207 None] Created volume successfully. Aug 05 10:25:22 devstack sudo[101324]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-65613363-5392-4b79-bf9d-fb6548292a74 tempest-CinderUnicodeTest-1731436236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9c12afed-044b-49a3-bf91-a6b3de8f4fdf 1073741824" returned: 0 in 0.452s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-65613363-5392-4b79-bf9d-fb6548292a74 tempest-CinderUnicodeTest-1731436236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9c12afed-044b-49a3-bf91-a6b3de8f4fdf {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:22 devstack sudo[101330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9c12afed-044b-49a3-bf91-a6b3de8f4fdf Aug 05 10:25:22 devstack sudo[101330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:22 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-94fbc181-bb4c-4beb-bc8b-5836df625b27 tempest-VolumesTransfersV355Test-1858234329 None] Acquiring lock "cinder-8b2cd61a-3198-4c99-9f7f-90bfb22415a6-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:25:22 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-94fbc181-bb4c-4beb-bc8b-5836df625b27 tempest-VolumesTransfersV355Test-1858234329 None] Lock "cinder-8b2cd61a-3198-4c99-9f7f-90bfb22415a6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:25:22 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-94fbc181-bb4c-4beb-bc8b-5836df625b27 tempest-VolumesTransfersV355Test-1858234329 None] Acquiring lock "cinder-quobyte-8b2cd61a-3198-4c99-9f7f-90bfb22415a6" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:25:22 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-94fbc181-bb4c-4beb-bc8b-5836df625b27 tempest-VolumesTransfersV355Test-1858234329 None] Lock "cinder-quobyte-8b2cd61a-3198-4c99-9f7f-90bfb22415a6" acquired by "delete_volume" :: waited 0.014s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:25:23 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7922c3-4374-4267-87e9-7a96abde50aa]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:25:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-94fbc181-bb4c-4beb-bc8b-5836df625b27 tempest-VolumesTransfersV355Test-1858234329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8b2cd61a-3198-4c99-9f7f-90bfb22415a6 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:23 devstack sudo[101330]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-65613363-5392-4b79-bf9d-fb6548292a74 tempest-CinderUnicodeTest-1731436236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9c12afed-044b-49a3-bf91-a6b3de8f4fdf" returned: 0 in 0.279s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:23 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-65613363-5392-4b79-bf9d-fb6548292a74 tempest-CinderUnicodeTest-1731436236 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:25:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-65613363-5392-4b79-bf9d-fb6548292a74 tempest-CinderUnicodeTest-1731436236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:25:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-247735da-4dd5-4337-9fac-fda42401890c tempest-VolumesActionsTest-508274144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.104s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:25:23 devstack sudo[101332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8b2cd61a-3198-4c99-9f7f-90bfb22415a6 Aug 05 10:25:23 devstack sudo[101332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:23 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-65613363-5392-4b79-bf9d-fb6548292a74 tempest-CinderUnicodeTest-1731436236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a87fe4d4-c1c9-4965-8fc0-45ab0241b132) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c12afed-044b-49a3-bf91-a6b3de8f4fdf', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:23 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-65613363-5392-4b79-bf9d-fb6548292a74 tempest-CinderUnicodeTest-1731436236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb8f15f8-0b61-4cc0-94dc-3c66ddbd74a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:23 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c9da99-6fee-4109-81a4-b64d06bdded9]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:25:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-247735da-4dd5-4337-9fac-fda42401890c tempest-VolumesActionsTest-508274144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ce011fe7-2b40-453b-9a5f-a8f03f3662d2 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:23 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-65613363-5392-4b79-bf9d-fb6548292a74 tempest-CinderUnicodeTest-1731436236 None] Volume volume-9c12afed-044b-49a3-bf91-a6b3de8f4fdf (9c12afed-044b-49a3-bf91-a6b3de8f4fdf): created successfully Aug 05 10:25:23 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-65613363-5392-4b79-bf9d-fb6548292a74 tempest-CinderUnicodeTest-1731436236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb8f15f8-0b61-4cc0-94dc-3c66ddbd74a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:23 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-65613363-5392-4b79-bf9d-fb6548292a74 tempest-CinderUnicodeTest-1731436236 None] Flow 'volume_create_manager' (31720f9b-8a31-4de8-a5be-3303284996c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:25:23 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-65613363-5392-4b79-bf9d-fb6548292a74 tempest-CinderUnicodeTest-1731436236 None] Created volume successfully. Aug 05 10:25:23 devstack sudo[101335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ce011fe7-2b40-453b-9a5f-a8f03f3662d2 Aug 05 10:25:23 devstack sudo[101335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:23 devstack sudo[101332]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-94fbc181-bb4c-4beb-bc8b-5836df625b27 tempest-VolumesTransfersV355Test-1858234329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8b2cd61a-3198-4c99-9f7f-90bfb22415a6" returned: 0 in 0.375s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-94fbc181-bb4c-4beb-bc8b-5836df625b27 tempest-VolumesTransfersV355Test-1858234329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8b2cd61a-3198-4c99-9f7f-90bfb22415a6 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:23 devstack sudo[101340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8b2cd61a-3198-4c99-9f7f-90bfb22415a6 Aug 05 10:25:23 devstack sudo[101340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:23 devstack sudo[101335]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-247735da-4dd5-4337-9fac-fda42401890c tempest-VolumesActionsTest-508274144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ce011fe7-2b40-453b-9a5f-a8f03f3662d2" returned: 0 in 0.376s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:23 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf372052-4da8-4aa0-b270-ba130d00d1db]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:25:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-247735da-4dd5-4337-9fac-fda42401890c tempest-VolumesActionsTest-508274144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ce011fe7-2b40-453b-9a5f-a8f03f3662d2 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:23 devstack sudo[101345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ce011fe7-2b40-453b-9a5f-a8f03f3662d2 Aug 05 10:25:23 devstack sudo[101345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:23 devstack sudo[101340]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-94fbc181-bb4c-4beb-bc8b-5836df625b27 tempest-VolumesTransfersV355Test-1858234329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8b2cd61a-3198-4c99-9f7f-90bfb22415a6" returned: 0 in 0.266s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:23 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-94fbc181-bb4c-4beb-bc8b-5836df625b27 tempest-VolumesTransfersV355Test-1858234329 None] Lock "cinder-quobyte-8b2cd61a-3198-4c99-9f7f-90bfb22415a6" released by "delete_volume" :: held 0.681s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:25:23 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-94fbc181-bb4c-4beb-bc8b-5836df625b27 tempest-VolumesTransfersV355Test-1858234329 None] Created reservations ['25fe4cfd-9ea9-4fba-ae42-a011553458dd', '72eef263-99dd-4b59-816a-985a9642e9a2', 'f99ac1bc-812f-474b-9f2b-6d4cf0d2809d', '695b1547-5234-4ad8-9657-64df98572322'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:25:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-94fbc181-bb4c-4beb-bc8b-5836df625b27 tempest-VolumesTransfersV355Test-1858234329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:25:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-94fbc181-bb4c-4beb-bc8b-5836df625b27 tempest-VolumesTransfersV355Test-1858234329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:25:23 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-94fbc181-bb4c-4beb-bc8b-5836df625b27 tempest-VolumesTransfersV355Test-1858234329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:25:23 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-94fbc181-bb4c-4beb-bc8b-5836df625b27 tempest-VolumesTransfersV355Test-1858234329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:25:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-94fbc181-bb4c-4beb-bc8b-5836df625b27 tempest-VolumesTransfersV355Test-1858234329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:25:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-94fbc181-bb4c-4beb-bc8b-5836df625b27 tempest-VolumesTransfersV355Test-1858234329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:23 devstack sudo[101348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:25:23 devstack sudo[101348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:23 devstack sudo[101345]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-247735da-4dd5-4337-9fac-fda42401890c tempest-VolumesActionsTest-508274144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ce011fe7-2b40-453b-9a5f-a8f03f3662d2" returned: 0 in 0.358s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-247735da-4dd5-4337-9fac-fda42401890c tempest-VolumesActionsTest-508274144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ce011fe7-2b40-453b-9a5f-a8f03f3662d2 /opt/stack/data/cinder/conversion/ce011fe7-2b40-453b-9a5f-a8f03f3662d2.temp_image.cbbb8f55-4193-4c31-8429-3b3769c1a67f1gwtk68q.img {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:23 devstack sudo[101353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ce011fe7-2b40-453b-9a5f-a8f03f3662d2 /opt/stack/data/cinder/conversion/ce011fe7-2b40-453b-9a5f-a8f03f3662d2.temp_image.cbbb8f55-4193-4c31-8429-3b3769c1a67f1gwtk68q.img Aug 05 10:25:23 devstack sudo[101353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:24 devstack sudo[101348]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:24 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-94fbc181-bb4c-4beb-bc8b-5836df625b27 tempest-VolumesTransfersV355Test-1858234329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.260s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:24 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-94fbc181-bb4c-4beb-bc8b-5836df625b27 tempest-VolumesTransfersV355Test-1858234329 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:25:24 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-94fbc181-bb4c-4beb-bc8b-5836df625b27 tempest-VolumesTransfersV355Test-1858234329 None] Deleted volume successfully. Aug 05 10:25:24 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-94fbc181-bb4c-4beb-bc8b-5836df625b27 tempest-VolumesTransfersV355Test-1858234329 None] Lock "cinder-8b2cd61a-3198-4c99-9f7f-90bfb22415a6-delete_volume" released by "delete_volume" :: held 1.135s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:25:25 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-598381ea-572a-4438-a9be-c8b00f580001 tempest-CinderUnicodeTest-1731436236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:25:25 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-598381ea-572a-4438-a9be-c8b00f580001 tempest-CinderUnicodeTest-1731436236 None] Flow 'volume_create_manager' (b8d8abb4-a88e-4550-8165-ffeff926c02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:25:25 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-598381ea-572a-4438-a9be-c8b00f580001 tempest-CinderUnicodeTest-1731436236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (913eb7e5-36a9-4a11-bbe0-339de8a4a70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:25 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-598381ea-572a-4438-a9be-c8b00f580001 tempest-CinderUnicodeTest-1731436236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (913eb7e5-36a9-4a11-bbe0-339de8a4a70b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:25:25Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-12276487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=983a09dc-6230-4e17-b3e5-999ead2dec79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eabc7d8bc78c44c5934c3b722ac290c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:25:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:25:26Z,use_quota=True,user_id='6751740867a040a2b463aadb3ce8b963',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:25 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-598381ea-572a-4438-a9be-c8b00f580001 tempest-CinderUnicodeTest-1731436236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57f07502-09b7-4879-affd-a3be0bb7c9da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:25 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-598381ea-572a-4438-a9be-c8b00f580001 tempest-CinderUnicodeTest-1731436236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57f07502-09b7-4879-affd-a3be0bb7c9da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:25 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-598381ea-572a-4438-a9be-c8b00f580001 tempest-CinderUnicodeTest-1731436236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0077069-619b-40ff-98c5-d0712a5af429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:25 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-598381ea-572a-4438-a9be-c8b00f580001 tempest-CinderUnicodeTest-1731436236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0077069-619b-40ff-98c5-d0712a5af429) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '983a09dc-6230-4e17-b3e5-999ead2dec79', 'volume_name': 'volume-983a09dc-6230-4e17-b3e5-999ead2dec79', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:25 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-598381ea-572a-4438-a9be-c8b00f580001 tempest-CinderUnicodeTest-1731436236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a841223-b0ac-4594-81bf-ba13c12c5032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:25 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-598381ea-572a-4438-a9be-c8b00f580001 tempest-CinderUnicodeTest-1731436236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a841223-b0ac-4594-81bf-ba13c12c5032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:25 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-598381ea-572a-4438-a9be-c8b00f580001 tempest-CinderUnicodeTest-1731436236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de3e5fc9-f2bd-4bff-a1df-ff8f51f9e724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:25 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-598381ea-572a-4438-a9be-c8b00f580001 tempest-CinderUnicodeTest-1731436236 None] Volume 983a09dc-6230-4e17-b3e5-999ead2dec79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-983a09dc-6230-4e17-b3e5-999ead2dec79', 'volume_size': 1} Aug 05 10:25:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-598381ea-572a-4438-a9be-c8b00f580001 tempest-CinderUnicodeTest-1731436236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:25:29 devstack sudo[101353]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:29 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-247735da-4dd5-4337-9fac-fda42401890c tempest-VolumesActionsTest-508274144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ce011fe7-2b40-453b-9a5f-a8f03f3662d2 /opt/stack/data/cinder/conversion/ce011fe7-2b40-453b-9a5f-a8f03f3662d2.temp_image.cbbb8f55-4193-4c31-8429-3b3769c1a67f1gwtk68q.img" returned: 0 in 5.199s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:29 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c1ad88-2aa2-4996-ab8a-5be3fa9a9632]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:25:29 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-247735da-4dd5-4337-9fac-fda42401890c tempest-VolumesActionsTest-508274144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ce011fe7-2b40-453b-9a5f-a8f03f3662d2 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:29 devstack sudo[101367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ce011fe7-2b40-453b-9a5f-a8f03f3662d2 Aug 05 10:25:29 devstack sudo[101367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:29 devstack sudo[101367]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:29 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-247735da-4dd5-4337-9fac-fda42401890c tempest-VolumesActionsTest-508274144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ce011fe7-2b40-453b-9a5f-a8f03f3662d2" returned: 0 in 0.649s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:29 devstack cinder-volume[88613]: DEBUG cinder.image.image_utils [None req-247735da-4dd5-4337-9fac-fda42401890c tempest-VolumesActionsTest-508274144 None] Image conversion details: src /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ce011fe7-2b40-453b-9a5f-a8f03f3662d2, size 1024.00 MB, duration 5.20 sec, destination /opt/stack/data/cinder/conversion/ce011fe7-2b40-453b-9a5f-a8f03f3662d2.temp_image.cbbb8f55-4193-4c31-8429-3b3769c1a67f1gwtk68q.img {{(pid=88613) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 10:25:29 devstack cinder-volume[88613]: INFO cinder.image.image_utils [None req-247735da-4dd5-4337-9fac-fda42401890c tempest-VolumesActionsTest-508274144 None] Converted 1024.00 MB image at 196.91 MB/s Aug 05 10:25:29 devstack cinder-volume[88613]: DEBUG cinder.image.image_utils [None req-247735da-4dd5-4337-9fac-fda42401890c tempest-VolumesActionsTest-508274144 None] cbbb8f55-4193-4c31-8429-3b3769c1a67f was raw, converting to qcow2 {{(pid=88613) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Aug 05 10:25:29 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9627121-5120-4dd1-95a2-fec968f722a6]: (4, 'raw') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:25:29 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-247735da-4dd5-4337-9fac-fda42401890c tempest-VolumesActionsTest-508274144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/ce011fe7-2b40-453b-9a5f-a8f03f3662d2.temp_image.cbbb8f55-4193-4c31-8429-3b3769c1a67f1gwtk68q.img {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:29 devstack sudo[101372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/ce011fe7-2b40-453b-9a5f-a8f03f3662d2.temp_image.cbbb8f55-4193-4c31-8429-3b3769c1a67f1gwtk68q.img Aug 05 10:25:29 devstack sudo[101372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:30 devstack sudo[101372]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:30 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-247735da-4dd5-4337-9fac-fda42401890c tempest-VolumesActionsTest-508274144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/ce011fe7-2b40-453b-9a5f-a8f03f3662d2.temp_image.cbbb8f55-4193-4c31-8429-3b3769c1a67f1gwtk68q.img" returned: 0 in 0.343s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:30 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-247735da-4dd5-4337-9fac-fda42401890c tempest-VolumesActionsTest-508274144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ce011fe7-2b40-453b-9a5f-a8f03f3662d2.temp_image.cbbb8f55-4193-4c31-8429-3b3769c1a67f1gwtk68q.img {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:30 devstack sudo[101376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ce011fe7-2b40-453b-9a5f-a8f03f3662d2.temp_image.cbbb8f55-4193-4c31-8429-3b3769c1a67f1gwtk68q.img Aug 05 10:25:30 devstack sudo[101376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:30 devstack sudo[101376]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:30 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-247735da-4dd5-4337-9fac-fda42401890c tempest-VolumesActionsTest-508274144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ce011fe7-2b40-453b-9a5f-a8f03f3662d2.temp_image.cbbb8f55-4193-4c31-8429-3b3769c1a67f1gwtk68q.img" returned: 1 in 0.370s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:30 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-247735da-4dd5-4337-9fac-fda42401890c tempest-VolumesActionsTest-508274144 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ce011fe7-2b40-453b-9a5f-a8f03f3662d2.temp_image.cbbb8f55-4193-4c31-8429-3b3769c1a67f1gwtk68q.img' failed. Not Retrying. {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 10:25:30 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-247735da-4dd5-4337-9fac-fda42401890c tempest-VolumesActionsTest-508274144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/ce011fe7-2b40-453b-9a5f-a8f03f3662d2.temp_image.cbbb8f55-4193-4c31-8429-3b3769c1a67f1gwtk68q.img /opt/stack/data/cinder/conversion/vol_upload_o22g8m77 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:30 devstack sudo[101381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/ce011fe7-2b40-453b-9a5f-a8f03f3662d2.temp_image.cbbb8f55-4193-4c31-8429-3b3769c1a67f1gwtk68q.img /opt/stack/data/cinder/conversion/vol_upload_o22g8m77 Aug 05 10:25:30 devstack sudo[101381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:30 devstack sudo[101381]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:30 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-247735da-4dd5-4337-9fac-fda42401890c tempest-VolumesActionsTest-508274144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/ce011fe7-2b40-453b-9a5f-a8f03f3662d2.temp_image.cbbb8f55-4193-4c31-8429-3b3769c1a67f1gwtk68q.img /opt/stack/data/cinder/conversion/vol_upload_o22g8m77" returned: 0 in 0.277s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:30 devstack cinder-volume[88613]: DEBUG cinder.image.image_utils [None req-247735da-4dd5-4337-9fac-fda42401890c tempest-VolumesActionsTest-508274144 None] Image conversion details: src /opt/stack/data/cinder/conversion/ce011fe7-2b40-453b-9a5f-a8f03f3662d2.temp_image.cbbb8f55-4193-4c31-8429-3b3769c1a67f1gwtk68q.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_o22g8m77 {{(pid=88613) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 10:25:30 devstack cinder-volume[88613]: INFO cinder.image.image_utils [None req-247735da-4dd5-4337-9fac-fda42401890c tempest-VolumesActionsTest-508274144 None] Converted 1024.00 MB image at 1024.00 MB/s Aug 05 10:25:30 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[830d8eec-0f89-4c12-9890-781c21de1f33]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:25:30 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-247735da-4dd5-4337-9fac-fda42401890c tempest-VolumesActionsTest-508274144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_o22g8m77 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:30 devstack sudo[101387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_o22g8m77 Aug 05 10:25:30 devstack sudo[101387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:31 devstack sudo[101387]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:31 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-247735da-4dd5-4337-9fac-fda42401890c tempest-VolumesActionsTest-508274144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_o22g8m77" returned: 0 in 0.355s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:32 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-12f2b300-a240-4130-8e21-0f64b276b369 tempest-VolumesCloneNegativeTest-812329086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:25:32 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-12f2b300-a240-4130-8e21-0f64b276b369 tempest-VolumesCloneNegativeTest-812329086 None] Flow 'volume_create_manager' (54244b24-53bc-41f1-9bb9-13e1dc7366a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:25:32 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-12f2b300-a240-4130-8e21-0f64b276b369 tempest-VolumesCloneNegativeTest-812329086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (357609db-0830-42c5-971a-abe7274a5169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:32 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-12f2b300-a240-4130-8e21-0f64b276b369 tempest-VolumesCloneNegativeTest-812329086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (357609db-0830-42c5-971a-abe7274a5169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:25:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-778198983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee490fef-acb1-41a9-b518-7926df24d000,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db5d26d701d94d11a598a4e2a30a0f89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:25:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:25:32Z,use_quota=True,user_id='5f070f22016f4b559db3e76a5d30fb53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:32 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-12f2b300-a240-4130-8e21-0f64b276b369 tempest-VolumesCloneNegativeTest-812329086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de44d583-618d-41ab-88e9-7542a764f641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:32 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-12f2b300-a240-4130-8e21-0f64b276b369 tempest-VolumesCloneNegativeTest-812329086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de44d583-618d-41ab-88e9-7542a764f641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:32 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-12f2b300-a240-4130-8e21-0f64b276b369 tempest-VolumesCloneNegativeTest-812329086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db7bf2a3-c750-49e7-819a-f78745cd4301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:32 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-12f2b300-a240-4130-8e21-0f64b276b369 tempest-VolumesCloneNegativeTest-812329086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db7bf2a3-c750-49e7-819a-f78745cd4301) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee490fef-acb1-41a9-b518-7926df24d000', 'volume_name': 'volume-ee490fef-acb1-41a9-b518-7926df24d000', 'volume_size': 2}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:32 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-12f2b300-a240-4130-8e21-0f64b276b369 tempest-VolumesCloneNegativeTest-812329086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14983e55-cf59-4f13-85df-12c17c5afac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:32 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-12f2b300-a240-4130-8e21-0f64b276b369 tempest-VolumesCloneNegativeTest-812329086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14983e55-cf59-4f13-85df-12c17c5afac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:32 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-12f2b300-a240-4130-8e21-0f64b276b369 tempest-VolumesCloneNegativeTest-812329086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2faea48-ace8-470d-b87b-7b06d1d4963a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:32 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-12f2b300-a240-4130-8e21-0f64b276b369 tempest-VolumesCloneNegativeTest-812329086 None] Volume ee490fef-acb1-41a9-b518-7926df24d000: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee490fef-acb1-41a9-b518-7926df24d000', 'volume_size': 2} Aug 05 10:25:32 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-12f2b300-a240-4130-8e21-0f64b276b369 tempest-VolumesCloneNegativeTest-812329086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:25:32 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-247735da-4dd5-4337-9fac-fda42401890c tempest-VolumesActionsTest-508274144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 9.458s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:25:32 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-247735da-4dd5-4337-9fac-fda42401890c tempest-VolumesActionsTest-508274144 None] Uploaded volume to glance image-id: cbbb8f55-4193-4c31-8429-3b3769c1a67f. {{(pid=88613) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 05 10:25:32 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c9b750b0-d36b-4e35-b74e-59ed2923b0e3 tempest-VolumesSnapshotListTestJSON-1551204288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.164s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:25:32 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-c9b750b0-d36b-4e35-b74e-59ed2923b0e3 tempest-VolumesSnapshotListTestJSON-1551204288 None] Creating offline snapshot fcd6a291-45f4-479e-bdbe-6eb05dbd6d6c of volume 7372aaad-6cff-4967-9e24-7d937657b1a9 {{(pid=88613) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:25:32 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-247735da-4dd5-4337-9fac-fda42401890c tempest-VolumesActionsTest-508274144 None] Copy volume to image completed successfully. Aug 05 10:25:32 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[93cd90ee-9b41-4d76-ae02-55ba4f8c96bc]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:25:32 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c9b750b0-d36b-4e35-b74e-59ed2923b0e3 tempest-VolumesSnapshotListTestJSON-1551204288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.2e93e02f-a6a4-4ff6-b5c2-bc0131445433 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:32 devstack sudo[101392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.2e93e02f-a6a4-4ff6-b5c2-bc0131445433 Aug 05 10:25:32 devstack sudo[101392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:32 devstack sudo[101392]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:32 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c9b750b0-d36b-4e35-b74e-59ed2923b0e3 tempest-VolumesSnapshotListTestJSON-1551204288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.2e93e02f-a6a4-4ff6-b5c2-bc0131445433" returned: 0 in 0.342s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:32 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-c9b750b0-d36b-4e35-b74e-59ed2923b0e3 tempest-VolumesSnapshotListTestJSON-1551204288 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7372aaad-6cff-4967-9e24-7d937657b1a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88613) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:25:32 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c9b750b0-d36b-4e35-b74e-59ed2923b0e3 tempest-VolumesSnapshotListTestJSON-1551204288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.2e93e02f-a6a4-4ff6-b5c2-bc0131445433,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.fcd6a291-45f4-479e-bdbe-6eb05dbd6d6c 1G {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:33 devstack sudo[101397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.2e93e02f-a6a4-4ff6-b5c2-bc0131445433,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.fcd6a291-45f4-479e-bdbe-6eb05dbd6d6c 1G Aug 05 10:25:33 devstack sudo[101397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:33 devstack sudo[101397]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:33 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c9b750b0-d36b-4e35-b74e-59ed2923b0e3 tempest-VolumesSnapshotListTestJSON-1551204288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.2e93e02f-a6a4-4ff6-b5c2-bc0131445433,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.fcd6a291-45f4-479e-bdbe-6eb05dbd6d6c 1G" returned: 0 in 0.442s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:33 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c9b750b0-d36b-4e35-b74e-59ed2923b0e3 tempest-VolumesSnapshotListTestJSON-1551204288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7372aaad-6cff-4967-9e24-7d937657b1a9.2e93e02f-a6a4-4ff6-b5c2-bc0131445433 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.fcd6a291-45f4-479e-bdbe-6eb05dbd6d6c {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:33 devstack sudo[101402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7372aaad-6cff-4967-9e24-7d937657b1a9.2e93e02f-a6a4-4ff6-b5c2-bc0131445433 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.fcd6a291-45f4-479e-bdbe-6eb05dbd6d6c Aug 05 10:25:33 devstack sudo[101402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:33 devstack sudo[101402]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:33 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c9b750b0-d36b-4e35-b74e-59ed2923b0e3 tempest-VolumesSnapshotListTestJSON-1551204288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7372aaad-6cff-4967-9e24-7d937657b1a9.2e93e02f-a6a4-4ff6-b5c2-bc0131445433 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.fcd6a291-45f4-479e-bdbe-6eb05dbd6d6c" returned: 0 in 0.343s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:33 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-c9b750b0-d36b-4e35-b74e-59ed2923b0e3 tempest-VolumesSnapshotListTestJSON-1551204288 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.fcd6a291-45f4-479e-bdbe-6eb05dbd6d6c is being set with open permissions: ugo+rw Aug 05 10:25:33 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c9b750b0-d36b-4e35-b74e-59ed2923b0e3 tempest-VolumesSnapshotListTestJSON-1551204288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.fcd6a291-45f4-479e-bdbe-6eb05dbd6d6c {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:33 devstack sudo[101408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.fcd6a291-45f4-479e-bdbe-6eb05dbd6d6c Aug 05 10:25:33 devstack sudo[101408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:34 devstack sudo[101408]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:34 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c9b750b0-d36b-4e35-b74e-59ed2923b0e3 tempest-VolumesSnapshotListTestJSON-1551204288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.fcd6a291-45f4-479e-bdbe-6eb05dbd6d6c" returned: 0 in 0.242s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:34 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c9b750b0-d36b-4e35-b74e-59ed2923b0e3 tempest-VolumesSnapshotListTestJSON-1551204288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.470s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:25:34 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-598381ea-572a-4438-a9be-c8b00f580001 tempest-CinderUnicodeTest-1731436236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.134s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:25:34 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-598381ea-572a-4438-a9be-c8b00f580001 tempest-CinderUnicodeTest-1731436236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:25:25Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-12276487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=983a09dc-6230-4e17-b3e5-999ead2dec79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eabc7d8bc78c44c5934c3b722ac290c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:25:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:25:26Z,use_quota=True,user_id='6751740867a040a2b463aadb3ce8b963',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:25:34 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-598381ea-572a-4438-a9be-c8b00f580001 tempest-CinderUnicodeTest-1731436236 None] Creating volume 983a09dc-6230-4e17-b3e5-999ead2dec79 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:25:34 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-598381ea-572a-4438-a9be-c8b00f580001 tempest-CinderUnicodeTest-1731436236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:25:34 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-598381ea-572a-4438-a9be-c8b00f580001 tempest-CinderUnicodeTest-1731436236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:25:34 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-598381ea-572a-4438-a9be-c8b00f580001 tempest-CinderUnicodeTest-1731436236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:25:34 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-598381ea-572a-4438-a9be-c8b00f580001 tempest-CinderUnicodeTest-1731436236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:25:34 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-598381ea-572a-4438-a9be-c8b00f580001 tempest-CinderUnicodeTest-1731436236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:25:34 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-598381ea-572a-4438-a9be-c8b00f580001 tempest-CinderUnicodeTest-1731436236 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:25:34 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-598381ea-572a-4438-a9be-c8b00f580001 tempest-CinderUnicodeTest-1731436236 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:25:34 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-598381ea-572a-4438-a9be-c8b00f580001 tempest-CinderUnicodeTest-1731436236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-983a09dc-6230-4e17-b3e5-999ead2dec79 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:34 devstack sudo[101411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-983a09dc-6230-4e17-b3e5-999ead2dec79 1073741824 Aug 05 10:25:34 devstack sudo[101411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:34 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-c9b750b0-d36b-4e35-b74e-59ed2923b0e3 tempest-VolumesSnapshotListTestJSON-1551204288 None] Create snapshot completed successfully Aug 05 10:25:34 devstack sudo[101411]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:34 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-598381ea-572a-4438-a9be-c8b00f580001 tempest-CinderUnicodeTest-1731436236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-983a09dc-6230-4e17-b3e5-999ead2dec79 1073741824" returned: 0 in 0.520s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:34 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-598381ea-572a-4438-a9be-c8b00f580001 tempest-CinderUnicodeTest-1731436236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-983a09dc-6230-4e17-b3e5-999ead2dec79 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:34 devstack sudo[101419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-983a09dc-6230-4e17-b3e5-999ead2dec79 Aug 05 10:25:34 devstack sudo[101419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:34 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-f25455a6-48ce-4ae3-8e08-26167ce1f6e7 tempest-VolumesActionsTest-508274144 None] Acquiring lock "cinder-ce011fe7-2b40-453b-9a5f-a8f03f3662d2-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:25:34 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-f25455a6-48ce-4ae3-8e08-26167ce1f6e7 tempest-VolumesActionsTest-508274144 None] Lock "cinder-ce011fe7-2b40-453b-9a5f-a8f03f3662d2-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:25:34 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-f25455a6-48ce-4ae3-8e08-26167ce1f6e7 tempest-VolumesActionsTest-508274144 None] Acquiring lock "cinder-quobyte-ce011fe7-2b40-453b-9a5f-a8f03f3662d2" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:25:34 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-f25455a6-48ce-4ae3-8e08-26167ce1f6e7 tempest-VolumesActionsTest-508274144 None] Lock "cinder-quobyte-ce011fe7-2b40-453b-9a5f-a8f03f3662d2" acquired by "delete_volume" :: waited 0.015s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:25:34 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[b43ff348-655b-4347-a573-03462cd2bc45]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:25:34 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f25455a6-48ce-4ae3-8e08-26167ce1f6e7 tempest-VolumesActionsTest-508274144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ce011fe7-2b40-453b-9a5f-a8f03f3662d2 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:34 devstack sudo[101419]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:34 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-598381ea-572a-4438-a9be-c8b00f580001 tempest-CinderUnicodeTest-1731436236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-983a09dc-6230-4e17-b3e5-999ead2dec79" returned: 0 in 0.268s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:34 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-598381ea-572a-4438-a9be-c8b00f580001 tempest-CinderUnicodeTest-1731436236 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:25:34 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-598381ea-572a-4438-a9be-c8b00f580001 tempest-CinderUnicodeTest-1731436236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:25:34 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-12f2b300-a240-4130-8e21-0f64b276b369 tempest-VolumesCloneNegativeTest-812329086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.610s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:25:34 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-12f2b300-a240-4130-8e21-0f64b276b369 tempest-VolumesCloneNegativeTest-812329086 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:25:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-778198983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee490fef-acb1-41a9-b518-7926df24d000,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db5d26d701d94d11a598a4e2a30a0f89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:25:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:25:32Z,use_quota=True,user_id='5f070f22016f4b559db3e76a5d30fb53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:25:34 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-12f2b300-a240-4130-8e21-0f64b276b369 tempest-VolumesCloneNegativeTest-812329086 None] Creating volume ee490fef-acb1-41a9-b518-7926df24d000 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:25:34 devstack sudo[101421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ce011fe7-2b40-453b-9a5f-a8f03f3662d2 Aug 05 10:25:34 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-12f2b300-a240-4130-8e21-0f64b276b369 tempest-VolumesCloneNegativeTest-812329086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:25:34 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-12f2b300-a240-4130-8e21-0f64b276b369 tempest-VolumesCloneNegativeTest-812329086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:25:34 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-12f2b300-a240-4130-8e21-0f64b276b369 tempest-VolumesCloneNegativeTest-812329086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:25:34 devstack sudo[101421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:34 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-12f2b300-a240-4130-8e21-0f64b276b369 tempest-VolumesCloneNegativeTest-812329086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:25:34 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-12f2b300-a240-4130-8e21-0f64b276b369 tempest-VolumesCloneNegativeTest-812329086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:25:34 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-12f2b300-a240-4130-8e21-0f64b276b369 tempest-VolumesCloneNegativeTest-812329086 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:25:34 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-12f2b300-a240-4130-8e21-0f64b276b369 tempest-VolumesCloneNegativeTest-812329086 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:25:34 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-12f2b300-a240-4130-8e21-0f64b276b369 tempest-VolumesCloneNegativeTest-812329086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ee490fef-acb1-41a9-b518-7926df24d000 2147483648 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:34 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-598381ea-572a-4438-a9be-c8b00f580001 tempest-CinderUnicodeTest-1731436236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de3e5fc9-f2bd-4bff-a1df-ff8f51f9e724) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-983a09dc-6230-4e17-b3e5-999ead2dec79', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:34 devstack sudo[101424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ee490fef-acb1-41a9-b518-7926df24d000 2147483648 Aug 05 10:25:34 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-598381ea-572a-4438-a9be-c8b00f580001 tempest-CinderUnicodeTest-1731436236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4304639-3b10-4716-ac58-db34b2b301b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:34 devstack sudo[101424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:34 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-598381ea-572a-4438-a9be-c8b00f580001 tempest-CinderUnicodeTest-1731436236 None] Volume volume-983a09dc-6230-4e17-b3e5-999ead2dec79 (983a09dc-6230-4e17-b3e5-999ead2dec79): created successfully Aug 05 10:25:34 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-598381ea-572a-4438-a9be-c8b00f580001 tempest-CinderUnicodeTest-1731436236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4304639-3b10-4716-ac58-db34b2b301b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:34 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-598381ea-572a-4438-a9be-c8b00f580001 tempest-CinderUnicodeTest-1731436236 None] Flow 'volume_create_manager' (b8d8abb4-a88e-4550-8165-ffeff926c02a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:25:34 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-598381ea-572a-4438-a9be-c8b00f580001 tempest-CinderUnicodeTest-1731436236 None] Created volume successfully. Aug 05 10:25:35 devstack sudo[101421]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:35 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f25455a6-48ce-4ae3-8e08-26167ce1f6e7 tempest-VolumesActionsTest-508274144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ce011fe7-2b40-453b-9a5f-a8f03f3662d2" returned: 0 in 0.398s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:35 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f25455a6-48ce-4ae3-8e08-26167ce1f6e7 tempest-VolumesActionsTest-508274144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ce011fe7-2b40-453b-9a5f-a8f03f3662d2 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:35 devstack sudo[101431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ce011fe7-2b40-453b-9a5f-a8f03f3662d2 Aug 05 10:25:35 devstack sudo[101431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:35 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-8978accd-9414-4a2e-acbe-fdd5832df9f3 tempest-VolumesSnapshotListTestJSON-1551204288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:25:35 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-6d70aa92-6fb4-4d48-ae2f-d7ea044e5a7f tempest-CinderUnicodeTest-1731436236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:25:35 devstack sudo[101431]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:35 devstack sudo[101424]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:35 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f25455a6-48ce-4ae3-8e08-26167ce1f6e7 tempest-VolumesActionsTest-508274144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ce011fe7-2b40-453b-9a5f-a8f03f3662d2" returned: 0 in 0.389s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:35 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-12f2b300-a240-4130-8e21-0f64b276b369 tempest-VolumesCloneNegativeTest-812329086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ee490fef-acb1-41a9-b518-7926df24d000 2147483648" returned: 0 in 0.674s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:35 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-f25455a6-48ce-4ae3-8e08-26167ce1f6e7 tempest-VolumesActionsTest-508274144 None] Lock "cinder-quobyte-ce011fe7-2b40-453b-9a5f-a8f03f3662d2" released by "delete_volume" :: held 0.827s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:25:35 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-12f2b300-a240-4130-8e21-0f64b276b369 tempest-VolumesCloneNegativeTest-812329086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ee490fef-acb1-41a9-b518-7926df24d000 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:35 devstack sudo[101435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ee490fef-acb1-41a9-b518-7926df24d000 Aug 05 10:25:35 devstack sudo[101435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:35 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-f25455a6-48ce-4ae3-8e08-26167ce1f6e7 tempest-VolumesActionsTest-508274144 None] Created reservations ['55faad5d-0a73-4d48-8f0c-9cb5822643ee', '2ff8c88c-091b-4e48-aed0-8779c8dfa060', '25e05d8e-5031-431d-8958-8ecd77e27d28', 'f9c9a667-4743-4e7a-99fa-e36f16005bed'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:25:35 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-f25455a6-48ce-4ae3-8e08-26167ce1f6e7 tempest-VolumesActionsTest-508274144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:25:35 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-f25455a6-48ce-4ae3-8e08-26167ce1f6e7 tempest-VolumesActionsTest-508274144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:25:35 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-f25455a6-48ce-4ae3-8e08-26167ce1f6e7 tempest-VolumesActionsTest-508274144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:25:35 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-f25455a6-48ce-4ae3-8e08-26167ce1f6e7 tempest-VolumesActionsTest-508274144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:25:35 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-f25455a6-48ce-4ae3-8e08-26167ce1f6e7 tempest-VolumesActionsTest-508274144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:25:35 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f25455a6-48ce-4ae3-8e08-26167ce1f6e7 tempest-VolumesActionsTest-508274144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:35 devstack sudo[101437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:25:35 devstack sudo[101437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:35 devstack sudo[101435]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:35 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-12f2b300-a240-4130-8e21-0f64b276b369 tempest-VolumesCloneNegativeTest-812329086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ee490fef-acb1-41a9-b518-7926df24d000" returned: 0 in 0.263s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:35 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-12f2b300-a240-4130-8e21-0f64b276b369 tempest-VolumesCloneNegativeTest-812329086 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:25:35 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-12f2b300-a240-4130-8e21-0f64b276b369 tempest-VolumesCloneNegativeTest-812329086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:25:35 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-8978accd-9414-4a2e-acbe-fdd5832df9f3 tempest-VolumesSnapshotListTestJSON-1551204288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.405s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:25:35 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-12f2b300-a240-4130-8e21-0f64b276b369 tempest-VolumesCloneNegativeTest-812329086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2faea48-ace8-470d-b87b-7b06d1d4963a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee490fef-acb1-41a9-b518-7926df24d000', 'volume_size': 2}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:35 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-12f2b300-a240-4130-8e21-0f64b276b369 tempest-VolumesCloneNegativeTest-812329086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b100173a-5f9b-4c11-b837-ffe7eba99301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:35 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-8978accd-9414-4a2e-acbe-fdd5832df9f3 tempest-VolumesSnapshotListTestJSON-1551204288 None] Creating offline snapshot 4fb37b30-efd2-4f41-b662-7db52bcb7a82 of volume 7372aaad-6cff-4967-9e24-7d937657b1a9 {{(pid=88613) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:25:35 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-12f2b300-a240-4130-8e21-0f64b276b369 tempest-VolumesCloneNegativeTest-812329086 None] Volume volume-ee490fef-acb1-41a9-b518-7926df24d000 (ee490fef-acb1-41a9-b518-7926df24d000): created successfully Aug 05 10:25:35 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-12f2b300-a240-4130-8e21-0f64b276b369 tempest-VolumesCloneNegativeTest-812329086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b100173a-5f9b-4c11-b837-ffe7eba99301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:35 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-12f2b300-a240-4130-8e21-0f64b276b369 tempest-VolumesCloneNegativeTest-812329086 None] Flow 'volume_create_manager' (54244b24-53bc-41f1-9bb9-13e1dc7366a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:25:35 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79506b3-fb8b-49bc-80e8-ef8b1b6b3668]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:25:35 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-8978accd-9414-4a2e-acbe-fdd5832df9f3 tempest-VolumesSnapshotListTestJSON-1551204288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.fcd6a291-45f4-479e-bdbe-6eb05dbd6d6c {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:35 devstack sudo[101437]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:36 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f25455a6-48ce-4ae3-8e08-26167ce1f6e7 tempest-VolumesActionsTest-508274144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.280s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:36 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-f25455a6-48ce-4ae3-8e08-26167ce1f6e7 tempest-VolumesActionsTest-508274144 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:25:36 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-f25455a6-48ce-4ae3-8e08-26167ce1f6e7 tempest-VolumesActionsTest-508274144 None] Deleted volume successfully. Aug 05 10:25:36 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-12f2b300-a240-4130-8e21-0f64b276b369 tempest-VolumesCloneNegativeTest-812329086 None] Created volume successfully. Aug 05 10:25:36 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-f25455a6-48ce-4ae3-8e08-26167ce1f6e7 tempest-VolumesActionsTest-508274144 None] Lock "cinder-ce011fe7-2b40-453b-9a5f-a8f03f3662d2-delete_volume" released by "delete_volume" :: held 1.344s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:25:36 devstack sudo[101441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.fcd6a291-45f4-479e-bdbe-6eb05dbd6d6c Aug 05 10:25:36 devstack sudo[101441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:36 devstack sudo[101441]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:36 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-8978accd-9414-4a2e-acbe-fdd5832df9f3 tempest-VolumesSnapshotListTestJSON-1551204288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.fcd6a291-45f4-479e-bdbe-6eb05dbd6d6c" returned: 0 in 0.381s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:36 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-8978accd-9414-4a2e-acbe-fdd5832df9f3 tempest-VolumesSnapshotListTestJSON-1551204288 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7372aaad-6cff-4967-9e24-7d937657b1a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88613) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:25:36 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-8978accd-9414-4a2e-acbe-fdd5832df9f3 tempest-VolumesSnapshotListTestJSON-1551204288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.fcd6a291-45f4-479e-bdbe-6eb05dbd6d6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.4fb37b30-efd2-4f41-b662-7db52bcb7a82 1G {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:36 devstack sudo[101446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.fcd6a291-45f4-479e-bdbe-6eb05dbd6d6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.4fb37b30-efd2-4f41-b662-7db52bcb7a82 1G Aug 05 10:25:36 devstack sudo[101446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:36 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-664bfa0f-bdbe-4064-b9b0-2c0df84847be tempest-VolumesCloneNegativeTest-812329086 None] Acquiring lock "cinder-ee490fef-acb1-41a9-b518-7926df24d000-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:25:36 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-664bfa0f-bdbe-4064-b9b0-2c0df84847be tempest-VolumesCloneNegativeTest-812329086 None] Lock "cinder-ee490fef-acb1-41a9-b518-7926df24d000-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:25:36 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-664bfa0f-bdbe-4064-b9b0-2c0df84847be tempest-VolumesCloneNegativeTest-812329086 None] Acquiring lock "cinder-quobyte-ee490fef-acb1-41a9-b518-7926df24d000" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:25:36 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-664bfa0f-bdbe-4064-b9b0-2c0df84847be tempest-VolumesCloneNegativeTest-812329086 None] Lock "cinder-quobyte-ee490fef-acb1-41a9-b518-7926df24d000" acquired by "delete_volume" :: waited 0.028s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:25:36 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da98735-7dc6-41c4-8aef-9dc4c2940724]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:25:36 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-664bfa0f-bdbe-4064-b9b0-2c0df84847be tempest-VolumesCloneNegativeTest-812329086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ee490fef-acb1-41a9-b518-7926df24d000 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:36 devstack sudo[101452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ee490fef-acb1-41a9-b518-7926df24d000 Aug 05 10:25:36 devstack sudo[101452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:36 devstack sudo[101446]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-8978accd-9414-4a2e-acbe-fdd5832df9f3 tempest-VolumesSnapshotListTestJSON-1551204288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.fcd6a291-45f4-479e-bdbe-6eb05dbd6d6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.4fb37b30-efd2-4f41-b662-7db52bcb7a82 1G" returned: 0 in 0.630s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-8978accd-9414-4a2e-acbe-fdd5832df9f3 tempest-VolumesSnapshotListTestJSON-1551204288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7372aaad-6cff-4967-9e24-7d937657b1a9.fcd6a291-45f4-479e-bdbe-6eb05dbd6d6c -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.4fb37b30-efd2-4f41-b662-7db52bcb7a82 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:37 devstack sudo[101454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7372aaad-6cff-4967-9e24-7d937657b1a9.fcd6a291-45f4-479e-bdbe-6eb05dbd6d6c -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.4fb37b30-efd2-4f41-b662-7db52bcb7a82 Aug 05 10:25:37 devstack sudo[101454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:37 devstack sudo[101452]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-664bfa0f-bdbe-4064-b9b0-2c0df84847be tempest-VolumesCloneNegativeTest-812329086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ee490fef-acb1-41a9-b518-7926df24d000" returned: 0 in 0.408s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-664bfa0f-bdbe-4064-b9b0-2c0df84847be tempest-VolumesCloneNegativeTest-812329086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ee490fef-acb1-41a9-b518-7926df24d000 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:37 devstack sudo[101461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ee490fef-acb1-41a9-b518-7926df24d000 Aug 05 10:25:37 devstack sudo[101461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:37 devstack sudo[101454]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-8978accd-9414-4a2e-acbe-fdd5832df9f3 tempest-VolumesSnapshotListTestJSON-1551204288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7372aaad-6cff-4967-9e24-7d937657b1a9.fcd6a291-45f4-479e-bdbe-6eb05dbd6d6c -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.4fb37b30-efd2-4f41-b662-7db52bcb7a82" returned: 0 in 0.312s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:37 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-8978accd-9414-4a2e-acbe-fdd5832df9f3 tempest-VolumesSnapshotListTestJSON-1551204288 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.4fb37b30-efd2-4f41-b662-7db52bcb7a82 is being set with open permissions: ugo+rw Aug 05 10:25:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-8978accd-9414-4a2e-acbe-fdd5832df9f3 tempest-VolumesSnapshotListTestJSON-1551204288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.4fb37b30-efd2-4f41-b662-7db52bcb7a82 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:37 devstack sudo[101465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.4fb37b30-efd2-4f41-b662-7db52bcb7a82 Aug 05 10:25:37 devstack sudo[101465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:37 devstack sudo[101461]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-664bfa0f-bdbe-4064-b9b0-2c0df84847be tempest-VolumesCloneNegativeTest-812329086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ee490fef-acb1-41a9-b518-7926df24d000" returned: 0 in 0.316s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:37 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-664bfa0f-bdbe-4064-b9b0-2c0df84847be tempest-VolumesCloneNegativeTest-812329086 None] Lock "cinder-quobyte-ee490fef-acb1-41a9-b518-7926df24d000" released by "delete_volume" :: held 0.774s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:25:37 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-664bfa0f-bdbe-4064-b9b0-2c0df84847be tempest-VolumesCloneNegativeTest-812329086 None] Created reservations ['341c1ace-a991-4a66-aeb8-3fb5dc026516', '768cf944-b454-4538-85ea-c993b8dd4e03', '6a9b6428-4f2f-42c9-84b6-c1e898cbef70', '25690dc1-a330-45a8-8534-5c421d08c5ef'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:25:37 devstack sudo[101465]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-8978accd-9414-4a2e-acbe-fdd5832df9f3 tempest-VolumesSnapshotListTestJSON-1551204288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.4fb37b30-efd2-4f41-b662-7db52bcb7a82" returned: 0 in 0.329s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-8978accd-9414-4a2e-acbe-fdd5832df9f3 tempest-VolumesSnapshotListTestJSON-1551204288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.792s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:25:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-6d70aa92-6fb4-4d48-ae2f-d7ea044e5a7f tempest-CinderUnicodeTest-1731436236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.176s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:25:37 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-6d70aa92-6fb4-4d48-ae2f-d7ea044e5a7f tempest-CinderUnicodeTest-1731436236 None] Creating offline snapshot 01d39b27-0c05-419d-933c-4b3868bfdf96 of volume 983a09dc-6230-4e17-b3e5-999ead2dec79 {{(pid=88613) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:25:37 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-8978accd-9414-4a2e-acbe-fdd5832df9f3 tempest-VolumesSnapshotListTestJSON-1551204288 None] Create snapshot completed successfully Aug 05 10:25:37 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[f67cabc1-fd46-41e0-af93-402aad2c1c67]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:25:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6d70aa92-6fb4-4d48-ae2f-d7ea044e5a7f tempest-CinderUnicodeTest-1731436236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-983a09dc-6230-4e17-b3e5-999ead2dec79 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-664bfa0f-bdbe-4064-b9b0-2c0df84847be tempest-VolumesCloneNegativeTest-812329086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:25:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-664bfa0f-bdbe-4064-b9b0-2c0df84847be tempest-VolumesCloneNegativeTest-812329086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:25:37 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-664bfa0f-bdbe-4064-b9b0-2c0df84847be tempest-VolumesCloneNegativeTest-812329086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:25:37 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-664bfa0f-bdbe-4064-b9b0-2c0df84847be tempest-VolumesCloneNegativeTest-812329086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:25:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-664bfa0f-bdbe-4064-b9b0-2c0df84847be tempest-VolumesCloneNegativeTest-812329086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:25:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-664bfa0f-bdbe-4064-b9b0-2c0df84847be tempest-VolumesCloneNegativeTest-812329086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:37 devstack sudo[101470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:25:37 devstack sudo[101470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:37 devstack sudo[101469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-983a09dc-6230-4e17-b3e5-999ead2dec79 Aug 05 10:25:37 devstack sudo[101469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:38 devstack sudo[101470]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:38 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-664bfa0f-bdbe-4064-b9b0-2c0df84847be tempest-VolumesCloneNegativeTest-812329086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.295s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:38 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-664bfa0f-bdbe-4064-b9b0-2c0df84847be tempest-VolumesCloneNegativeTest-812329086 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:25:38 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-664bfa0f-bdbe-4064-b9b0-2c0df84847be tempest-VolumesCloneNegativeTest-812329086 None] Deleted volume successfully. Aug 05 10:25:38 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-664bfa0f-bdbe-4064-b9b0-2c0df84847be tempest-VolumesCloneNegativeTest-812329086 None] Lock "cinder-ee490fef-acb1-41a9-b518-7926df24d000-delete_volume" released by "delete_volume" :: held 1.389s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:25:38 devstack sudo[101469]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:38 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6d70aa92-6fb4-4d48-ae2f-d7ea044e5a7f tempest-CinderUnicodeTest-1731436236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-983a09dc-6230-4e17-b3e5-999ead2dec79" returned: 0 in 0.444s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:38 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6d70aa92-6fb4-4d48-ae2f-d7ea044e5a7f tempest-CinderUnicodeTest-1731436236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-983a09dc-6230-4e17-b3e5-999ead2dec79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-983a09dc-6230-4e17-b3e5-999ead2dec79.01d39b27-0c05-419d-933c-4b3868bfdf96 1G {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:38 devstack sudo[101477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-983a09dc-6230-4e17-b3e5-999ead2dec79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-983a09dc-6230-4e17-b3e5-999ead2dec79.01d39b27-0c05-419d-933c-4b3868bfdf96 1G Aug 05 10:25:38 devstack sudo[101477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:38 devstack sudo[101477]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:38 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6d70aa92-6fb4-4d48-ae2f-d7ea044e5a7f tempest-CinderUnicodeTest-1731436236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-983a09dc-6230-4e17-b3e5-999ead2dec79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-983a09dc-6230-4e17-b3e5-999ead2dec79.01d39b27-0c05-419d-933c-4b3868bfdf96 1G" returned: 0 in 0.551s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:38 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6d70aa92-6fb4-4d48-ae2f-d7ea044e5a7f tempest-CinderUnicodeTest-1731436236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-983a09dc-6230-4e17-b3e5-999ead2dec79 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-983a09dc-6230-4e17-b3e5-999ead2dec79.01d39b27-0c05-419d-933c-4b3868bfdf96 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:38 devstack sudo[101483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-983a09dc-6230-4e17-b3e5-999ead2dec79 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-983a09dc-6230-4e17-b3e5-999ead2dec79.01d39b27-0c05-419d-933c-4b3868bfdf96 Aug 05 10:25:38 devstack sudo[101483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:39 devstack sudo[101483]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:39 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6d70aa92-6fb4-4d48-ae2f-d7ea044e5a7f tempest-CinderUnicodeTest-1731436236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-983a09dc-6230-4e17-b3e5-999ead2dec79 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-983a09dc-6230-4e17-b3e5-999ead2dec79.01d39b27-0c05-419d-933c-4b3868bfdf96" returned: 0 in 0.598s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:39 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-6d70aa92-6fb4-4d48-ae2f-d7ea044e5a7f tempest-CinderUnicodeTest-1731436236 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-983a09dc-6230-4e17-b3e5-999ead2dec79.01d39b27-0c05-419d-933c-4b3868bfdf96 is being set with open permissions: ugo+rw Aug 05 10:25:39 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6d70aa92-6fb4-4d48-ae2f-d7ea044e5a7f tempest-CinderUnicodeTest-1731436236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-983a09dc-6230-4e17-b3e5-999ead2dec79.01d39b27-0c05-419d-933c-4b3868bfdf96 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:39 devstack sudo[101489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-983a09dc-6230-4e17-b3e5-999ead2dec79.01d39b27-0c05-419d-933c-4b3868bfdf96 Aug 05 10:25:39 devstack sudo[101489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:39 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-f42affe5-04ba-4fa1-9ccd-42e735bceba8 tempest-VolumesSnapshotListTestJSON-1551204288 None] Acquiring lock "cinder-4fb37b30-efd2-4f41-b662-7db52bcb7a82-delete_snapshot" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:25:39 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-f42affe5-04ba-4fa1-9ccd-42e735bceba8 tempest-VolumesSnapshotListTestJSON-1551204288 None] Lock "cinder-4fb37b30-efd2-4f41-b662-7db52bcb7a82-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:25:39 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-f42affe5-04ba-4fa1-9ccd-42e735bceba8 tempest-VolumesSnapshotListTestJSON-1551204288 None] Acquiring lock "cinder-quobyte-7372aaad-6cff-4967-9e24-7d937657b1a9" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:25:39 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-f42affe5-04ba-4fa1-9ccd-42e735bceba8 tempest-VolumesSnapshotListTestJSON-1551204288 None] Lock "cinder-quobyte-7372aaad-6cff-4967-9e24-7d937657b1a9" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:25:39 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-f42affe5-04ba-4fa1-9ccd-42e735bceba8 tempest-VolumesSnapshotListTestJSON-1551204288 None] Acquiring lock "cinder-quobyte-4fb37b30-efd2-4f41-b662-7db52bcb7a82" by "_delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:25:39 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-f42affe5-04ba-4fa1-9ccd-42e735bceba8 tempest-VolumesSnapshotListTestJSON-1551204288 None] Lock "cinder-quobyte-4fb37b30-efd2-4f41-b662-7db52bcb7a82" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:25:39 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-f42affe5-04ba-4fa1-9ccd-42e735bceba8 tempest-VolumesSnapshotListTestJSON-1551204288 None] Deleting offline snapshot 4fb37b30-efd2-4f41-b662-7db52bcb7a82 of volume 7372aaad-6cff-4967-9e24-7d937657b1a9 {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:25:39 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-f42affe5-04ba-4fa1-9ccd-42e735bceba8 tempest-VolumesSnapshotListTestJSON-1551204288 None] snapshot_file for this snap is: volume-7372aaad-6cff-4967-9e24-7d937657b1a9.4fb37b30-efd2-4f41-b662-7db52bcb7a82 {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:25:39 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e4e1a56-84de-4a1f-8fb4-9dbf65db8cef]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:25:39 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f42affe5-04ba-4fa1-9ccd-42e735bceba8 tempest-VolumesSnapshotListTestJSON-1551204288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.4fb37b30-efd2-4f41-b662-7db52bcb7a82 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:39 devstack sudo[101489]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:39 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6d70aa92-6fb4-4d48-ae2f-d7ea044e5a7f tempest-CinderUnicodeTest-1731436236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-983a09dc-6230-4e17-b3e5-999ead2dec79.01d39b27-0c05-419d-933c-4b3868bfdf96" returned: 0 in 0.387s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:39 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6d70aa92-6fb4-4d48-ae2f-d7ea044e5a7f tempest-CinderUnicodeTest-1731436236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-983a09dc-6230-4e17-b3e5-999ead2dec79.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:39 devstack sudo[101493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-983a09dc-6230-4e17-b3e5-999ead2dec79.info Aug 05 10:25:39 devstack sudo[101493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:39 devstack sudo[101492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.4fb37b30-efd2-4f41-b662-7db52bcb7a82 Aug 05 10:25:39 devstack sudo[101492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:40 devstack sudo[101493]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:40 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6d70aa92-6fb4-4d48-ae2f-d7ea044e5a7f tempest-CinderUnicodeTest-1731436236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-983a09dc-6230-4e17-b3e5-999ead2dec79.info" returned: 0 in 0.358s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:40 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-6d70aa92-6fb4-4d48-ae2f-d7ea044e5a7f tempest-CinderUnicodeTest-1731436236 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-983a09dc-6230-4e17-b3e5-999ead2dec79.info is being set with open permissions: ugo+rw Aug 05 10:25:40 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6d70aa92-6fb4-4d48-ae2f-d7ea044e5a7f tempest-CinderUnicodeTest-1731436236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-983a09dc-6230-4e17-b3e5-999ead2dec79.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:40 devstack sudo[101492]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:40 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f42affe5-04ba-4fa1-9ccd-42e735bceba8 tempest-VolumesSnapshotListTestJSON-1551204288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.4fb37b30-efd2-4f41-b662-7db52bcb7a82" returned: 0 in 0.490s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:40 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-f42affe5-04ba-4fa1-9ccd-42e735bceba8 tempest-VolumesSnapshotListTestJSON-1551204288 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7372aaad-6cff-4967-9e24-7d937657b1a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88613) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:25:40 devstack sudo[101501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-983a09dc-6230-4e17-b3e5-999ead2dec79.info Aug 05 10:25:40 devstack sudo[101501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:40 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ba723a-b02f-4f0e-a038-92353ca76053]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:25:40 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f42affe5-04ba-4fa1-9ccd-42e735bceba8 tempest-VolumesSnapshotListTestJSON-1551204288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.fcd6a291-45f4-479e-bdbe-6eb05dbd6d6c {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:40 devstack sudo[101503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.fcd6a291-45f4-479e-bdbe-6eb05dbd6d6c Aug 05 10:25:40 devstack sudo[101503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:40 devstack sudo[101501]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:40 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6d70aa92-6fb4-4d48-ae2f-d7ea044e5a7f tempest-CinderUnicodeTest-1731436236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-983a09dc-6230-4e17-b3e5-999ead2dec79.info" returned: 0 in 0.303s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:40 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-6d70aa92-6fb4-4d48-ae2f-d7ea044e5a7f tempest-CinderUnicodeTest-1731436236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.787s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:25:40 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-6d70aa92-6fb4-4d48-ae2f-d7ea044e5a7f tempest-CinderUnicodeTest-1731436236 None] Create snapshot completed successfully Aug 05 10:25:40 devstack sudo[101503]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:40 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f42affe5-04ba-4fa1-9ccd-42e735bceba8 tempest-VolumesSnapshotListTestJSON-1551204288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.fcd6a291-45f4-479e-bdbe-6eb05dbd6d6c" returned: 0 in 0.460s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:40 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-f42affe5-04ba-4fa1-9ccd-42e735bceba8 tempest-VolumesSnapshotListTestJSON-1551204288 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7372aaad-6cff-4967-9e24-7d937657b1a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88613) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:25:40 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f42affe5-04ba-4fa1-9ccd-42e735bceba8 tempest-VolumesSnapshotListTestJSON-1551204288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.4fb37b30-efd2-4f41-b662-7db52bcb7a82 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:40 devstack sudo[101510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.4fb37b30-efd2-4f41-b662-7db52bcb7a82 Aug 05 10:25:40 devstack sudo[101510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:40 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-f8594b51-16e0-4176-90ab-45500285a485 tempest-CinderUnicodeTest-1731436236 None] Acquiring lock "cinder-01d39b27-0c05-419d-933c-4b3868bfdf96-delete_snapshot" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:25:40 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-f8594b51-16e0-4176-90ab-45500285a485 tempest-CinderUnicodeTest-1731436236 None] Lock "cinder-01d39b27-0c05-419d-933c-4b3868bfdf96-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:25:40 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-f8594b51-16e0-4176-90ab-45500285a485 tempest-CinderUnicodeTest-1731436236 None] Acquiring lock "cinder-quobyte-983a09dc-6230-4e17-b3e5-999ead2dec79" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:25:40 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-f8594b51-16e0-4176-90ab-45500285a485 tempest-CinderUnicodeTest-1731436236 None] Lock "cinder-quobyte-983a09dc-6230-4e17-b3e5-999ead2dec79" acquired by "delete_snapshot" :: waited 0.034s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:25:40 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-f8594b51-16e0-4176-90ab-45500285a485 tempest-CinderUnicodeTest-1731436236 None] Acquiring lock "cinder-quobyte-01d39b27-0c05-419d-933c-4b3868bfdf96" by "_delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:25:40 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-f8594b51-16e0-4176-90ab-45500285a485 tempest-CinderUnicodeTest-1731436236 None] Lock "cinder-quobyte-01d39b27-0c05-419d-933c-4b3868bfdf96" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:25:40 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-f8594b51-16e0-4176-90ab-45500285a485 tempest-CinderUnicodeTest-1731436236 None] Deleting offline snapshot 01d39b27-0c05-419d-933c-4b3868bfdf96 of volume 983a09dc-6230-4e17-b3e5-999ead2dec79 {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:25:40 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-f8594b51-16e0-4176-90ab-45500285a485 tempest-CinderUnicodeTest-1731436236 None] snapshot_file for this snap is: volume-983a09dc-6230-4e17-b3e5-999ead2dec79.01d39b27-0c05-419d-933c-4b3868bfdf96 {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:25:40 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[287ee534-e8c8-409a-83d0-4f2d1861abb2]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:25:40 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f8594b51-16e0-4176-90ab-45500285a485 tempest-CinderUnicodeTest-1731436236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-983a09dc-6230-4e17-b3e5-999ead2dec79.01d39b27-0c05-419d-933c-4b3868bfdf96 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:41 devstack sudo[101514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-983a09dc-6230-4e17-b3e5-999ead2dec79.01d39b27-0c05-419d-933c-4b3868bfdf96 Aug 05 10:25:41 devstack sudo[101514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:41 devstack sudo[101510]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:41 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f42affe5-04ba-4fa1-9ccd-42e735bceba8 tempest-VolumesSnapshotListTestJSON-1551204288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.4fb37b30-efd2-4f41-b662-7db52bcb7a82" returned: 0 in 0.584s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:41 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f42affe5-04ba-4fa1-9ccd-42e735bceba8 tempest-VolumesSnapshotListTestJSON-1551204288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.4fb37b30-efd2-4f41-b662-7db52bcb7a82 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:41 devstack sudo[101518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.4fb37b30-efd2-4f41-b662-7db52bcb7a82 Aug 05 10:25:41 devstack sudo[101518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:41 devstack sudo[101514]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:41 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f8594b51-16e0-4176-90ab-45500285a485 tempest-CinderUnicodeTest-1731436236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-983a09dc-6230-4e17-b3e5-999ead2dec79.01d39b27-0c05-419d-933c-4b3868bfdf96" returned: 0 in 0.501s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:41 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-f8594b51-16e0-4176-90ab-45500285a485 tempest-CinderUnicodeTest-1731436236 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-983a09dc-6230-4e17-b3e5-999ead2dec79(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88613) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:25:41 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[694f44f0-3c1c-4b5c-8e55-d4705a82b8ec]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:25:41 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f8594b51-16e0-4176-90ab-45500285a485 tempest-CinderUnicodeTest-1731436236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-983a09dc-6230-4e17-b3e5-999ead2dec79 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:41 devstack sudo[101518]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:41 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f42affe5-04ba-4fa1-9ccd-42e735bceba8 tempest-VolumesSnapshotListTestJSON-1551204288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.4fb37b30-efd2-4f41-b662-7db52bcb7a82" returned: 0 in 0.340s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:41 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-f42affe5-04ba-4fa1-9ccd-42e735bceba8 tempest-VolumesSnapshotListTestJSON-1551204288 None] Lock "cinder-quobyte-4fb37b30-efd2-4f41-b662-7db52bcb7a82" released by "_delete_snapshot" :: held 2.015s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:25:41 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-f42affe5-04ba-4fa1-9ccd-42e735bceba8 tempest-VolumesSnapshotListTestJSON-1551204288 None] Lock "cinder-quobyte-7372aaad-6cff-4967-9e24-7d937657b1a9" released by "delete_snapshot" :: held 2.052s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:25:41 devstack sudo[101523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-983a09dc-6230-4e17-b3e5-999ead2dec79 Aug 05 10:25:41 devstack sudo[101523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:41 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-f42affe5-04ba-4fa1-9ccd-42e735bceba8 tempest-VolumesSnapshotListTestJSON-1551204288 None] Created reservations ['b17652ab-25c2-4f9a-8e56-3f38846ec46b', 'f39772c8-d46d-4296-b32e-9eeaf6d9ef7e', 'c4a519e5-ff2c-4060-b115-2aea45149133', '693ed8f6-55a3-4a78-8a71-93bce7d44193'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:25:41 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-f42affe5-04ba-4fa1-9ccd-42e735bceba8 tempest-VolumesSnapshotListTestJSON-1551204288 None] Delete snapshot completed successfully. Aug 05 10:25:41 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-f42affe5-04ba-4fa1-9ccd-42e735bceba8 tempest-VolumesSnapshotListTestJSON-1551204288 None] Lock "cinder-4fb37b30-efd2-4f41-b662-7db52bcb7a82-delete_snapshot" released by "delete_snapshot" :: held 2.238s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:25:41 devstack sudo[101523]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:41 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f8594b51-16e0-4176-90ab-45500285a485 tempest-CinderUnicodeTest-1731436236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-983a09dc-6230-4e17-b3e5-999ead2dec79" returned: 0 in 0.467s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:41 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f8594b51-16e0-4176-90ab-45500285a485 tempest-CinderUnicodeTest-1731436236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-983a09dc-6230-4e17-b3e5-999ead2dec79.01d39b27-0c05-419d-933c-4b3868bfdf96 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:42 devstack sudo[101529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-983a09dc-6230-4e17-b3e5-999ead2dec79.01d39b27-0c05-419d-933c-4b3868bfdf96 Aug 05 10:25:42 devstack sudo[101529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:42 devstack sudo[101529]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:42 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f8594b51-16e0-4176-90ab-45500285a485 tempest-CinderUnicodeTest-1731436236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-983a09dc-6230-4e17-b3e5-999ead2dec79.01d39b27-0c05-419d-933c-4b3868bfdf96" returned: 0 in 0.375s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:42 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f8594b51-16e0-4176-90ab-45500285a485 tempest-CinderUnicodeTest-1731436236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-983a09dc-6230-4e17-b3e5-999ead2dec79.01d39b27-0c05-419d-933c-4b3868bfdf96 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:42 devstack sudo[101534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-983a09dc-6230-4e17-b3e5-999ead2dec79.01d39b27-0c05-419d-933c-4b3868bfdf96 Aug 05 10:25:42 devstack sudo[101534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:42 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0a385c6-2938-4c44-8fef-a2b8063f606a tempest-VolumesExtendTest-84277837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:25:42 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-b0a385c6-2938-4c44-8fef-a2b8063f606a tempest-VolumesExtendTest-84277837 None] Flow 'volume_create_manager' (edaad6ca-6905-467f-b25a-c7baf2894513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:25:42 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-b0a385c6-2938-4c44-8fef-a2b8063f606a tempest-VolumesExtendTest-84277837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a20b17f5-af67-4916-b735-8c21fdfccd2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:42 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-b0a385c6-2938-4c44-8fef-a2b8063f606a tempest-VolumesExtendTest-84277837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a20b17f5-af67-4916-b735-8c21fdfccd2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:25:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1653391669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad0647ca-1f1c-498a-929d-7a995c145702,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5337dbcb66d1477b99ac725e7845d82b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:25:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:25:42Z,use_quota=True,user_id='336e8f22ff9e44c79e645a95b47d2d7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:42 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-b0a385c6-2938-4c44-8fef-a2b8063f606a tempest-VolumesExtendTest-84277837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79a0295d-e4b2-48a9-8489-259f431250c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:42 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-b0a385c6-2938-4c44-8fef-a2b8063f606a tempest-VolumesExtendTest-84277837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79a0295d-e4b2-48a9-8489-259f431250c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:42 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-b0a385c6-2938-4c44-8fef-a2b8063f606a tempest-VolumesExtendTest-84277837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7ba0b71-73c4-4b19-b164-487976700a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:42 devstack cinder-volume[88613]: DEBUG cinder.image.glance [None req-b0a385c6-2938-4c44-8fef-a2b8063f606a tempest-VolumesExtendTest-84277837 None] Creating Keystone auth plugin from conf {{(pid=88613) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 05 10:25:42 devstack sudo[101534]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:42 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f8594b51-16e0-4176-90ab-45500285a485 tempest-CinderUnicodeTest-1731436236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-983a09dc-6230-4e17-b3e5-999ead2dec79.01d39b27-0c05-419d-933c-4b3868bfdf96" returned: 0 in 0.280s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:42 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-f8594b51-16e0-4176-90ab-45500285a485 tempest-CinderUnicodeTest-1731436236 None] Lock "cinder-quobyte-01d39b27-0c05-419d-933c-4b3868bfdf96" released by "_delete_snapshot" :: held 1.766s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:25:42 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-f8594b51-16e0-4176-90ab-45500285a485 tempest-CinderUnicodeTest-1731436236 None] Lock "cinder-quobyte-983a09dc-6230-4e17-b3e5-999ead2dec79" released by "delete_snapshot" :: held 1.815s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:25:42 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-f8594b51-16e0-4176-90ab-45500285a485 tempest-CinderUnicodeTest-1731436236 None] Created reservations ['ecfc22fe-7580-4b88-8761-e7ec60037785', '7243a8b7-f552-43c9-b015-6f402fbd2e10', 'd9d3494e-1783-4167-ae95-2fd6e2ecfc23', '47daba04-e0a5-45aa-83fc-ef382f703657'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:25:42 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d9ae5c66-f9cd-4689-acb4-98ab7b11ce34 tempest-VolumesSnapshotListTestJSON-1551204288 None] Acquiring lock "cinder-fcd6a291-45f4-479e-bdbe-6eb05dbd6d6c-delete_snapshot" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:25:42 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d9ae5c66-f9cd-4689-acb4-98ab7b11ce34 tempest-VolumesSnapshotListTestJSON-1551204288 None] Lock "cinder-fcd6a291-45f4-479e-bdbe-6eb05dbd6d6c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:25:42 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d9ae5c66-f9cd-4689-acb4-98ab7b11ce34 tempest-VolumesSnapshotListTestJSON-1551204288 None] Acquiring lock "cinder-quobyte-7372aaad-6cff-4967-9e24-7d937657b1a9" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:25:42 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d9ae5c66-f9cd-4689-acb4-98ab7b11ce34 tempest-VolumesSnapshotListTestJSON-1551204288 None] Lock "cinder-quobyte-7372aaad-6cff-4967-9e24-7d937657b1a9" acquired by "delete_snapshot" :: waited 0.034s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:25:42 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d9ae5c66-f9cd-4689-acb4-98ab7b11ce34 tempest-VolumesSnapshotListTestJSON-1551204288 None] Acquiring lock "cinder-quobyte-fcd6a291-45f4-479e-bdbe-6eb05dbd6d6c" by "_delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:25:42 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d9ae5c66-f9cd-4689-acb4-98ab7b11ce34 tempest-VolumesSnapshotListTestJSON-1551204288 None] Lock "cinder-quobyte-fcd6a291-45f4-479e-bdbe-6eb05dbd6d6c" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:25:42 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-d9ae5c66-f9cd-4689-acb4-98ab7b11ce34 tempest-VolumesSnapshotListTestJSON-1551204288 None] Deleting offline snapshot fcd6a291-45f4-479e-bdbe-6eb05dbd6d6c of volume 7372aaad-6cff-4967-9e24-7d937657b1a9 {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:25:42 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-d9ae5c66-f9cd-4689-acb4-98ab7b11ce34 tempest-VolumesSnapshotListTestJSON-1551204288 None] snapshot_file for this snap is: volume-7372aaad-6cff-4967-9e24-7d937657b1a9.fcd6a291-45f4-479e-bdbe-6eb05dbd6d6c {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:25:42 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2fe216-bf02-4fe7-8070-e3a59d83c2c0]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:25:42 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d9ae5c66-f9cd-4689-acb4-98ab7b11ce34 tempest-VolumesSnapshotListTestJSON-1551204288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.fcd6a291-45f4-479e-bdbe-6eb05dbd6d6c {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:42 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-f8594b51-16e0-4176-90ab-45500285a485 tempest-CinderUnicodeTest-1731436236 None] Delete snapshot completed successfully. Aug 05 10:25:43 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-f8594b51-16e0-4176-90ab-45500285a485 tempest-CinderUnicodeTest-1731436236 None] Lock "cinder-01d39b27-0c05-419d-933c-4b3868bfdf96-delete_snapshot" released by "delete_snapshot" :: held 2.136s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:25:43 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-b0a385c6-2938-4c44-8fef-a2b8063f606a tempest-VolumesExtendTest-84277837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7ba0b71-73c4-4b19-b164-487976700a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ad0647ca-1f1c-498a-929d-7a995c145702', 'volume_name': 'volume-ad0647ca-1f1c-498a-929d-7a995c145702', 'volume_size': 1, 'image_id': '89278436-b56f-45f7-8c42-c9afd7bd7453', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/89278436-b56f-45f7-8c42-c9afd7bd7453', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '654c7af809d145caaadc8738d3dc3df2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '89278436-b56f-45f7-8c42-c9afd7bd7453', 'created_at': datetime.datetime(2026, 8, 5, 8, 7, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 8, 7, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/89278436-b56f-45f7-8c42-c9afd7bd7453/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:43 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-b0a385c6-2938-4c44-8fef-a2b8063f606a tempest-VolumesExtendTest-84277837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (888fc7bc-9954-4cf9-b885-c0b9a20449ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:43 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-b0a385c6-2938-4c44-8fef-a2b8063f606a tempest-VolumesExtendTest-84277837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (888fc7bc-9954-4cf9-b885-c0b9a20449ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:43 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-b0a385c6-2938-4c44-8fef-a2b8063f606a tempest-VolumesExtendTest-84277837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d176ba8a-11d4-4ebd-968e-27cd57e508c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:43 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-b0a385c6-2938-4c44-8fef-a2b8063f606a tempest-VolumesExtendTest-84277837 None] Volume ad0647ca-1f1c-498a-929d-7a995c145702: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ad0647ca-1f1c-498a-929d-7a995c145702', 'volume_size': 1, 'image_id': '89278436-b56f-45f7-8c42-c9afd7bd7453', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/89278436-b56f-45f7-8c42-c9afd7bd7453', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '654c7af809d145caaadc8738d3dc3df2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '89278436-b56f-45f7-8c42-c9afd7bd7453', 'created_at': datetime.datetime(2026, 8, 5, 8, 7, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 8, 7, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/89278436-b56f-45f7-8c42-c9afd7bd7453/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 05 10:25:43 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0a385c6-2938-4c44-8fef-a2b8063f606a tempest-VolumesExtendTest-84277837 None] Trying to clone ad0647ca-1f1c-498a-929d-7a995c145702 from image 89278436-b56f-45f7-8c42-c9afd7bd7453 at location (None, [{'url': 'file:///opt/stack/data/glance/images/89278436-b56f-45f7-8c42-c9afd7bd7453', 'metadata': {}}]). {{(pid=88613) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 05 10:25:43 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-7a6b61cd-f98c-4279-b3c4-12ee673b288a tempest-CinderUnicodeTest-1731436236 None] Acquiring lock "cinder-983a09dc-6230-4e17-b3e5-999ead2dec79-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:25:43 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-7a6b61cd-f98c-4279-b3c4-12ee673b288a tempest-CinderUnicodeTest-1731436236 None] Lock "cinder-983a09dc-6230-4e17-b3e5-999ead2dec79-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:25:43 devstack sudo[101537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.fcd6a291-45f4-479e-bdbe-6eb05dbd6d6c Aug 05 10:25:43 devstack sudo[101537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:43 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c0a1e7a-9ed1-4aa9-afcd-c69d0b893d5b tempest-VolumesNegativeTest-559948873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:25:43 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3c0a1e7a-9ed1-4aa9-afcd-c69d0b893d5b tempest-VolumesNegativeTest-559948873 None] Flow 'volume_create_manager' (2ee02d6a-602a-4e10-9c0f-80c55bd5bf17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:25:43 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3c0a1e7a-9ed1-4aa9-afcd-c69d0b893d5b tempest-VolumesNegativeTest-559948873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (369f97a7-2b9c-444c-bb52-f81d216ea1a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:43 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3c0a1e7a-9ed1-4aa9-afcd-c69d0b893d5b tempest-VolumesNegativeTest-559948873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (369f97a7-2b9c-444c-bb52-f81d216ea1a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:25:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1767717062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18f5d97b-fddd-4866-97a4-3a18f92be960,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88474d99aaf6430087c3e18938f1f9dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:25:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:25:43Z,use_quota=True,user_id='4eebd4a11c334a46ae460be7f8fa10ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:43 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3c0a1e7a-9ed1-4aa9-afcd-c69d0b893d5b tempest-VolumesNegativeTest-559948873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (453f82eb-2d8c-48b9-8a46-d4ccf2ddb755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:43 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3c0a1e7a-9ed1-4aa9-afcd-c69d0b893d5b tempest-VolumesNegativeTest-559948873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (453f82eb-2d8c-48b9-8a46-d4ccf2ddb755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:43 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3c0a1e7a-9ed1-4aa9-afcd-c69d0b893d5b tempest-VolumesNegativeTest-559948873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d71384e-5d8c-4d16-896d-c5288e9fec03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:43 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3c0a1e7a-9ed1-4aa9-afcd-c69d0b893d5b tempest-VolumesNegativeTest-559948873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d71384e-5d8c-4d16-896d-c5288e9fec03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18f5d97b-fddd-4866-97a4-3a18f92be960', 'volume_name': 'volume-18f5d97b-fddd-4866-97a4-3a18f92be960', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:43 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3c0a1e7a-9ed1-4aa9-afcd-c69d0b893d5b tempest-VolumesNegativeTest-559948873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af2499b3-c6f7-4bb2-acf6-9e2bf62e51dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:43 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3c0a1e7a-9ed1-4aa9-afcd-c69d0b893d5b tempest-VolumesNegativeTest-559948873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af2499b3-c6f7-4bb2-acf6-9e2bf62e51dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:43 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3c0a1e7a-9ed1-4aa9-afcd-c69d0b893d5b tempest-VolumesNegativeTest-559948873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (871ae5b3-4ab0-43f8-a820-24010ce04321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:43 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-3c0a1e7a-9ed1-4aa9-afcd-c69d0b893d5b tempest-VolumesNegativeTest-559948873 None] Volume 18f5d97b-fddd-4866-97a4-3a18f92be960: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18f5d97b-fddd-4866-97a4-3a18f92be960', 'volume_size': 1} Aug 05 10:25:43 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-3c0a1e7a-9ed1-4aa9-afcd-c69d0b893d5b tempest-VolumesNegativeTest-559948873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:25:43 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-3c0a1e7a-9ed1-4aa9-afcd-c69d0b893d5b tempest-VolumesNegativeTest-559948873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:25:43 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-3c0a1e7a-9ed1-4aa9-afcd-c69d0b893d5b tempest-VolumesNegativeTest-559948873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:25:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1767717062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18f5d97b-fddd-4866-97a4-3a18f92be960,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88474d99aaf6430087c3e18938f1f9dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:25:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:25:43Z,use_quota=True,user_id='4eebd4a11c334a46ae460be7f8fa10ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:25:43 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-3c0a1e7a-9ed1-4aa9-afcd-c69d0b893d5b tempest-VolumesNegativeTest-559948873 None] Creating volume 18f5d97b-fddd-4866-97a4-3a18f92be960 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:25:43 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-3c0a1e7a-9ed1-4aa9-afcd-c69d0b893d5b tempest-VolumesNegativeTest-559948873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:25:43 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-3c0a1e7a-9ed1-4aa9-afcd-c69d0b893d5b tempest-VolumesNegativeTest-559948873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:25:43 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-3c0a1e7a-9ed1-4aa9-afcd-c69d0b893d5b tempest-VolumesNegativeTest-559948873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:25:43 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-3c0a1e7a-9ed1-4aa9-afcd-c69d0b893d5b tempest-VolumesNegativeTest-559948873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:25:43 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-3c0a1e7a-9ed1-4aa9-afcd-c69d0b893d5b tempest-VolumesNegativeTest-559948873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:25:43 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-3c0a1e7a-9ed1-4aa9-afcd-c69d0b893d5b tempest-VolumesNegativeTest-559948873 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:25:43 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-3c0a1e7a-9ed1-4aa9-afcd-c69d0b893d5b tempest-VolumesNegativeTest-559948873 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:25:43 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3c0a1e7a-9ed1-4aa9-afcd-c69d0b893d5b tempest-VolumesNegativeTest-559948873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-18f5d97b-fddd-4866-97a4-3a18f92be960 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:43 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-7a6b61cd-f98c-4279-b3c4-12ee673b288a tempest-CinderUnicodeTest-1731436236 None] Acquiring lock "cinder-quobyte-983a09dc-6230-4e17-b3e5-999ead2dec79" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:25:43 devstack sudo[101539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-18f5d97b-fddd-4866-97a4-3a18f92be960 1073741824 Aug 05 10:25:43 devstack sudo[101539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:43 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-7a6b61cd-f98c-4279-b3c4-12ee673b288a tempest-CinderUnicodeTest-1731436236 None] Lock "cinder-quobyte-983a09dc-6230-4e17-b3e5-999ead2dec79" acquired by "delete_volume" :: waited 0.028s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:25:43 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc983b5d-0755-4262-a0bc-c7c69363b41d]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:25:43 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7a6b61cd-f98c-4279-b3c4-12ee673b288a tempest-CinderUnicodeTest-1731436236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-983a09dc-6230-4e17-b3e5-999ead2dec79 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:43 devstack sudo[101537]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:43 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d9ae5c66-f9cd-4689-acb4-98ab7b11ce34 tempest-VolumesSnapshotListTestJSON-1551204288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.fcd6a291-45f4-479e-bdbe-6eb05dbd6d6c" returned: 0 in 0.492s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:43 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-d9ae5c66-f9cd-4689-acb4-98ab7b11ce34 tempest-VolumesSnapshotListTestJSON-1551204288 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7372aaad-6cff-4967-9e24-7d937657b1a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88613) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:25:43 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ebb95e-b1ef-451c-adff-53073bfabe3d]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:25:43 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d9ae5c66-f9cd-4689-acb4-98ab7b11ce34 tempest-VolumesSnapshotListTestJSON-1551204288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.2e93e02f-a6a4-4ff6-b5c2-bc0131445433 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:43 devstack sudo[101544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-983a09dc-6230-4e17-b3e5-999ead2dec79 Aug 05 10:25:43 devstack sudo[101544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:43 devstack cinder-volume[88613]: DEBUG cinder.image.image_utils [None req-b0a385c6-2938-4c44-8fef-a2b8063f606a tempest-VolumesExtendTest-84277837 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_89278436-b56f-45f7-8c42-c9afd7bd7453_uupxgf8_devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88613) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 05 10:25:43 devstack cinder-volume[88613]: INFO cinder.image.image_utils [None req-b0a385c6-2938-4c44-8fef-a2b8063f606a tempest-VolumesExtendTest-84277837 None] Image download 20.69 MB at 20.69 MB/s Aug 05 10:25:43 devstack sudo[101546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.2e93e02f-a6a4-4ff6-b5c2-bc0131445433 Aug 05 10:25:43 devstack sudo[101546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:43 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b07441e-043d-4cb0-91cd-bf7aec12bfa4]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:25:43 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b0a385c6-2938-4c44-8fef-a2b8063f606a tempest-VolumesExtendTest-84277837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89278436-b56f-45f7-8c42-c9afd7bd7453_uupxgf8_devstack@QuobyteHD {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:43 devstack sudo[101552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89278436-b56f-45f7-8c42-c9afd7bd7453_uupxgf8_devstack@QuobyteHD Aug 05 10:25:43 devstack sudo[101552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:43 devstack sudo[101539]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:43 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3c0a1e7a-9ed1-4aa9-afcd-c69d0b893d5b tempest-VolumesNegativeTest-559948873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-18f5d97b-fddd-4866-97a4-3a18f92be960 1073741824" returned: 0 in 0.606s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:43 devstack sudo[101544]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:43 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7a6b61cd-f98c-4279-b3c4-12ee673b288a tempest-CinderUnicodeTest-1731436236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-983a09dc-6230-4e17-b3e5-999ead2dec79" returned: 0 in 0.509s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:43 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7a6b61cd-f98c-4279-b3c4-12ee673b288a tempest-CinderUnicodeTest-1731436236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-983a09dc-6230-4e17-b3e5-999ead2dec79 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:43 devstack sudo[101557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-983a09dc-6230-4e17-b3e5-999ead2dec79 Aug 05 10:25:43 devstack sudo[101557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:43 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3c0a1e7a-9ed1-4aa9-afcd-c69d0b893d5b tempest-VolumesNegativeTest-559948873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-18f5d97b-fddd-4866-97a4-3a18f92be960 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:43 devstack sudo[101561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-18f5d97b-fddd-4866-97a4-3a18f92be960 Aug 05 10:25:43 devstack sudo[101561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:44 devstack sudo[101546]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d9ae5c66-f9cd-4689-acb4-98ab7b11ce34 tempest-VolumesSnapshotListTestJSON-1551204288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.2e93e02f-a6a4-4ff6-b5c2-bc0131445433" returned: 0 in 0.526s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:44 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-d9ae5c66-f9cd-4689-acb4-98ab7b11ce34 tempest-VolumesSnapshotListTestJSON-1551204288 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7372aaad-6cff-4967-9e24-7d937657b1a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88613) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:25:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d9ae5c66-f9cd-4689-acb4-98ab7b11ce34 tempest-VolumesSnapshotListTestJSON-1551204288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.fcd6a291-45f4-479e-bdbe-6eb05dbd6d6c {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:44 devstack sudo[101567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.fcd6a291-45f4-479e-bdbe-6eb05dbd6d6c Aug 05 10:25:44 devstack sudo[101567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:44 devstack sudo[101552]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b0a385c6-2938-4c44-8fef-a2b8063f606a tempest-VolumesExtendTest-84277837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89278436-b56f-45f7-8c42-c9afd7bd7453_uupxgf8_devstack@QuobyteHD" returned: 0 in 0.395s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:44 devstack cinder-volume[88613]: DEBUG cinder.image.image_utils [None req-b0a385c6-2938-4c44-8fef-a2b8063f606a tempest-VolumesExtendTest-84277837 None] Temporary image 89278436-b56f-45f7-8c42-c9afd7bd7453 is fetched for user 336e8f22ff9e44c79e645a95b47d2d7e. {{(pid=88613) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 05 10:25:44 devstack sudo[101557]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7a6b61cd-f98c-4279-b3c4-12ee673b288a tempest-CinderUnicodeTest-1731436236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-983a09dc-6230-4e17-b3e5-999ead2dec79" returned: 0 in 0.314s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:44 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[4411677d-dcc0-4827-a5b0-05a7c8e98da5]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:25:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b0a385c6-2938-4c44-8fef-a2b8063f606a tempest-VolumesExtendTest-84277837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89278436-b56f-45f7-8c42-c9afd7bd7453_uupxgf8_devstack@QuobyteHD {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:44 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-7a6b61cd-f98c-4279-b3c4-12ee673b288a tempest-CinderUnicodeTest-1731436236 None] Lock "cinder-quobyte-983a09dc-6230-4e17-b3e5-999ead2dec79" released by "delete_volume" :: held 0.924s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:25:44 devstack sudo[101561]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3c0a1e7a-9ed1-4aa9-afcd-c69d0b893d5b tempest-VolumesNegativeTest-559948873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-18f5d97b-fddd-4866-97a4-3a18f92be960" returned: 0 in 0.364s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:44 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-3c0a1e7a-9ed1-4aa9-afcd-c69d0b893d5b tempest-VolumesNegativeTest-559948873 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:25:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-3c0a1e7a-9ed1-4aa9-afcd-c69d0b893d5b tempest-VolumesNegativeTest-559948873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:25:44 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3c0a1e7a-9ed1-4aa9-afcd-c69d0b893d5b tempest-VolumesNegativeTest-559948873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (871ae5b3-4ab0-43f8-a820-24010ce04321) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18f5d97b-fddd-4866-97a4-3a18f92be960', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:44 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3c0a1e7a-9ed1-4aa9-afcd-c69d0b893d5b tempest-VolumesNegativeTest-559948873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f326812-df46-4321-b876-c3abf8c55b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:44 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-7a6b61cd-f98c-4279-b3c4-12ee673b288a tempest-CinderUnicodeTest-1731436236 None] Created reservations ['26e22d0e-0420-4fe3-b6d3-c058251c6ca4', '03bf291a-7138-4e45-840d-6789ca75ba92', 'e5fc0e91-98c0-4274-97e8-bd04a17b2603', '33862665-5aaa-4ba2-bc0e-6499b77e618c'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:25:44 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-3c0a1e7a-9ed1-4aa9-afcd-c69d0b893d5b tempest-VolumesNegativeTest-559948873 None] Volume volume-18f5d97b-fddd-4866-97a4-3a18f92be960 (18f5d97b-fddd-4866-97a4-3a18f92be960): created successfully Aug 05 10:25:44 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3c0a1e7a-9ed1-4aa9-afcd-c69d0b893d5b tempest-VolumesNegativeTest-559948873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f326812-df46-4321-b876-c3abf8c55b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:44 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3c0a1e7a-9ed1-4aa9-afcd-c69d0b893d5b tempest-VolumesNegativeTest-559948873 None] Flow 'volume_create_manager' (2ee02d6a-602a-4e10-9c0f-80c55bd5bf17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:25:44 devstack sudo[101571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89278436-b56f-45f7-8c42-c9afd7bd7453_uupxgf8_devstack@QuobyteHD Aug 05 10:25:44 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-3c0a1e7a-9ed1-4aa9-afcd-c69d0b893d5b tempest-VolumesNegativeTest-559948873 None] Created volume successfully. Aug 05 10:25:44 devstack sudo[101571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-7a6b61cd-f98c-4279-b3c4-12ee673b288a tempest-CinderUnicodeTest-1731436236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:25:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-7a6b61cd-f98c-4279-b3c4-12ee673b288a tempest-CinderUnicodeTest-1731436236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:25:44 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-7a6b61cd-f98c-4279-b3c4-12ee673b288a tempest-CinderUnicodeTest-1731436236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:25:44 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-7a6b61cd-f98c-4279-b3c4-12ee673b288a tempest-CinderUnicodeTest-1731436236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:25:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-7a6b61cd-f98c-4279-b3c4-12ee673b288a tempest-CinderUnicodeTest-1731436236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:25:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7a6b61cd-f98c-4279-b3c4-12ee673b288a tempest-CinderUnicodeTest-1731436236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:44 devstack sudo[101582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:25:44 devstack sudo[101582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:44 devstack sudo[101567]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d9ae5c66-f9cd-4689-acb4-98ab7b11ce34 tempest-VolumesSnapshotListTestJSON-1551204288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.fcd6a291-45f4-479e-bdbe-6eb05dbd6d6c" returned: 0 in 0.533s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d9ae5c66-f9cd-4689-acb4-98ab7b11ce34 tempest-VolumesSnapshotListTestJSON-1551204288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.fcd6a291-45f4-479e-bdbe-6eb05dbd6d6c {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:44 devstack sudo[101584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.fcd6a291-45f4-479e-bdbe-6eb05dbd6d6c Aug 05 10:25:44 devstack sudo[101584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:44 devstack sudo[101571]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b0a385c6-2938-4c44-8fef-a2b8063f606a tempest-VolumesExtendTest-84277837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89278436-b56f-45f7-8c42-c9afd7bd7453_uupxgf8_devstack@QuobyteHD" returned: 0 in 0.392s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-b0a385c6-2938-4c44-8fef-a2b8063f606a tempest-VolumesExtendTest-84277837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:25:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-b0a385c6-2938-4c44-8fef-a2b8063f606a tempest-VolumesExtendTest-84277837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:25:44 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-b0a385c6-2938-4c44-8fef-a2b8063f606a tempest-VolumesExtendTest-84277837 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:25:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1653391669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad0647ca-1f1c-498a-929d-7a995c145702,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5337dbcb66d1477b99ac725e7845d82b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:25:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:25:42Z,use_quota=True,user_id='336e8f22ff9e44c79e645a95b47d2d7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:25:44 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-b0a385c6-2938-4c44-8fef-a2b8063f606a tempest-VolumesExtendTest-84277837 None] Creating volume ad0647ca-1f1c-498a-929d-7a995c145702 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:25:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-b0a385c6-2938-4c44-8fef-a2b8063f606a tempest-VolumesExtendTest-84277837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:25:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-b0a385c6-2938-4c44-8fef-a2b8063f606a tempest-VolumesExtendTest-84277837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:25:44 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-b0a385c6-2938-4c44-8fef-a2b8063f606a tempest-VolumesExtendTest-84277837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:25:44 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-b0a385c6-2938-4c44-8fef-a2b8063f606a tempest-VolumesExtendTest-84277837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:25:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-b0a385c6-2938-4c44-8fef-a2b8063f606a tempest-VolumesExtendTest-84277837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:25:44 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-b0a385c6-2938-4c44-8fef-a2b8063f606a tempest-VolumesExtendTest-84277837 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:25:44 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-b0a385c6-2938-4c44-8fef-a2b8063f606a tempest-VolumesExtendTest-84277837 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:25:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b0a385c6-2938-4c44-8fef-a2b8063f606a tempest-VolumesExtendTest-84277837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ad0647ca-1f1c-498a-929d-7a995c145702 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:44 devstack sudo[101590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ad0647ca-1f1c-498a-929d-7a995c145702 1073741824 Aug 05 10:25:44 devstack sudo[101590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:44 devstack sudo[101582]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7a6b61cd-f98c-4279-b3c4-12ee673b288a tempest-CinderUnicodeTest-1731436236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.284s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:44 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-7a6b61cd-f98c-4279-b3c4-12ee673b288a tempest-CinderUnicodeTest-1731436236 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:25:44 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-7a6b61cd-f98c-4279-b3c4-12ee673b288a tempest-CinderUnicodeTest-1731436236 None] Deleted volume successfully. Aug 05 10:25:44 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-7a6b61cd-f98c-4279-b3c4-12ee673b288a tempest-CinderUnicodeTest-1731436236 None] Lock "cinder-983a09dc-6230-4e17-b3e5-999ead2dec79-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:25:44 devstack sudo[101584]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d9ae5c66-f9cd-4689-acb4-98ab7b11ce34 tempest-VolumesSnapshotListTestJSON-1551204288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.fcd6a291-45f4-479e-bdbe-6eb05dbd6d6c" returned: 0 in 0.292s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:44 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d9ae5c66-f9cd-4689-acb4-98ab7b11ce34 tempest-VolumesSnapshotListTestJSON-1551204288 None] Lock "cinder-quobyte-fcd6a291-45f4-479e-bdbe-6eb05dbd6d6c" released by "_delete_snapshot" :: held 1.992s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:25:44 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d9ae5c66-f9cd-4689-acb4-98ab7b11ce34 tempest-VolumesSnapshotListTestJSON-1551204288 None] Lock "cinder-quobyte-7372aaad-6cff-4967-9e24-7d937657b1a9" released by "delete_snapshot" :: held 2.032s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:25:44 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-d9ae5c66-f9cd-4689-acb4-98ab7b11ce34 tempest-VolumesSnapshotListTestJSON-1551204288 None] Created reservations ['d1dcd608-3d89-404e-bba3-e93a95435f28', 'de023805-42af-4f5c-83e9-c8dc58bda364', 'a6c360da-42fa-402a-9af0-2fc301964e8f', '42e6069e-96b0-45dd-9fc5-ea33c3c36e5e'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:25:45 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-d9ae5c66-f9cd-4689-acb4-98ab7b11ce34 tempest-VolumesSnapshotListTestJSON-1551204288 None] Delete snapshot completed successfully. Aug 05 10:25:45 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d9ae5c66-f9cd-4689-acb4-98ab7b11ce34 tempest-VolumesSnapshotListTestJSON-1551204288 None] Lock "cinder-fcd6a291-45f4-479e-bdbe-6eb05dbd6d6c-delete_snapshot" released by "delete_snapshot" :: held 2.197s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:25:45 devstack sudo[101590]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:45 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b0a385c6-2938-4c44-8fef-a2b8063f606a tempest-VolumesExtendTest-84277837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ad0647ca-1f1c-498a-929d-7a995c145702 1073741824" returned: 0 in 0.456s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:45 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b0a385c6-2938-4c44-8fef-a2b8063f606a tempest-VolumesExtendTest-84277837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ad0647ca-1f1c-498a-929d-7a995c145702 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:45 devstack sudo[101598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ad0647ca-1f1c-498a-929d-7a995c145702 Aug 05 10:25:45 devstack sudo[101598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:45 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-2e92aa1b-1aee-4adf-80fa-99f5c6e13bda tempest-CinderUnicodeTest-1731436236 None] Acquiring lock "cinder-9c12afed-044b-49a3-bf91-a6b3de8f4fdf-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:25:45 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-2e92aa1b-1aee-4adf-80fa-99f5c6e13bda tempest-CinderUnicodeTest-1731436236 None] Lock "cinder-9c12afed-044b-49a3-bf91-a6b3de8f4fdf-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:25:45 devstack sudo[101598]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:45 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b0a385c6-2938-4c44-8fef-a2b8063f606a tempest-VolumesExtendTest-84277837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ad0647ca-1f1c-498a-929d-7a995c145702" returned: 0 in 0.306s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:45 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-b0a385c6-2938-4c44-8fef-a2b8063f606a tempest-VolumesExtendTest-84277837 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:25:45 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-b0a385c6-2938-4c44-8fef-a2b8063f606a tempest-VolumesExtendTest-84277837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:25:45 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-2e92aa1b-1aee-4adf-80fa-99f5c6e13bda tempest-CinderUnicodeTest-1731436236 None] Acquiring lock "cinder-quobyte-9c12afed-044b-49a3-bf91-a6b3de8f4fdf" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:25:45 devstack cinder-volume[88613]: DEBUG cinder.volume.volume_utils [None req-b0a385c6-2938-4c44-8fef-a2b8063f606a tempest-VolumesExtendTest-84277837 None] Attempting download of 89278436-b56f-45f7-8c42-c9afd7bd7453 ((None, [{'url': 'file:///opt/stack/data/glance/images/89278436-b56f-45f7-8c42-c9afd7bd7453', 'metadata': {}}])) to volume ad0647ca-1f1c-498a-929d-7a995c145702. {{(pid=88613) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 05 10:25:45 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-2e92aa1b-1aee-4adf-80fa-99f5c6e13bda tempest-CinderUnicodeTest-1731436236 None] Lock "cinder-quobyte-9c12afed-044b-49a3-bf91-a6b3de8f4fdf" acquired by "delete_volume" :: waited 0.042s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:25:45 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08bd3c1-c037-466d-9238-d1a07b5919a7]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:25:45 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2e92aa1b-1aee-4adf-80fa-99f5c6e13bda tempest-CinderUnicodeTest-1731436236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9c12afed-044b-49a3-bf91-a6b3de8f4fdf {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:45 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[43dd943a-9634-42f0-8496-1a35a9898898]: (4, 'raw') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:25:45 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b0a385c6-2938-4c44-8fef-a2b8063f606a tempest-VolumesExtendTest-84277837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_89278436-b56f-45f7-8c42-c9afd7bd7453_7s8tn4wp {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:45 devstack sudo[101601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9c12afed-044b-49a3-bf91-a6b3de8f4fdf Aug 05 10:25:45 devstack sudo[101601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:45 devstack sudo[101602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_89278436-b56f-45f7-8c42-c9afd7bd7453_7s8tn4wp Aug 05 10:25:45 devstack sudo[101602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:45 devstack sudo[101602]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:45 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b0a385c6-2938-4c44-8fef-a2b8063f606a tempest-VolumesExtendTest-84277837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_89278436-b56f-45f7-8c42-c9afd7bd7453_7s8tn4wp" returned: 0 in 0.347s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:45 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b0a385c6-2938-4c44-8fef-a2b8063f606a tempest-VolumesExtendTest-84277837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_89278436-b56f-45f7-8c42-c9afd7bd7453_7s8tn4wp {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:45 devstack sudo[101601]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2e92aa1b-1aee-4adf-80fa-99f5c6e13bda tempest-CinderUnicodeTest-1731436236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9c12afed-044b-49a3-bf91-a6b3de8f4fdf" returned: 0 in 0.454s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2e92aa1b-1aee-4adf-80fa-99f5c6e13bda tempest-CinderUnicodeTest-1731436236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9c12afed-044b-49a3-bf91-a6b3de8f4fdf {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:46 devstack sudo[101614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9c12afed-044b-49a3-bf91-a6b3de8f4fdf Aug 05 10:25:46 devstack sudo[101614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:46 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-644f92d9-ce0a-4065-b60c-367a4da2df79 tempest-VolumesSnapshotListTestJSON-1551204288 None] Acquiring lock "cinder-2e93e02f-a6a4-4ff6-b5c2-bc0131445433-delete_snapshot" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:25:46 devstack sudo[101613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_89278436-b56f-45f7-8c42-c9afd7bd7453_7s8tn4wp Aug 05 10:25:46 devstack sudo[101613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:46 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-644f92d9-ce0a-4065-b60c-367a4da2df79 tempest-VolumesSnapshotListTestJSON-1551204288 None] Lock "cinder-2e93e02f-a6a4-4ff6-b5c2-bc0131445433-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:25:46 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-644f92d9-ce0a-4065-b60c-367a4da2df79 tempest-VolumesSnapshotListTestJSON-1551204288 None] Acquiring lock "cinder-quobyte-7372aaad-6cff-4967-9e24-7d937657b1a9" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:25:46 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-644f92d9-ce0a-4065-b60c-367a4da2df79 tempest-VolumesSnapshotListTestJSON-1551204288 None] Lock "cinder-quobyte-7372aaad-6cff-4967-9e24-7d937657b1a9" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:25:46 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-644f92d9-ce0a-4065-b60c-367a4da2df79 tempest-VolumesSnapshotListTestJSON-1551204288 None] Acquiring lock "cinder-quobyte-2e93e02f-a6a4-4ff6-b5c2-bc0131445433" by "_delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:25:46 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-644f92d9-ce0a-4065-b60c-367a4da2df79 tempest-VolumesSnapshotListTestJSON-1551204288 None] Lock "cinder-quobyte-2e93e02f-a6a4-4ff6-b5c2-bc0131445433" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:25:46 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-644f92d9-ce0a-4065-b60c-367a4da2df79 tempest-VolumesSnapshotListTestJSON-1551204288 None] Deleting offline snapshot 2e93e02f-a6a4-4ff6-b5c2-bc0131445433 of volume 7372aaad-6cff-4967-9e24-7d937657b1a9 {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:25:46 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-644f92d9-ce0a-4065-b60c-367a4da2df79 tempest-VolumesSnapshotListTestJSON-1551204288 None] snapshot_file for this snap is: volume-7372aaad-6cff-4967-9e24-7d937657b1a9.2e93e02f-a6a4-4ff6-b5c2-bc0131445433 {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:25:46 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[babd5343-d0da-4c21-ab84-8870ceef14b3]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:25:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-644f92d9-ce0a-4065-b60c-367a4da2df79 tempest-VolumesSnapshotListTestJSON-1551204288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.2e93e02f-a6a4-4ff6-b5c2-bc0131445433 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:46 devstack sudo[101617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.2e93e02f-a6a4-4ff6-b5c2-bc0131445433 Aug 05 10:25:46 devstack sudo[101617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:46 devstack sudo[101614]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2e92aa1b-1aee-4adf-80fa-99f5c6e13bda tempest-CinderUnicodeTest-1731436236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9c12afed-044b-49a3-bf91-a6b3de8f4fdf" returned: 0 in 0.347s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:46 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-2e92aa1b-1aee-4adf-80fa-99f5c6e13bda tempest-CinderUnicodeTest-1731436236 None] Lock "cinder-quobyte-9c12afed-044b-49a3-bf91-a6b3de8f4fdf" released by "delete_volume" :: held 0.865s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:25:46 devstack sudo[101613]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b0a385c6-2938-4c44-8fef-a2b8063f606a tempest-VolumesExtendTest-84277837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_89278436-b56f-45f7-8c42-c9afd7bd7453_7s8tn4wp" returned: 1 in 0.452s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b0a385c6-2938-4c44-8fef-a2b8063f606a tempest-VolumesExtendTest-84277837 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_89278436-b56f-45f7-8c42-c9afd7bd7453_7s8tn4wp' failed. Not Retrying. {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 10:25:46 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[e763e52d-7fc6-4764-a210-e67bb6b1cd9a]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:25:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b0a385c6-2938-4c44-8fef-a2b8063f606a tempest-VolumesExtendTest-84277837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89278436-b56f-45f7-8c42-c9afd7bd7453_uupxgf8_devstack@QuobyteHD {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:46 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-2e92aa1b-1aee-4adf-80fa-99f5c6e13bda tempest-CinderUnicodeTest-1731436236 None] Created reservations ['5cad3dcd-27d6-4d7e-b75a-e8bf297befd6', '51282624-f690-43a2-a9a0-d549b1031f36', '1e8ee853-d0da-47b4-8904-a36834493f93', 'fa1bcc56-b43a-4e6b-9415-6c601efe90ae'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:25:46 devstack sudo[101622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89278436-b56f-45f7-8c42-c9afd7bd7453_uupxgf8_devstack@QuobyteHD Aug 05 10:25:46 devstack sudo[101622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2e92aa1b-1aee-4adf-80fa-99f5c6e13bda tempest-CinderUnicodeTest-1731436236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:25:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2e92aa1b-1aee-4adf-80fa-99f5c6e13bda tempest-CinderUnicodeTest-1731436236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:25:46 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-2e92aa1b-1aee-4adf-80fa-99f5c6e13bda tempest-CinderUnicodeTest-1731436236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:25:46 devstack sudo[101617]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:46 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-2e92aa1b-1aee-4adf-80fa-99f5c6e13bda tempest-CinderUnicodeTest-1731436236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:25:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2e92aa1b-1aee-4adf-80fa-99f5c6e13bda tempest-CinderUnicodeTest-1731436236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:25:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2e92aa1b-1aee-4adf-80fa-99f5c6e13bda tempest-CinderUnicodeTest-1731436236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-644f92d9-ce0a-4065-b60c-367a4da2df79 tempest-VolumesSnapshotListTestJSON-1551204288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.2e93e02f-a6a4-4ff6-b5c2-bc0131445433" returned: 0 in 0.483s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:46 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-644f92d9-ce0a-4065-b60c-367a4da2df79 tempest-VolumesSnapshotListTestJSON-1551204288 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7372aaad-6cff-4967-9e24-7d937657b1a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88613) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:25:46 devstack sudo[101628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:25:46 devstack sudo[101628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:46 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[c299abe9-8a47-4a97-b7ce-6d287004a411]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:25:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-644f92d9-ce0a-4065-b60c-367a4da2df79 tempest-VolumesSnapshotListTestJSON-1551204288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:46 devstack sudo[101630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9 Aug 05 10:25:46 devstack sudo[101630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:46 devstack sudo[101622]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b0a385c6-2938-4c44-8fef-a2b8063f606a tempest-VolumesExtendTest-84277837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89278436-b56f-45f7-8c42-c9afd7bd7453_uupxgf8_devstack@QuobyteHD" returned: 0 in 0.499s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:46 devstack cinder-volume[88613]: DEBUG cinder.image.image_utils [None req-b0a385c6-2938-4c44-8fef-a2b8063f606a tempest-VolumesExtendTest-84277837 None] 89278436-b56f-45f7-8c42-c9afd7bd7453 was qcow2, converting to qcow2 {{(pid=88613) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 05 10:25:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b0a385c6-2938-4c44-8fef-a2b8063f606a tempest-VolumesExtendTest-84277837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_89278436-b56f-45f7-8c42-c9afd7bd7453_uupxgf8_devstack@QuobyteHD /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ad0647ca-1f1c-498a-929d-7a995c145702 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:46 devstack sudo[101635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_89278436-b56f-45f7-8c42-c9afd7bd7453_uupxgf8_devstack@QuobyteHD /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ad0647ca-1f1c-498a-929d-7a995c145702 Aug 05 10:25:46 devstack sudo[101635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:46 devstack sudo[101628]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2e92aa1b-1aee-4adf-80fa-99f5c6e13bda tempest-CinderUnicodeTest-1731436236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.294s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:46 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-2e92aa1b-1aee-4adf-80fa-99f5c6e13bda tempest-CinderUnicodeTest-1731436236 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:25:46 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-2e92aa1b-1aee-4adf-80fa-99f5c6e13bda tempest-CinderUnicodeTest-1731436236 None] Deleted volume successfully. Aug 05 10:25:47 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-2e92aa1b-1aee-4adf-80fa-99f5c6e13bda tempest-CinderUnicodeTest-1731436236 None] Lock "cinder-9c12afed-044b-49a3-bf91-a6b3de8f4fdf-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:25:47 devstack sudo[101630]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:47 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-644f92d9-ce0a-4065-b60c-367a4da2df79 tempest-VolumesSnapshotListTestJSON-1551204288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9" returned: 0 in 0.441s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:47 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-644f92d9-ce0a-4065-b60c-367a4da2df79 tempest-VolumesSnapshotListTestJSON-1551204288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.2e93e02f-a6a4-4ff6-b5c2-bc0131445433 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:47 devstack sudo[101644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.2e93e02f-a6a4-4ff6-b5c2-bc0131445433 Aug 05 10:25:47 devstack sudo[101644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:47 devstack sudo[101644]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:47 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-644f92d9-ce0a-4065-b60c-367a4da2df79 tempest-VolumesSnapshotListTestJSON-1551204288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.2e93e02f-a6a4-4ff6-b5c2-bc0131445433" returned: 0 in 0.445s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:47 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-644f92d9-ce0a-4065-b60c-367a4da2df79 tempest-VolumesSnapshotListTestJSON-1551204288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.2e93e02f-a6a4-4ff6-b5c2-bc0131445433 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:47 devstack sudo[101652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.2e93e02f-a6a4-4ff6-b5c2-bc0131445433 Aug 05 10:25:47 devstack sudo[101652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:47 devstack sudo[101652]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:47 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-644f92d9-ce0a-4065-b60c-367a4da2df79 tempest-VolumesSnapshotListTestJSON-1551204288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9.2e93e02f-a6a4-4ff6-b5c2-bc0131445433" returned: 0 in 0.327s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:48 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-644f92d9-ce0a-4065-b60c-367a4da2df79 tempest-VolumesSnapshotListTestJSON-1551204288 None] Lock "cinder-quobyte-2e93e02f-a6a4-4ff6-b5c2-bc0131445433" released by "_delete_snapshot" :: held 1.882s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:25:48 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-644f92d9-ce0a-4065-b60c-367a4da2df79 tempest-VolumesSnapshotListTestJSON-1551204288 None] Lock "cinder-quobyte-7372aaad-6cff-4967-9e24-7d937657b1a9" released by "delete_snapshot" :: held 1.920s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:25:48 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-644f92d9-ce0a-4065-b60c-367a4da2df79 tempest-VolumesSnapshotListTestJSON-1551204288 None] Created reservations ['352a578f-7d2f-4d94-92e6-426f3c304e48', '2926ece9-d835-4d14-96b9-55447ea82f5a', 'fb39615e-b62d-45e7-846d-ce56af0893dd', '9c29adf7-5396-4777-930a-dd2450a803b9'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:25:48 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-644f92d9-ce0a-4065-b60c-367a4da2df79 tempest-VolumesSnapshotListTestJSON-1551204288 None] Delete snapshot completed successfully. Aug 05 10:25:48 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-644f92d9-ce0a-4065-b60c-367a4da2df79 tempest-VolumesSnapshotListTestJSON-1551204288 None] Lock "cinder-2e93e02f-a6a4-4ff6-b5c2-bc0131445433-delete_snapshot" released by "delete_snapshot" :: held 2.187s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:25:49 devstack sudo[101635]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b0a385c6-2938-4c44-8fef-a2b8063f606a tempest-VolumesExtendTest-84277837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_89278436-b56f-45f7-8c42-c9afd7bd7453_uupxgf8_devstack@QuobyteHD /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ad0647ca-1f1c-498a-929d-7a995c145702" returned: 0 in 2.242s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:49 devstack cinder-volume[88613]: DEBUG cinder.image.image_utils [None req-b0a385c6-2938-4c44-8fef-a2b8063f606a tempest-VolumesExtendTest-84277837 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_89278436-b56f-45f7-8c42-c9afd7bd7453_uupxgf8_devstack@QuobyteHD, size 112.00 MB, duration 2.24 sec, destination /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ad0647ca-1f1c-498a-929d-7a995c145702 {{(pid=88613) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 10:25:49 devstack cinder-volume[88613]: INFO cinder.image.image_utils [None req-b0a385c6-2938-4c44-8fef-a2b8063f606a tempest-VolumesExtendTest-84277837 None] Converted 112.00 MB image at 49.93 MB/s Aug 05 10:25:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b0a385c6-2938-4c44-8fef-a2b8063f606a tempest-VolumesExtendTest-84277837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ad0647ca-1f1c-498a-929d-7a995c145702 1G {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:49 devstack sudo[101666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ad0647ca-1f1c-498a-929d-7a995c145702 1G Aug 05 10:25:49 devstack sudo[101666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:49 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-9acd5261-003f-41db-82f8-49697d3b45d1 tempest-VolumesSnapshotListTestJSON-1551204288 None] Acquiring lock "cinder-7372aaad-6cff-4967-9e24-7d937657b1a9-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:25:49 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-9acd5261-003f-41db-82f8-49697d3b45d1 tempest-VolumesSnapshotListTestJSON-1551204288 None] Lock "cinder-7372aaad-6cff-4967-9e24-7d937657b1a9-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:25:49 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-9acd5261-003f-41db-82f8-49697d3b45d1 tempest-VolumesSnapshotListTestJSON-1551204288 None] Acquiring lock "cinder-quobyte-7372aaad-6cff-4967-9e24-7d937657b1a9" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:25:49 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-9acd5261-003f-41db-82f8-49697d3b45d1 tempest-VolumesSnapshotListTestJSON-1551204288 None] Lock "cinder-quobyte-7372aaad-6cff-4967-9e24-7d937657b1a9" acquired by "delete_volume" :: waited 0.028s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:25:49 devstack sudo[101666]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:49 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca6fe70-77b5-4f0e-aa7b-f4bb0b450d9f]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:25:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9acd5261-003f-41db-82f8-49697d3b45d1 tempest-VolumesSnapshotListTestJSON-1551204288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b0a385c6-2938-4c44-8fef-a2b8063f606a tempest-VolumesExtendTest-84277837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ad0647ca-1f1c-498a-929d-7a995c145702 1G" returned: 0 in 0.547s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:49 devstack cinder-volume[88613]: DEBUG cinder.volume.volume_utils [None req-b0a385c6-2938-4c44-8fef-a2b8063f606a tempest-VolumesExtendTest-84277837 None] Downloaded image 89278436-b56f-45f7-8c42-c9afd7bd7453 ((None, [{'url': 'file:///opt/stack/data/glance/images/89278436-b56f-45f7-8c42-c9afd7bd7453', 'metadata': {}}])) to volume ad0647ca-1f1c-498a-929d-7a995c145702 successfully. {{(pid=88613) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 05 10:25:49 devstack cinder-volume[88613]: DEBUG cinder.image.image_utils [None req-b0a385c6-2938-4c44-8fef-a2b8063f606a tempest-VolumesExtendTest-84277837 None] Temporary image 89278436-b56f-45f7-8c42-c9afd7bd7453 for user 336e8f22ff9e44c79e645a95b47d2d7e is deleted. {{(pid=88613) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 05 10:25:49 devstack cinder-volume[88613]: DEBUG cinder.volume.volume_utils [None req-b0a385c6-2938-4c44-8fef-a2b8063f606a tempest-VolumesExtendTest-84277837 None] Marking volume ad0647ca-1f1c-498a-929d-7a995c145702 as bootable. {{(pid=88613) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 05 10:25:49 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0a385c6-2938-4c44-8fef-a2b8063f606a tempest-VolumesExtendTest-84277837 None] Copying metadata from image 89278436-b56f-45f7-8c42-c9afd7bd7453 to ad0647ca-1f1c-498a-929d-7a995c145702. {{(pid=88613) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 05 10:25:49 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0a385c6-2938-4c44-8fef-a2b8063f606a tempest-VolumesExtendTest-84277837 None] Creating volume glance metadata for volume ad0647ca-1f1c-498a-929d-7a995c145702 backed by image 89278436-b56f-45f7-8c42-c9afd7bd7453 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '89278436-b56f-45f7-8c42-c9afd7bd7453', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88613) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 05 10:25:49 devstack sudo[101677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9 Aug 05 10:25:49 devstack sudo[101677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:49 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-b0a385c6-2938-4c44-8fef-a2b8063f606a tempest-VolumesExtendTest-84277837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d176ba8a-11d4-4ebd-968e-27cd57e508c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad0647ca-1f1c-498a-929d-7a995c145702', 'volume_size': 1, 'image_id': '89278436-b56f-45f7-8c42-c9afd7bd7453', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/89278436-b56f-45f7-8c42-c9afd7bd7453', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '654c7af809d145caaadc8738d3dc3df2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '89278436-b56f-45f7-8c42-c9afd7bd7453', 'created_at': datetime.datetime(2026, 8, 5, 8, 7, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 8, 7, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/89278436-b56f-45f7-8c42-c9afd7bd7453/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:49 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-b0a385c6-2938-4c44-8fef-a2b8063f606a tempest-VolumesExtendTest-84277837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1323ff1-8a75-418d-927a-e97383a1add4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:49 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-b0a385c6-2938-4c44-8fef-a2b8063f606a tempest-VolumesExtendTest-84277837 None] Volume volume-ad0647ca-1f1c-498a-929d-7a995c145702 (ad0647ca-1f1c-498a-929d-7a995c145702): created successfully Aug 05 10:25:49 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-b0a385c6-2938-4c44-8fef-a2b8063f606a tempest-VolumesExtendTest-84277837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1323ff1-8a75-418d-927a-e97383a1add4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:49 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-b0a385c6-2938-4c44-8fef-a2b8063f606a tempest-VolumesExtendTest-84277837 None] Flow 'volume_create_manager' (edaad6ca-6905-467f-b25a-c7baf2894513) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:25:49 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-b0a385c6-2938-4c44-8fef-a2b8063f606a tempest-VolumesExtendTest-84277837 None] Created volume successfully. Aug 05 10:25:50 devstack sudo[101677]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9acd5261-003f-41db-82f8-49697d3b45d1 tempest-VolumesSnapshotListTestJSON-1551204288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9" returned: 0 in 0.503s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9acd5261-003f-41db-82f8-49697d3b45d1 tempest-VolumesSnapshotListTestJSON-1551204288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:50 devstack sudo[101684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9 Aug 05 10:25:50 devstack sudo[101684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:50 devstack sudo[101684]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9acd5261-003f-41db-82f8-49697d3b45d1 tempest-VolumesSnapshotListTestJSON-1551204288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7372aaad-6cff-4967-9e24-7d937657b1a9" returned: 0 in 0.365s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:50 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-9acd5261-003f-41db-82f8-49697d3b45d1 tempest-VolumesSnapshotListTestJSON-1551204288 None] Lock "cinder-quobyte-7372aaad-6cff-4967-9e24-7d937657b1a9" released by "delete_volume" :: held 0.956s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:25:50 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-9acd5261-003f-41db-82f8-49697d3b45d1 tempest-VolumesSnapshotListTestJSON-1551204288 None] Created reservations ['cead1dfd-1efb-4bfd-b9d7-ba0aa3605d57', 'ab801d9c-82f2-4a8a-8162-d03563e4b4ac', '0a1b5ff9-8b95-499b-8b62-c8fdba8d1fc2', '453c75af-27e0-4900-b3c8-641d01b48e9a'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:25:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-9acd5261-003f-41db-82f8-49697d3b45d1 tempest-VolumesSnapshotListTestJSON-1551204288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:25:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-9acd5261-003f-41db-82f8-49697d3b45d1 tempest-VolumesSnapshotListTestJSON-1551204288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:25:50 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-9acd5261-003f-41db-82f8-49697d3b45d1 tempest-VolumesSnapshotListTestJSON-1551204288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:25:50 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-9acd5261-003f-41db-82f8-49697d3b45d1 tempest-VolumesSnapshotListTestJSON-1551204288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:25:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-9acd5261-003f-41db-82f8-49697d3b45d1 tempest-VolumesSnapshotListTestJSON-1551204288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:25:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9acd5261-003f-41db-82f8-49697d3b45d1 tempest-VolumesSnapshotListTestJSON-1551204288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:50 devstack sudo[101687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:25:50 devstack sudo[101687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:50 devstack sudo[101687]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9acd5261-003f-41db-82f8-49697d3b45d1 tempest-VolumesSnapshotListTestJSON-1551204288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.266s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:50 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-9acd5261-003f-41db-82f8-49697d3b45d1 tempest-VolumesSnapshotListTestJSON-1551204288 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:25:51 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-9acd5261-003f-41db-82f8-49697d3b45d1 tempest-VolumesSnapshotListTestJSON-1551204288 None] Deleted volume successfully. Aug 05 10:25:51 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-9acd5261-003f-41db-82f8-49697d3b45d1 tempest-VolumesSnapshotListTestJSON-1551204288 None] Lock "cinder-7372aaad-6cff-4967-9e24-7d937657b1a9-delete_volume" released by "delete_volume" :: held 1.557s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:25:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-30862c6a-66c5-4c8f-9286-bc7ea0b21a55 tempest-VolumesExtendTest-84277837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:25:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-30862c6a-66c5-4c8f-9286-bc7ea0b21a55 tempest-VolumesExtendTest-84277837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:25:51 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ef3aa5-b815-40a2-a6ee-4b84ed9416e6]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:25:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-30862c6a-66c5-4c8f-9286-bc7ea0b21a55 tempest-VolumesExtendTest-84277837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ad0647ca-1f1c-498a-929d-7a995c145702 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:51 devstack sudo[101690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ad0647ca-1f1c-498a-929d-7a995c145702 Aug 05 10:25:51 devstack sudo[101690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:51 devstack sudo[101690]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-30862c6a-66c5-4c8f-9286-bc7ea0b21a55 tempest-VolumesExtendTest-84277837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ad0647ca-1f1c-498a-929d-7a995c145702" returned: 0 in 0.549s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-30862c6a-66c5-4c8f-9286-bc7ea0b21a55 tempest-VolumesExtendTest-84277837 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ad0647ca-1f1c-498a-929d-7a995c145702 2G {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-30862c6a-66c5-4c8f-9286-bc7ea0b21a55 tempest-VolumesExtendTest-84277837 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ad0647ca-1f1c-498a-929d-7a995c145702 2G" returned: 0 in 0.132s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-30862c6a-66c5-4c8f-9286-bc7ea0b21a55 tempest-VolumesExtendTest-84277837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.716s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:25:52 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-30862c6a-66c5-4c8f-9286-bc7ea0b21a55 tempest-VolumesExtendTest-84277837 None] Extend volume completed successfully. Aug 05 10:25:52 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-8d3772bf-61b4-4931-b395-7ba86fbd7c19 tempest-VolumesExtendTest-84277837 None] Acquiring lock "cinder-ad0647ca-1f1c-498a-929d-7a995c145702-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:25:52 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-ece0722d-a629-4f7a-a8c8-437519c05cef tempest-ProjectReaderTests-733667239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:25:53 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ece0722d-a629-4f7a-a8c8-437519c05cef tempest-ProjectReaderTests-733667239 None] Flow 'volume_create_manager' (e7408807-cf5a-402b-8a68-0881535fb447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:25:53 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ece0722d-a629-4f7a-a8c8-437519c05cef tempest-ProjectReaderTests-733667239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (556fa599-4882-474a-9c52-4ba2cafcaa76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:53 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-8d3772bf-61b4-4931-b395-7ba86fbd7c19 tempest-VolumesExtendTest-84277837 None] Lock "cinder-ad0647ca-1f1c-498a-929d-7a995c145702-delete_volume" acquired by "delete_volume" :: waited 0.108s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:25:53 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ece0722d-a629-4f7a-a8c8-437519c05cef tempest-ProjectReaderTests-733667239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (556fa599-4882-474a-9c52-4ba2cafcaa76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:25:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1122149402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6db8f06-8c55-49c7-abda-55a94616a2b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f9729d192e24f35bd4428e4b4fe2fa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:25:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:25:53Z,use_quota=True,user_id='36abfcbbbae0460d928b1df46c26df39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:53 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ece0722d-a629-4f7a-a8c8-437519c05cef tempest-ProjectReaderTests-733667239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (811fdff8-4f2c-4fc4-9ae6-815f0c51a104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:53 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ece0722d-a629-4f7a-a8c8-437519c05cef tempest-ProjectReaderTests-733667239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (811fdff8-4f2c-4fc4-9ae6-815f0c51a104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:53 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ece0722d-a629-4f7a-a8c8-437519c05cef tempest-ProjectReaderTests-733667239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48a7ba7d-e4dd-41f9-bfa4-7dee9d3f85b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:53 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ece0722d-a629-4f7a-a8c8-437519c05cef tempest-ProjectReaderTests-733667239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48a7ba7d-e4dd-41f9-bfa4-7dee9d3f85b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6db8f06-8c55-49c7-abda-55a94616a2b1', 'volume_name': 'volume-e6db8f06-8c55-49c7-abda-55a94616a2b1', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:53 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ece0722d-a629-4f7a-a8c8-437519c05cef tempest-ProjectReaderTests-733667239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84710b21-1132-4551-adb4-f8bbb48f8695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:53 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ece0722d-a629-4f7a-a8c8-437519c05cef tempest-ProjectReaderTests-733667239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84710b21-1132-4551-adb4-f8bbb48f8695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:53 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ece0722d-a629-4f7a-a8c8-437519c05cef tempest-ProjectReaderTests-733667239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdda0068-713b-40e1-975e-ebe34d51a5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:53 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-ece0722d-a629-4f7a-a8c8-437519c05cef tempest-ProjectReaderTests-733667239 None] Volume e6db8f06-8c55-49c7-abda-55a94616a2b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6db8f06-8c55-49c7-abda-55a94616a2b1', 'volume_size': 1} Aug 05 10:25:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-ece0722d-a629-4f7a-a8c8-437519c05cef tempest-ProjectReaderTests-733667239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:25:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-ece0722d-a629-4f7a-a8c8-437519c05cef tempest-ProjectReaderTests-733667239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:25:53 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-ece0722d-a629-4f7a-a8c8-437519c05cef tempest-ProjectReaderTests-733667239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:25:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1122149402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6db8f06-8c55-49c7-abda-55a94616a2b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f9729d192e24f35bd4428e4b4fe2fa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:25:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:25:53Z,use_quota=True,user_id='36abfcbbbae0460d928b1df46c26df39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:25:53 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-ece0722d-a629-4f7a-a8c8-437519c05cef tempest-ProjectReaderTests-733667239 None] Creating volume e6db8f06-8c55-49c7-abda-55a94616a2b1 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:25:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-ece0722d-a629-4f7a-a8c8-437519c05cef tempest-ProjectReaderTests-733667239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:25:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-ece0722d-a629-4f7a-a8c8-437519c05cef tempest-ProjectReaderTests-733667239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:25:53 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-ece0722d-a629-4f7a-a8c8-437519c05cef tempest-ProjectReaderTests-733667239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:25:53 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-ece0722d-a629-4f7a-a8c8-437519c05cef tempest-ProjectReaderTests-733667239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:25:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-ece0722d-a629-4f7a-a8c8-437519c05cef tempest-ProjectReaderTests-733667239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:25:53 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-ece0722d-a629-4f7a-a8c8-437519c05cef tempest-ProjectReaderTests-733667239 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:25:53 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-ece0722d-a629-4f7a-a8c8-437519c05cef tempest-ProjectReaderTests-733667239 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:25:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ece0722d-a629-4f7a-a8c8-437519c05cef tempest-ProjectReaderTests-733667239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e6db8f06-8c55-49c7-abda-55a94616a2b1 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:53 devstack sudo[101759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e6db8f06-8c55-49c7-abda-55a94616a2b1 1073741824 Aug 05 10:25:53 devstack sudo[101759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:53 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-8d3772bf-61b4-4931-b395-7ba86fbd7c19 tempest-VolumesExtendTest-84277837 None] Acquiring lock "cinder-quobyte-ad0647ca-1f1c-498a-929d-7a995c145702" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:25:53 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-8d3772bf-61b4-4931-b395-7ba86fbd7c19 tempest-VolumesExtendTest-84277837 None] Lock "cinder-quobyte-ad0647ca-1f1c-498a-929d-7a995c145702" acquired by "delete_volume" :: waited 0.030s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:25:53 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d7e30c-94b3-435e-a3c4-a7b09d92ac00]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:25:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-8d3772bf-61b4-4931-b395-7ba86fbd7c19 tempest-VolumesExtendTest-84277837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ad0647ca-1f1c-498a-929d-7a995c145702 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:53 devstack sudo[101763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ad0647ca-1f1c-498a-929d-7a995c145702 Aug 05 10:25:53 devstack sudo[101763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:53 devstack sudo[101763]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-8d3772bf-61b4-4931-b395-7ba86fbd7c19 tempest-VolumesExtendTest-84277837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ad0647ca-1f1c-498a-929d-7a995c145702" returned: 0 in 0.643s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-8d3772bf-61b4-4931-b395-7ba86fbd7c19 tempest-VolumesExtendTest-84277837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ad0647ca-1f1c-498a-929d-7a995c145702 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:53 devstack sudo[101795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ad0647ca-1f1c-498a-929d-7a995c145702 Aug 05 10:25:53 devstack sudo[101759]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:53 devstack sudo[101795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ece0722d-a629-4f7a-a8c8-437519c05cef tempest-ProjectReaderTests-733667239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e6db8f06-8c55-49c7-abda-55a94616a2b1 1073741824" returned: 0 in 0.836s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ece0722d-a629-4f7a-a8c8-437519c05cef tempest-ProjectReaderTests-733667239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e6db8f06-8c55-49c7-abda-55a94616a2b1 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:54 devstack sudo[101797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e6db8f06-8c55-49c7-abda-55a94616a2b1 Aug 05 10:25:54 devstack sudo[101797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:54 devstack sudo[101795]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-8d3772bf-61b4-4931-b395-7ba86fbd7c19 tempest-VolumesExtendTest-84277837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ad0647ca-1f1c-498a-929d-7a995c145702" returned: 0 in 0.385s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:54 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-8d3772bf-61b4-4931-b395-7ba86fbd7c19 tempest-VolumesExtendTest-84277837 None] Lock "cinder-quobyte-ad0647ca-1f1c-498a-929d-7a995c145702" released by "delete_volume" :: held 1.079s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:25:54 devstack sudo[101797]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ece0722d-a629-4f7a-a8c8-437519c05cef tempest-ProjectReaderTests-733667239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e6db8f06-8c55-49c7-abda-55a94616a2b1" returned: 0 in 0.364s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:54 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-ece0722d-a629-4f7a-a8c8-437519c05cef tempest-ProjectReaderTests-733667239 None] <== create_volume: return (1283ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:25:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-ece0722d-a629-4f7a-a8c8-437519c05cef tempest-ProjectReaderTests-733667239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.289s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:25:54 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ece0722d-a629-4f7a-a8c8-437519c05cef tempest-ProjectReaderTests-733667239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdda0068-713b-40e1-975e-ebe34d51a5d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6db8f06-8c55-49c7-abda-55a94616a2b1', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:54 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ece0722d-a629-4f7a-a8c8-437519c05cef tempest-ProjectReaderTests-733667239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c01473c4-445e-4d12-8c4f-861befb499b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:54 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-8d3772bf-61b4-4931-b395-7ba86fbd7c19 tempest-VolumesExtendTest-84277837 None] Created reservations ['2c84c1a4-142d-44b4-9493-73a999be78a3', 'f23b4b8c-4a91-42fc-8707-77c7ce540fb4', '7cee8ccd-10d1-41e2-9bf0-53e6cc998177', '8c858d63-e32d-4dc3-8c8a-6152689c647a'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:25:54 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-ece0722d-a629-4f7a-a8c8-437519c05cef tempest-ProjectReaderTests-733667239 None] Volume volume-e6db8f06-8c55-49c7-abda-55a94616a2b1 (e6db8f06-8c55-49c7-abda-55a94616a2b1): created successfully Aug 05 10:25:54 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ece0722d-a629-4f7a-a8c8-437519c05cef tempest-ProjectReaderTests-733667239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c01473c4-445e-4d12-8c4f-861befb499b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:54 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ece0722d-a629-4f7a-a8c8-437519c05cef tempest-ProjectReaderTests-733667239 None] Flow 'volume_create_manager' (e7408807-cf5a-402b-8a68-0881535fb447) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:25:54 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-ece0722d-a629-4f7a-a8c8-437519c05cef tempest-ProjectReaderTests-733667239 None] Created volume successfully. Aug 05 10:25:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-8d3772bf-61b4-4931-b395-7ba86fbd7c19 tempest-VolumesExtendTest-84277837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:25:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-8d3772bf-61b4-4931-b395-7ba86fbd7c19 tempest-VolumesExtendTest-84277837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:25:54 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-8d3772bf-61b4-4931-b395-7ba86fbd7c19 tempest-VolumesExtendTest-84277837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:25:54 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-8d3772bf-61b4-4931-b395-7ba86fbd7c19 tempest-VolumesExtendTest-84277837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:25:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-8d3772bf-61b4-4931-b395-7ba86fbd7c19 tempest-VolumesExtendTest-84277837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:25:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-8d3772bf-61b4-4931-b395-7ba86fbd7c19 tempest-VolumesExtendTest-84277837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:54 devstack sudo[101802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:25:54 devstack sudo[101802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:54 devstack sudo[101802]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-8d3772bf-61b4-4931-b395-7ba86fbd7c19 tempest-VolumesExtendTest-84277837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.378s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:54 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-8d3772bf-61b4-4931-b395-7ba86fbd7c19 tempest-VolumesExtendTest-84277837 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:25:54 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-8d3772bf-61b4-4931-b395-7ba86fbd7c19 tempest-VolumesExtendTest-84277837 None] Deleted volume successfully. Aug 05 10:25:54 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-8d3772bf-61b4-4931-b395-7ba86fbd7c19 tempest-VolumesExtendTest-84277837 None] Lock "cinder-ad0647ca-1f1c-498a-929d-7a995c145702-delete_volume" released by "delete_volume" :: held 1.933s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:25:55 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-9a8de8ef-2a55-4cd7-8b0b-6ef39e8424cd tempest-ProjectReaderTests-733667239 None] Acquiring lock "cinder-e6db8f06-8c55-49c7-abda-55a94616a2b1-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:25:55 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-9a8de8ef-2a55-4cd7-8b0b-6ef39e8424cd tempest-ProjectReaderTests-733667239 None] Lock "cinder-e6db8f06-8c55-49c7-abda-55a94616a2b1-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:25:55 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-9a8de8ef-2a55-4cd7-8b0b-6ef39e8424cd tempest-ProjectReaderTests-733667239 None] Acquiring lock "cinder-quobyte-e6db8f06-8c55-49c7-abda-55a94616a2b1" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:25:55 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-9a8de8ef-2a55-4cd7-8b0b-6ef39e8424cd tempest-ProjectReaderTests-733667239 None] Lock "cinder-quobyte-e6db8f06-8c55-49c7-abda-55a94616a2b1" acquired by "delete_volume" :: waited 0.064s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:25:55 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26cae52-89e4-4f2b-a329-bf8333184cad]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:25:55 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9a8de8ef-2a55-4cd7-8b0b-6ef39e8424cd tempest-ProjectReaderTests-733667239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e6db8f06-8c55-49c7-abda-55a94616a2b1 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:55 devstack sudo[101813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e6db8f06-8c55-49c7-abda-55a94616a2b1 Aug 05 10:25:55 devstack sudo[101813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:56 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-416bcecd-937c-40bb-b446-7b9cf8ec6a4c tempest-VolumesExtendTest-84277837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:25:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-416bcecd-937c-40bb-b446-7b9cf8ec6a4c tempest-VolumesExtendTest-84277837 None] Flow 'volume_create_manager' (faca1ccb-c9e8-42f8-82f1-9563308bd717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:25:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-416bcecd-937c-40bb-b446-7b9cf8ec6a4c tempest-VolumesExtendTest-84277837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a50fa95-b0ff-4e0c-b39c-ba868ea59f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-416bcecd-937c-40bb-b446-7b9cf8ec6a4c tempest-VolumesExtendTest-84277837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a50fa95-b0ff-4e0c-b39c-ba868ea59f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:25:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-575505847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fe3ae7b-59ae-48ed-8982-1e2995d1ff4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5337dbcb66d1477b99ac725e7845d82b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:25:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:25:56Z,use_quota=True,user_id='336e8f22ff9e44c79e645a95b47d2d7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-416bcecd-937c-40bb-b446-7b9cf8ec6a4c tempest-VolumesExtendTest-84277837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32a77892-55d0-40fd-bee8-222f08f98cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-416bcecd-937c-40bb-b446-7b9cf8ec6a4c tempest-VolumesExtendTest-84277837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32a77892-55d0-40fd-bee8-222f08f98cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-416bcecd-937c-40bb-b446-7b9cf8ec6a4c tempest-VolumesExtendTest-84277837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f2eaaac-e9e1-47a1-b950-5625ef1b6bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-416bcecd-937c-40bb-b446-7b9cf8ec6a4c tempest-VolumesExtendTest-84277837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f2eaaac-e9e1-47a1-b950-5625ef1b6bea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fe3ae7b-59ae-48ed-8982-1e2995d1ff4d', 'volume_name': 'volume-8fe3ae7b-59ae-48ed-8982-1e2995d1ff4d', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-416bcecd-937c-40bb-b446-7b9cf8ec6a4c tempest-VolumesExtendTest-84277837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6b87b10-46de-434f-be84-353e87fdd696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-416bcecd-937c-40bb-b446-7b9cf8ec6a4c tempest-VolumesExtendTest-84277837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6b87b10-46de-434f-be84-353e87fdd696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-416bcecd-937c-40bb-b446-7b9cf8ec6a4c tempest-VolumesExtendTest-84277837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e583c6ea-b18f-4124-bfa6-de257999934a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:56 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-416bcecd-937c-40bb-b446-7b9cf8ec6a4c tempest-VolumesExtendTest-84277837 None] Volume 8fe3ae7b-59ae-48ed-8982-1e2995d1ff4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fe3ae7b-59ae-48ed-8982-1e2995d1ff4d', 'volume_size': 1} Aug 05 10:25:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-416bcecd-937c-40bb-b446-7b9cf8ec6a4c tempest-VolumesExtendTest-84277837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:25:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-416bcecd-937c-40bb-b446-7b9cf8ec6a4c tempest-VolumesExtendTest-84277837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:25:56 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-416bcecd-937c-40bb-b446-7b9cf8ec6a4c tempest-VolumesExtendTest-84277837 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:25:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-575505847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fe3ae7b-59ae-48ed-8982-1e2995d1ff4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5337dbcb66d1477b99ac725e7845d82b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:25:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:25:56Z,use_quota=True,user_id='336e8f22ff9e44c79e645a95b47d2d7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:25:56 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-416bcecd-937c-40bb-b446-7b9cf8ec6a4c tempest-VolumesExtendTest-84277837 None] Creating volume 8fe3ae7b-59ae-48ed-8982-1e2995d1ff4d {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:25:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-416bcecd-937c-40bb-b446-7b9cf8ec6a4c tempest-VolumesExtendTest-84277837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:25:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-416bcecd-937c-40bb-b446-7b9cf8ec6a4c tempest-VolumesExtendTest-84277837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:25:56 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-416bcecd-937c-40bb-b446-7b9cf8ec6a4c tempest-VolumesExtendTest-84277837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:25:56 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-416bcecd-937c-40bb-b446-7b9cf8ec6a4c tempest-VolumesExtendTest-84277837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:25:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-416bcecd-937c-40bb-b446-7b9cf8ec6a4c tempest-VolumesExtendTest-84277837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:25:56 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-416bcecd-937c-40bb-b446-7b9cf8ec6a4c tempest-VolumesExtendTest-84277837 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:25:56 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-416bcecd-937c-40bb-b446-7b9cf8ec6a4c tempest-VolumesExtendTest-84277837 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:25:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-416bcecd-937c-40bb-b446-7b9cf8ec6a4c tempest-VolumesExtendTest-84277837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8fe3ae7b-59ae-48ed-8982-1e2995d1ff4d 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:56 devstack sudo[101845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8fe3ae7b-59ae-48ed-8982-1e2995d1ff4d 1073741824 Aug 05 10:25:56 devstack sudo[101845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:56 devstack sudo[101813]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9a8de8ef-2a55-4cd7-8b0b-6ef39e8424cd tempest-ProjectReaderTests-733667239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e6db8f06-8c55-49c7-abda-55a94616a2b1" returned: 0 in 1.101s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9a8de8ef-2a55-4cd7-8b0b-6ef39e8424cd tempest-ProjectReaderTests-733667239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e6db8f06-8c55-49c7-abda-55a94616a2b1 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:56 devstack sudo[101850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e6db8f06-8c55-49c7-abda-55a94616a2b1 Aug 05 10:25:56 devstack sudo[101850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:57 devstack sudo[101845]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:57 devstack sudo[101850]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-416bcecd-937c-40bb-b446-7b9cf8ec6a4c tempest-VolumesExtendTest-84277837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8fe3ae7b-59ae-48ed-8982-1e2995d1ff4d 1073741824" returned: 0 in 0.779s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9a8de8ef-2a55-4cd7-8b0b-6ef39e8424cd tempest-ProjectReaderTests-733667239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e6db8f06-8c55-49c7-abda-55a94616a2b1" returned: 0 in 0.462s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:57 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-9a8de8ef-2a55-4cd7-8b0b-6ef39e8424cd tempest-ProjectReaderTests-733667239 None] Lock "cinder-quobyte-e6db8f06-8c55-49c7-abda-55a94616a2b1" released by "delete_volume" :: held 1.681s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:25:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-416bcecd-937c-40bb-b446-7b9cf8ec6a4c tempest-VolumesExtendTest-84277837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8fe3ae7b-59ae-48ed-8982-1e2995d1ff4d {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:57 devstack sudo[101859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8fe3ae7b-59ae-48ed-8982-1e2995d1ff4d Aug 05 10:25:57 devstack sudo[101859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:57 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-9a8de8ef-2a55-4cd7-8b0b-6ef39e8424cd tempest-ProjectReaderTests-733667239 None] Created reservations ['14acb622-0444-4e3f-a2ec-a47d039764f8', '3f79a516-c3b9-4718-98f7-95dcd199bad4', 'dbcd62ab-0367-4429-b1e2-811c49312efc', '2d3d2482-a397-4bc5-87d6-1de3ad2855bc'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:25:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-9a8de8ef-2a55-4cd7-8b0b-6ef39e8424cd tempest-ProjectReaderTests-733667239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:25:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-9a8de8ef-2a55-4cd7-8b0b-6ef39e8424cd tempest-ProjectReaderTests-733667239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:25:57 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-9a8de8ef-2a55-4cd7-8b0b-6ef39e8424cd tempest-ProjectReaderTests-733667239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:25:57 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-9a8de8ef-2a55-4cd7-8b0b-6ef39e8424cd tempest-ProjectReaderTests-733667239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:25:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-9a8de8ef-2a55-4cd7-8b0b-6ef39e8424cd tempest-ProjectReaderTests-733667239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:25:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9a8de8ef-2a55-4cd7-8b0b-6ef39e8424cd tempest-ProjectReaderTests-733667239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:57 devstack sudo[101864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:25:57 devstack sudo[101864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:57 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3a99766-4b59-46ff-b0c6-fd397d323a29 tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:25:57 devstack sudo[101859]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c3a99766-4b59-46ff-b0c6-fd397d323a29 tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] Flow 'volume_create_manager' (818072c0-66ee-467c-b57a-1107b91c2c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:25:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c3a99766-4b59-46ff-b0c6-fd397d323a29 tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (908b4ab6-bfcd-4ab3-b10c-af384b9657ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-416bcecd-937c-40bb-b446-7b9cf8ec6a4c tempest-VolumesExtendTest-84277837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8fe3ae7b-59ae-48ed-8982-1e2995d1ff4d" returned: 0 in 0.359s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:57 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-416bcecd-937c-40bb-b446-7b9cf8ec6a4c tempest-VolumesExtendTest-84277837 None] <== create_volume: return (1227ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:25:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-416bcecd-937c-40bb-b446-7b9cf8ec6a4c tempest-VolumesExtendTest-84277837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.232s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:25:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c3a99766-4b59-46ff-b0c6-fd397d323a29 tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (908b4ab6-bfcd-4ab3-b10c-af384b9657ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:25:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-440875680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=718e0616-c93c-41c0-aeb3-5c154d3b5e5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0d65cf4969442bba7f645cba37fcfb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:25:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:25:58Z,use_quota=True,user_id='64dcf5d43c674213b4f3ebe027ae81ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c3a99766-4b59-46ff-b0c6-fd397d323a29 tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14924ea2-6740-48f4-9bf7-bf656a7b93b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c3a99766-4b59-46ff-b0c6-fd397d323a29 tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14924ea2-6740-48f4-9bf7-bf656a7b93b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c3a99766-4b59-46ff-b0c6-fd397d323a29 tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd9b93e7-a818-4f08-a854-44e0bccb50b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c3a99766-4b59-46ff-b0c6-fd397d323a29 tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd9b93e7-a818-4f08-a854-44e0bccb50b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '718e0616-c93c-41c0-aeb3-5c154d3b5e5a', 'volume_name': 'volume-718e0616-c93c-41c0-aeb3-5c154d3b5e5a', 'volume_size': 2}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c3a99766-4b59-46ff-b0c6-fd397d323a29 tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d58c7d8-4d5b-4782-a324-77a7337a0be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c3a99766-4b59-46ff-b0c6-fd397d323a29 tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d58c7d8-4d5b-4782-a324-77a7337a0be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c3a99766-4b59-46ff-b0c6-fd397d323a29 tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27cbc258-79d2-4476-a480-91df5ccfbff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:57 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-c3a99766-4b59-46ff-b0c6-fd397d323a29 tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] Volume 718e0616-c93c-41c0-aeb3-5c154d3b5e5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-718e0616-c93c-41c0-aeb3-5c154d3b5e5a', 'volume_size': 2} Aug 05 10:25:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c3a99766-4b59-46ff-b0c6-fd397d323a29 tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:25:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c3a99766-4b59-46ff-b0c6-fd397d323a29 tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:25:57 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-c3a99766-4b59-46ff-b0c6-fd397d323a29 tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:25:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-440875680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=718e0616-c93c-41c0-aeb3-5c154d3b5e5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0d65cf4969442bba7f645cba37fcfb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:25:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:25:58Z,use_quota=True,user_id='64dcf5d43c674213b4f3ebe027ae81ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:25:57 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-c3a99766-4b59-46ff-b0c6-fd397d323a29 tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] Creating volume 718e0616-c93c-41c0-aeb3-5c154d3b5e5a {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:25:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c3a99766-4b59-46ff-b0c6-fd397d323a29 tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:25:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c3a99766-4b59-46ff-b0c6-fd397d323a29 tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:25:57 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-c3a99766-4b59-46ff-b0c6-fd397d323a29 tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:25:57 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-c3a99766-4b59-46ff-b0c6-fd397d323a29 tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:25:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c3a99766-4b59-46ff-b0c6-fd397d323a29 tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:25:57 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-c3a99766-4b59-46ff-b0c6-fd397d323a29 tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:25:57 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-c3a99766-4b59-46ff-b0c6-fd397d323a29 tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:25:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c3a99766-4b59-46ff-b0c6-fd397d323a29 tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-718e0616-c93c-41c0-aeb3-5c154d3b5e5a 2147483648 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:57 devstack sudo[101881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-718e0616-c93c-41c0-aeb3-5c154d3b5e5a 2147483648 Aug 05 10:25:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-416bcecd-937c-40bb-b446-7b9cf8ec6a4c tempest-VolumesExtendTest-84277837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e583c6ea-b18f-4124-bfa6-de257999934a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fe3ae7b-59ae-48ed-8982-1e2995d1ff4d', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:57 devstack sudo[101881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-416bcecd-937c-40bb-b446-7b9cf8ec6a4c tempest-VolumesExtendTest-84277837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89fa4e67-3906-4f42-97f8-5b744e68d1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:57 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-416bcecd-937c-40bb-b446-7b9cf8ec6a4c tempest-VolumesExtendTest-84277837 None] Volume volume-8fe3ae7b-59ae-48ed-8982-1e2995d1ff4d (8fe3ae7b-59ae-48ed-8982-1e2995d1ff4d): created successfully Aug 05 10:25:58 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-416bcecd-937c-40bb-b446-7b9cf8ec6a4c tempest-VolumesExtendTest-84277837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89fa4e67-3906-4f42-97f8-5b744e68d1d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:58 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-416bcecd-937c-40bb-b446-7b9cf8ec6a4c tempest-VolumesExtendTest-84277837 None] Flow 'volume_create_manager' (faca1ccb-c9e8-42f8-82f1-9563308bd717) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:25:58 devstack sudo[101864]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9a8de8ef-2a55-4cd7-8b0b-6ef39e8424cd tempest-ProjectReaderTests-733667239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.469s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:58 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-9a8de8ef-2a55-4cd7-8b0b-6ef39e8424cd tempest-ProjectReaderTests-733667239 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:25:58 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-416bcecd-937c-40bb-b446-7b9cf8ec6a4c tempest-VolumesExtendTest-84277837 None] Created volume successfully. Aug 05 10:25:58 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-9a8de8ef-2a55-4cd7-8b0b-6ef39e8424cd tempest-ProjectReaderTests-733667239 None] Deleted volume successfully. Aug 05 10:25:58 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-9a8de8ef-2a55-4cd7-8b0b-6ef39e8424cd tempest-ProjectReaderTests-733667239 None] Lock "cinder-e6db8f06-8c55-49c7-abda-55a94616a2b1-delete_volume" released by "delete_volume" :: held 2.557s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:25:58 devstack sudo[101881]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c3a99766-4b59-46ff-b0c6-fd397d323a29 tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-718e0616-c93c-41c0-aeb3-5c154d3b5e5a 2147483648" returned: 0 in 0.782s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c3a99766-4b59-46ff-b0c6-fd397d323a29 tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-718e0616-c93c-41c0-aeb3-5c154d3b5e5a {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:58 devstack sudo[101894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-718e0616-c93c-41c0-aeb3-5c154d3b5e5a Aug 05 10:25:58 devstack sudo[101894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:58 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-939a41ee-7de1-4c9a-a142-13d64588b15f tempest-ProjectReaderTests-733667239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:25:58 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-939a41ee-7de1-4c9a-a142-13d64588b15f tempest-ProjectReaderTests-733667239 None] Flow 'volume_create_manager' (66c75468-8632-42be-91b1-b0f8cf351ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:25:58 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-939a41ee-7de1-4c9a-a142-13d64588b15f tempest-ProjectReaderTests-733667239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b5b7321-54d4-443d-ab41-49ea8c823539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:58 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-939a41ee-7de1-4c9a-a142-13d64588b15f tempest-ProjectReaderTests-733667239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b5b7321-54d4-443d-ab41-49ea8c823539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:25:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1863590279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a5123c0-ce28-42a9-9264-96fb2bba0f68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f9729d192e24f35bd4428e4b4fe2fa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:25:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:25:59Z,use_quota=True,user_id='36abfcbbbae0460d928b1df46c26df39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:58 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-939a41ee-7de1-4c9a-a142-13d64588b15f tempest-ProjectReaderTests-733667239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72ffade6-f74c-4a4f-bc57-3e353e0a014b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:58 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-939a41ee-7de1-4c9a-a142-13d64588b15f tempest-ProjectReaderTests-733667239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72ffade6-f74c-4a4f-bc57-3e353e0a014b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:58 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-939a41ee-7de1-4c9a-a142-13d64588b15f tempest-ProjectReaderTests-733667239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (481a5366-005c-4435-84e3-80379dedbfc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:58 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-939a41ee-7de1-4c9a-a142-13d64588b15f tempest-ProjectReaderTests-733667239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (481a5366-005c-4435-84e3-80379dedbfc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a5123c0-ce28-42a9-9264-96fb2bba0f68', 'volume_name': 'volume-9a5123c0-ce28-42a9-9264-96fb2bba0f68', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:58 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-939a41ee-7de1-4c9a-a142-13d64588b15f tempest-ProjectReaderTests-733667239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01f96263-0deb-4ea6-90d0-1279f9ebae9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:59 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-939a41ee-7de1-4c9a-a142-13d64588b15f tempest-ProjectReaderTests-733667239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01f96263-0deb-4ea6-90d0-1279f9ebae9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:59 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-939a41ee-7de1-4c9a-a142-13d64588b15f tempest-ProjectReaderTests-733667239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af9fba02-75d3-4d78-9008-c437e8475d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:59 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-939a41ee-7de1-4c9a-a142-13d64588b15f tempest-ProjectReaderTests-733667239 None] Volume 9a5123c0-ce28-42a9-9264-96fb2bba0f68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a5123c0-ce28-42a9-9264-96fb2bba0f68', 'volume_size': 1} Aug 05 10:25:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-939a41ee-7de1-4c9a-a142-13d64588b15f tempest-ProjectReaderTests-733667239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:25:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-22fdbca4-f7cd-4ba2-8684-6d9cb90f3390 tempest-VolumesExtendTest-84277837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:25:59 devstack sudo[101894]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c3a99766-4b59-46ff-b0c6-fd397d323a29 tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-718e0616-c93c-41c0-aeb3-5c154d3b5e5a" returned: 0 in 0.300s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:59 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-c3a99766-4b59-46ff-b0c6-fd397d323a29 tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] <== create_volume: return (1156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:25:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c3a99766-4b59-46ff-b0c6-fd397d323a29 tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:25:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-939a41ee-7de1-4c9a-a142-13d64588b15f tempest-ProjectReaderTests-733667239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.021s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:25:59 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-939a41ee-7de1-4c9a-a142-13d64588b15f tempest-ProjectReaderTests-733667239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:25:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1863590279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a5123c0-ce28-42a9-9264-96fb2bba0f68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f9729d192e24f35bd4428e4b4fe2fa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:25:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:25:59Z,use_quota=True,user_id='36abfcbbbae0460d928b1df46c26df39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:25:59 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-939a41ee-7de1-4c9a-a142-13d64588b15f tempest-ProjectReaderTests-733667239 None] Creating volume 9a5123c0-ce28-42a9-9264-96fb2bba0f68 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:25:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-939a41ee-7de1-4c9a-a142-13d64588b15f tempest-ProjectReaderTests-733667239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:25:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-939a41ee-7de1-4c9a-a142-13d64588b15f tempest-ProjectReaderTests-733667239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:25:59 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-939a41ee-7de1-4c9a-a142-13d64588b15f tempest-ProjectReaderTests-733667239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:25:59 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-939a41ee-7de1-4c9a-a142-13d64588b15f tempest-ProjectReaderTests-733667239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:25:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-939a41ee-7de1-4c9a-a142-13d64588b15f tempest-ProjectReaderTests-733667239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:25:59 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-939a41ee-7de1-4c9a-a142-13d64588b15f tempest-ProjectReaderTests-733667239 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:25:59 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-939a41ee-7de1-4c9a-a142-13d64588b15f tempest-ProjectReaderTests-733667239 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:25:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-939a41ee-7de1-4c9a-a142-13d64588b15f tempest-ProjectReaderTests-733667239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9a5123c0-ce28-42a9-9264-96fb2bba0f68 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:59 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c3a99766-4b59-46ff-b0c6-fd397d323a29 tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27cbc258-79d2-4476-a480-91df5ccfbff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-718e0616-c93c-41c0-aeb3-5c154d3b5e5a', 'volume_size': 2}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:59 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c3a99766-4b59-46ff-b0c6-fd397d323a29 tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9c849b6-873a-437d-8912-8aa0487e7776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:59 devstack sudo[101899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9a5123c0-ce28-42a9-9264-96fb2bba0f68 1073741824 Aug 05 10:25:59 devstack sudo[101899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:59 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-c3a99766-4b59-46ff-b0c6-fd397d323a29 tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] Volume volume-718e0616-c93c-41c0-aeb3-5c154d3b5e5a (718e0616-c93c-41c0-aeb3-5c154d3b5e5a): created successfully Aug 05 10:25:59 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c3a99766-4b59-46ff-b0c6-fd397d323a29 tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9c849b6-873a-437d-8912-8aa0487e7776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:59 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c3a99766-4b59-46ff-b0c6-fd397d323a29 tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] Flow 'volume_create_manager' (818072c0-66ee-467c-b57a-1107b91c2c61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:25:59 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-c3a99766-4b59-46ff-b0c6-fd397d323a29 tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] Created volume successfully. Aug 05 10:25:59 devstack sudo[101899]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-939a41ee-7de1-4c9a-a142-13d64588b15f tempest-ProjectReaderTests-733667239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9a5123c0-ce28-42a9-9264-96fb2bba0f68 1073741824" returned: 0 in 0.453s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-939a41ee-7de1-4c9a-a142-13d64588b15f tempest-ProjectReaderTests-733667239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9a5123c0-ce28-42a9-9264-96fb2bba0f68 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:59 devstack sudo[101906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9a5123c0-ce28-42a9-9264-96fb2bba0f68 Aug 05 10:25:59 devstack sudo[101906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:59 devstack sudo[101906]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-939a41ee-7de1-4c9a-a142-13d64588b15f tempest-ProjectReaderTests-733667239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9a5123c0-ce28-42a9-9264-96fb2bba0f68" returned: 0 in 0.271s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:59 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-939a41ee-7de1-4c9a-a142-13d64588b15f tempest-ProjectReaderTests-733667239 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:25:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-939a41ee-7de1-4c9a-a142-13d64588b15f tempest-ProjectReaderTests-733667239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:25:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-22fdbca4-f7cd-4ba2-8684-6d9cb90f3390 tempest-VolumesExtendTest-84277837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.807s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:25:59 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-939a41ee-7de1-4c9a-a142-13d64588b15f tempest-ProjectReaderTests-733667239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af9fba02-75d3-4d78-9008-c437e8475d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a5123c0-ce28-42a9-9264-96fb2bba0f68', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:59 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-939a41ee-7de1-4c9a-a142-13d64588b15f tempest-ProjectReaderTests-733667239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f624fa8d-0df9-45f4-99b6-346d70708132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:59 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-22fdbca4-f7cd-4ba2-8684-6d9cb90f3390 tempest-VolumesExtendTest-84277837 None] Creating offline snapshot 7a5d2dc9-f4e0-4788-ab13-09ef14966d3b of volume 8fe3ae7b-59ae-48ed-8982-1e2995d1ff4d {{(pid=88613) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:25:59 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-939a41ee-7de1-4c9a-a142-13d64588b15f tempest-ProjectReaderTests-733667239 None] Volume volume-9a5123c0-ce28-42a9-9264-96fb2bba0f68 (9a5123c0-ce28-42a9-9264-96fb2bba0f68): created successfully Aug 05 10:25:59 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-939a41ee-7de1-4c9a-a142-13d64588b15f tempest-ProjectReaderTests-733667239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f624fa8d-0df9-45f4-99b6-346d70708132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:59 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-939a41ee-7de1-4c9a-a142-13d64588b15f tempest-ProjectReaderTests-733667239 None] Flow 'volume_create_manager' (66c75468-8632-42be-91b1-b0f8cf351ccf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:25:59 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de71d2f-cfa1-45ec-b9c7-1fe04ba6daf9]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:25:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-22fdbca4-f7cd-4ba2-8684-6d9cb90f3390 tempest-VolumesExtendTest-84277837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8fe3ae7b-59ae-48ed-8982-1e2995d1ff4d {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:59 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-939a41ee-7de1-4c9a-a142-13d64588b15f tempest-ProjectReaderTests-733667239 None] Created volume successfully. Aug 05 10:26:00 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-93553c05-0661-4df5-8a9a-f2ece2f16a86 tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:26:00 devstack sudo[101909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8fe3ae7b-59ae-48ed-8982-1e2995d1ff4d Aug 05 10:26:00 devstack sudo[101909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:00 devstack sudo[101909]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:00 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-22fdbca4-f7cd-4ba2-8684-6d9cb90f3390 tempest-VolumesExtendTest-84277837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8fe3ae7b-59ae-48ed-8982-1e2995d1ff4d" returned: 0 in 0.444s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:00 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-22fdbca4-f7cd-4ba2-8684-6d9cb90f3390 tempest-VolumesExtendTest-84277837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8fe3ae7b-59ae-48ed-8982-1e2995d1ff4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8fe3ae7b-59ae-48ed-8982-1e2995d1ff4d.7a5d2dc9-f4e0-4788-ab13-09ef14966d3b 1G {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:00 devstack sudo[101914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8fe3ae7b-59ae-48ed-8982-1e2995d1ff4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8fe3ae7b-59ae-48ed-8982-1e2995d1ff4d.7a5d2dc9-f4e0-4788-ab13-09ef14966d3b 1G Aug 05 10:26:00 devstack sudo[101914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:00 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e88a5759-d7e3-442d-ad08-2821c0df2c79 tempest-ProjectReaderTests-733667239 None] Acquiring lock "cinder-9a5123c0-ce28-42a9-9264-96fb2bba0f68-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:26:00 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e88a5759-d7e3-442d-ad08-2821c0df2c79 tempest-ProjectReaderTests-733667239 None] Lock "cinder-9a5123c0-ce28-42a9-9264-96fb2bba0f68-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:26:00 devstack sudo[101914]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:00 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-22fdbca4-f7cd-4ba2-8684-6d9cb90f3390 tempest-VolumesExtendTest-84277837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8fe3ae7b-59ae-48ed-8982-1e2995d1ff4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8fe3ae7b-59ae-48ed-8982-1e2995d1ff4d.7a5d2dc9-f4e0-4788-ab13-09ef14966d3b 1G" returned: 0 in 0.536s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:00 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-22fdbca4-f7cd-4ba2-8684-6d9cb90f3390 tempest-VolumesExtendTest-84277837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fe3ae7b-59ae-48ed-8982-1e2995d1ff4d -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8fe3ae7b-59ae-48ed-8982-1e2995d1ff4d.7a5d2dc9-f4e0-4788-ab13-09ef14966d3b {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:00 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e88a5759-d7e3-442d-ad08-2821c0df2c79 tempest-ProjectReaderTests-733667239 None] Acquiring lock "cinder-quobyte-9a5123c0-ce28-42a9-9264-96fb2bba0f68" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:26:00 devstack sudo[101920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fe3ae7b-59ae-48ed-8982-1e2995d1ff4d -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8fe3ae7b-59ae-48ed-8982-1e2995d1ff4d.7a5d2dc9-f4e0-4788-ab13-09ef14966d3b Aug 05 10:26:00 devstack sudo[101920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:00 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e88a5759-d7e3-442d-ad08-2821c0df2c79 tempest-ProjectReaderTests-733667239 None] Lock "cinder-quobyte-9a5123c0-ce28-42a9-9264-96fb2bba0f68" acquired by "delete_volume" :: waited 0.023s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:26:00 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[f45e11d1-a708-4d51-b3fc-0ad3308a6c61]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:26:00 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e88a5759-d7e3-442d-ad08-2821c0df2c79 tempest-ProjectReaderTests-733667239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9a5123c0-ce28-42a9-9264-96fb2bba0f68 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:01 devstack sudo[101922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9a5123c0-ce28-42a9-9264-96fb2bba0f68 Aug 05 10:26:01 devstack sudo[101922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:01 devstack sudo[101920]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:01 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-22fdbca4-f7cd-4ba2-8684-6d9cb90f3390 tempest-VolumesExtendTest-84277837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fe3ae7b-59ae-48ed-8982-1e2995d1ff4d -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8fe3ae7b-59ae-48ed-8982-1e2995d1ff4d.7a5d2dc9-f4e0-4788-ab13-09ef14966d3b" returned: 0 in 0.316s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:01 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-22fdbca4-f7cd-4ba2-8684-6d9cb90f3390 tempest-VolumesExtendTest-84277837 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8fe3ae7b-59ae-48ed-8982-1e2995d1ff4d.7a5d2dc9-f4e0-4788-ab13-09ef14966d3b is being set with open permissions: ugo+rw Aug 05 10:26:01 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-22fdbca4-f7cd-4ba2-8684-6d9cb90f3390 tempest-VolumesExtendTest-84277837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8fe3ae7b-59ae-48ed-8982-1e2995d1ff4d.7a5d2dc9-f4e0-4788-ab13-09ef14966d3b {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:01 devstack sudo[101928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8fe3ae7b-59ae-48ed-8982-1e2995d1ff4d.7a5d2dc9-f4e0-4788-ab13-09ef14966d3b Aug 05 10:26:01 devstack sudo[101928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:01 devstack sudo[101922]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:01 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e88a5759-d7e3-442d-ad08-2821c0df2c79 tempest-ProjectReaderTests-733667239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9a5123c0-ce28-42a9-9264-96fb2bba0f68" returned: 0 in 0.393s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:01 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e88a5759-d7e3-442d-ad08-2821c0df2c79 tempest-ProjectReaderTests-733667239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9a5123c0-ce28-42a9-9264-96fb2bba0f68 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:01 devstack sudo[101933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9a5123c0-ce28-42a9-9264-96fb2bba0f68 Aug 05 10:26:01 devstack sudo[101933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:01 devstack sudo[101928]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:01 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-22fdbca4-f7cd-4ba2-8684-6d9cb90f3390 tempest-VolumesExtendTest-84277837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8fe3ae7b-59ae-48ed-8982-1e2995d1ff4d.7a5d2dc9-f4e0-4788-ab13-09ef14966d3b" returned: 0 in 0.281s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:01 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-22fdbca4-f7cd-4ba2-8684-6d9cb90f3390 tempest-VolumesExtendTest-84277837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8fe3ae7b-59ae-48ed-8982-1e2995d1ff4d.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:01 devstack sudo[101936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8fe3ae7b-59ae-48ed-8982-1e2995d1ff4d.info Aug 05 10:26:01 devstack sudo[101936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:01 devstack sudo[101933]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:01 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e88a5759-d7e3-442d-ad08-2821c0df2c79 tempest-ProjectReaderTests-733667239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-9a5123c0-ce28-42a9-9264-96fb2bba0f68" returned: 0 in 0.295s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:01 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e88a5759-d7e3-442d-ad08-2821c0df2c79 tempest-ProjectReaderTests-733667239 None] Lock "cinder-quobyte-9a5123c0-ce28-42a9-9264-96fb2bba0f68" released by "delete_volume" :: held 0.739s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:26:01 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-e88a5759-d7e3-442d-ad08-2821c0df2c79 tempest-ProjectReaderTests-733667239 None] Created reservations ['40e7b91f-91aa-4f14-b246-45e02f49d38e', 'ced2c045-aaac-43f3-a10b-10e7fe1da8d0', '90a26896-b6c6-4e11-94bf-34c66ce73d75', '96ee4d4d-0199-4c68-91b8-dc1d0624609d'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:26:01 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-e88a5759-d7e3-442d-ad08-2821c0df2c79 tempest-ProjectReaderTests-733667239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:26:01 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-e88a5759-d7e3-442d-ad08-2821c0df2c79 tempest-ProjectReaderTests-733667239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:26:01 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-e88a5759-d7e3-442d-ad08-2821c0df2c79 tempest-ProjectReaderTests-733667239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:26:01 devstack sudo[101936]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:01 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-e88a5759-d7e3-442d-ad08-2821c0df2c79 tempest-ProjectReaderTests-733667239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:26:01 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-e88a5759-d7e3-442d-ad08-2821c0df2c79 tempest-ProjectReaderTests-733667239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:26:01 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e88a5759-d7e3-442d-ad08-2821c0df2c79 tempest-ProjectReaderTests-733667239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:01 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-22fdbca4-f7cd-4ba2-8684-6d9cb90f3390 tempest-VolumesExtendTest-84277837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8fe3ae7b-59ae-48ed-8982-1e2995d1ff4d.info" returned: 0 in 0.308s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:01 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-22fdbca4-f7cd-4ba2-8684-6d9cb90f3390 tempest-VolumesExtendTest-84277837 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8fe3ae7b-59ae-48ed-8982-1e2995d1ff4d.info is being set with open permissions: ugo+rw Aug 05 10:26:01 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-22fdbca4-f7cd-4ba2-8684-6d9cb90f3390 tempest-VolumesExtendTest-84277837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8fe3ae7b-59ae-48ed-8982-1e2995d1ff4d.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:01 devstack sudo[101940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:26:01 devstack sudo[101940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:01 devstack sudo[101941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8fe3ae7b-59ae-48ed-8982-1e2995d1ff4d.info Aug 05 10:26:01 devstack sudo[101941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:02 devstack sudo[101941]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:02 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-22fdbca4-f7cd-4ba2-8684-6d9cb90f3390 tempest-VolumesExtendTest-84277837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8fe3ae7b-59ae-48ed-8982-1e2995d1ff4d.info" returned: 0 in 0.299s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:02 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-22fdbca4-f7cd-4ba2-8684-6d9cb90f3390 tempest-VolumesExtendTest-84277837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.339s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:26:02 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-93553c05-0661-4df5-8a9a-f2ece2f16a86 tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.132s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:26:02 devstack sudo[101940]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:02 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e88a5759-d7e3-442d-ad08-2821c0df2c79 tempest-ProjectReaderTests-733667239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.359s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:02 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-e88a5759-d7e3-442d-ad08-2821c0df2c79 tempest-ProjectReaderTests-733667239 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:26:02 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-e88a5759-d7e3-442d-ad08-2821c0df2c79 tempest-ProjectReaderTests-733667239 None] Deleted volume successfully. Aug 05 10:26:02 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-93553c05-0661-4df5-8a9a-f2ece2f16a86 tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] Creating offline snapshot ea089461-0cdd-40ad-80a2-66a7945db2cf of volume 718e0616-c93c-41c0-aeb3-5c154d3b5e5a {{(pid=88613) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:26:02 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-22fdbca4-f7cd-4ba2-8684-6d9cb90f3390 tempest-VolumesExtendTest-84277837 None] Create snapshot completed successfully Aug 05 10:26:02 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab03fec-86ed-436f-af3e-1f3606bf6d83]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:26:02 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-93553c05-0661-4df5-8a9a-f2ece2f16a86 tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-718e0616-c93c-41c0-aeb3-5c154d3b5e5a {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:02 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e88a5759-d7e3-442d-ad08-2821c0df2c79 tempest-ProjectReaderTests-733667239 None] Lock "cinder-9a5123c0-ce28-42a9-9264-96fb2bba0f68-delete_volume" released by "delete_volume" :: held 1.439s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:26:02 devstack sudo[101946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-718e0616-c93c-41c0-aeb3-5c154d3b5e5a Aug 05 10:26:02 devstack sudo[101946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:02 devstack sudo[101946]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:02 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-93553c05-0661-4df5-8a9a-f2ece2f16a86 tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-718e0616-c93c-41c0-aeb3-5c154d3b5e5a" returned: 0 in 0.462s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:02 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-93553c05-0661-4df5-8a9a-f2ece2f16a86 tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-718e0616-c93c-41c0-aeb3-5c154d3b5e5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-718e0616-c93c-41c0-aeb3-5c154d3b5e5a.ea089461-0cdd-40ad-80a2-66a7945db2cf 2G {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:02 devstack sudo[101953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-718e0616-c93c-41c0-aeb3-5c154d3b5e5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-718e0616-c93c-41c0-aeb3-5c154d3b5e5a.ea089461-0cdd-40ad-80a2-66a7945db2cf 2G Aug 05 10:26:02 devstack sudo[101953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:03 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-761642a9-a108-4ee2-a107-0be14a5eaba0 tempest-VolumesExtendTest-84277837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:26:03 devstack sudo[101953]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:03 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-93553c05-0661-4df5-8a9a-f2ece2f16a86 tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-718e0616-c93c-41c0-aeb3-5c154d3b5e5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-718e0616-c93c-41c0-aeb3-5c154d3b5e5a.ea089461-0cdd-40ad-80a2-66a7945db2cf 2G" returned: 0 in 0.576s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:03 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-93553c05-0661-4df5-8a9a-f2ece2f16a86 tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-718e0616-c93c-41c0-aeb3-5c154d3b5e5a -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-718e0616-c93c-41c0-aeb3-5c154d3b5e5a.ea089461-0cdd-40ad-80a2-66a7945db2cf {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:03 devstack sudo[101959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-718e0616-c93c-41c0-aeb3-5c154d3b5e5a -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-718e0616-c93c-41c0-aeb3-5c154d3b5e5a.ea089461-0cdd-40ad-80a2-66a7945db2cf Aug 05 10:26:03 devstack sudo[101959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:03 devstack sudo[101959]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:03 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-93553c05-0661-4df5-8a9a-f2ece2f16a86 tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-718e0616-c93c-41c0-aeb3-5c154d3b5e5a -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-718e0616-c93c-41c0-aeb3-5c154d3b5e5a.ea089461-0cdd-40ad-80a2-66a7945db2cf" returned: 0 in 0.358s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:03 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-93553c05-0661-4df5-8a9a-f2ece2f16a86 tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-718e0616-c93c-41c0-aeb3-5c154d3b5e5a.ea089461-0cdd-40ad-80a2-66a7945db2cf is being set with open permissions: ugo+rw Aug 05 10:26:03 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-93553c05-0661-4df5-8a9a-f2ece2f16a86 tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-718e0616-c93c-41c0-aeb3-5c154d3b5e5a.ea089461-0cdd-40ad-80a2-66a7945db2cf {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:03 devstack sudo[101964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-718e0616-c93c-41c0-aeb3-5c154d3b5e5a.ea089461-0cdd-40ad-80a2-66a7945db2cf Aug 05 10:26:03 devstack sudo[101964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:03 devstack sudo[101964]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:03 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-93553c05-0661-4df5-8a9a-f2ece2f16a86 tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-718e0616-c93c-41c0-aeb3-5c154d3b5e5a.ea089461-0cdd-40ad-80a2-66a7945db2cf" returned: 0 in 0.286s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:03 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-93553c05-0661-4df5-8a9a-f2ece2f16a86 tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-718e0616-c93c-41c0-aeb3-5c154d3b5e5a.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:04 devstack sudo[101967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-718e0616-c93c-41c0-aeb3-5c154d3b5e5a.info Aug 05 10:26:04 devstack sudo[101967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:04 devstack sudo[101967]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-93553c05-0661-4df5-8a9a-f2ece2f16a86 tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-718e0616-c93c-41c0-aeb3-5c154d3b5e5a.info" returned: 0 in 0.304s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:04 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-93553c05-0661-4df5-8a9a-f2ece2f16a86 tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-718e0616-c93c-41c0-aeb3-5c154d3b5e5a.info is being set with open permissions: ugo+rw Aug 05 10:26:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-93553c05-0661-4df5-8a9a-f2ece2f16a86 tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-718e0616-c93c-41c0-aeb3-5c154d3b5e5a.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:04 devstack sudo[101970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-718e0616-c93c-41c0-aeb3-5c154d3b5e5a.info Aug 05 10:26:04 devstack sudo[101970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:04 devstack sudo[101970]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-93553c05-0661-4df5-8a9a-f2ece2f16a86 tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-718e0616-c93c-41c0-aeb3-5c154d3b5e5a.info" returned: 0 in 0.285s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-93553c05-0661-4df5-8a9a-f2ece2f16a86 tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.421s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:26:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-761642a9-a108-4ee2-a107-0be14a5eaba0 tempest-VolumesExtendTest-84277837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.537s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:26:04 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b94029-150d-4cc0-a740-bd05a9fd266f]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:26:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-761642a9-a108-4ee2-a107-0be14a5eaba0 tempest-VolumesExtendTest-84277837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8fe3ae7b-59ae-48ed-8982-1e2995d1ff4d {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:04 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-93553c05-0661-4df5-8a9a-f2ece2f16a86 tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] Create snapshot completed successfully Aug 05 10:26:04 devstack sudo[101974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8fe3ae7b-59ae-48ed-8982-1e2995d1ff4d Aug 05 10:26:04 devstack sudo[101974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:04 devstack sudo[101974]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-761642a9-a108-4ee2-a107-0be14a5eaba0 tempest-VolumesExtendTest-84277837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8fe3ae7b-59ae-48ed-8982-1e2995d1ff4d" returned: 0 in 0.378s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:05 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-761642a9-a108-4ee2-a107-0be14a5eaba0 tempest-VolumesExtendTest-84277837 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8fe3ae7b-59ae-48ed-8982-1e2995d1ff4d.7a5d2dc9-f4e0-4788-ab13-09ef14966d3b 2G {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:05 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-761642a9-a108-4ee2-a107-0be14a5eaba0 tempest-VolumesExtendTest-84277837 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8fe3ae7b-59ae-48ed-8982-1e2995d1ff4d.7a5d2dc9-f4e0-4788-ab13-09ef14966d3b 2G" returned: 0 in 0.130s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:05 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-761642a9-a108-4ee2-a107-0be14a5eaba0 tempest-VolumesExtendTest-84277837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.549s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:26:05 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-761642a9-a108-4ee2-a107-0be14a5eaba0 tempest-VolumesExtendTest-84277837 None] Extend volume completed successfully. Aug 05 10:26:05 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-aea27ca3-87fc-485e-b0f9-21cdf442924b tempest-VolumesExtendTest-84277837 None] Acquiring lock "cinder-7a5d2dc9-f4e0-4788-ab13-09ef14966d3b-delete_snapshot" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:26:05 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-b9d94875-1e12-4d83-a6b3-3bd19b466bbc tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] Acquiring lock "cinder-ea089461-0cdd-40ad-80a2-66a7945db2cf-delete_snapshot" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:26:05 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-aea27ca3-87fc-485e-b0f9-21cdf442924b tempest-VolumesExtendTest-84277837 None] Lock "cinder-7a5d2dc9-f4e0-4788-ab13-09ef14966d3b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:26:05 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-aea27ca3-87fc-485e-b0f9-21cdf442924b tempest-VolumesExtendTest-84277837 None] Acquiring lock "cinder-quobyte-8fe3ae7b-59ae-48ed-8982-1e2995d1ff4d" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:26:05 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-b9d94875-1e12-4d83-a6b3-3bd19b466bbc tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] Lock "cinder-ea089461-0cdd-40ad-80a2-66a7945db2cf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:26:05 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-b9d94875-1e12-4d83-a6b3-3bd19b466bbc tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] Acquiring lock "cinder-quobyte-718e0616-c93c-41c0-aeb3-5c154d3b5e5a" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:26:05 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-aea27ca3-87fc-485e-b0f9-21cdf442924b tempest-VolumesExtendTest-84277837 None] Lock "cinder-quobyte-8fe3ae7b-59ae-48ed-8982-1e2995d1ff4d" acquired by "delete_snapshot" :: waited 0.034s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:26:05 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-aea27ca3-87fc-485e-b0f9-21cdf442924b tempest-VolumesExtendTest-84277837 None] Acquiring lock "cinder-quobyte-7a5d2dc9-f4e0-4788-ab13-09ef14966d3b" by "_delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:26:05 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-b9d94875-1e12-4d83-a6b3-3bd19b466bbc tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] Lock "cinder-quobyte-718e0616-c93c-41c0-aeb3-5c154d3b5e5a" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:26:05 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-b9d94875-1e12-4d83-a6b3-3bd19b466bbc tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] Acquiring lock "cinder-quobyte-ea089461-0cdd-40ad-80a2-66a7945db2cf" by "_delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:26:05 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-aea27ca3-87fc-485e-b0f9-21cdf442924b tempest-VolumesExtendTest-84277837 None] Lock "cinder-quobyte-7a5d2dc9-f4e0-4788-ab13-09ef14966d3b" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:26:05 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-aea27ca3-87fc-485e-b0f9-21cdf442924b tempest-VolumesExtendTest-84277837 None] Deleting offline snapshot 7a5d2dc9-f4e0-4788-ab13-09ef14966d3b of volume 8fe3ae7b-59ae-48ed-8982-1e2995d1ff4d {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:26:05 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-aea27ca3-87fc-485e-b0f9-21cdf442924b tempest-VolumesExtendTest-84277837 None] snapshot_file for this snap is: volume-8fe3ae7b-59ae-48ed-8982-1e2995d1ff4d.7a5d2dc9-f4e0-4788-ab13-09ef14966d3b {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:26:05 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-b9d94875-1e12-4d83-a6b3-3bd19b466bbc tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] Lock "cinder-quobyte-ea089461-0cdd-40ad-80a2-66a7945db2cf" acquired by "_delete_snapshot" :: waited 0.054s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:26:05 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-b9d94875-1e12-4d83-a6b3-3bd19b466bbc tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] Deleting offline snapshot ea089461-0cdd-40ad-80a2-66a7945db2cf of volume 718e0616-c93c-41c0-aeb3-5c154d3b5e5a {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:26:05 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-b9d94875-1e12-4d83-a6b3-3bd19b466bbc tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] snapshot_file for this snap is: volume-718e0616-c93c-41c0-aeb3-5c154d3b5e5a.ea089461-0cdd-40ad-80a2-66a7945db2cf {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:26:05 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40a44f9-db04-4feb-8d4e-9cf1ecabdb39]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:26:05 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-aea27ca3-87fc-485e-b0f9-21cdf442924b tempest-VolumesExtendTest-84277837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8fe3ae7b-59ae-48ed-8982-1e2995d1ff4d.7a5d2dc9-f4e0-4788-ab13-09ef14966d3b {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:05 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f9cc0ee-f98d-4e1a-ac8a-abdd634c4f93]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:26:05 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b9d94875-1e12-4d83-a6b3-3bd19b466bbc tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-718e0616-c93c-41c0-aeb3-5c154d3b5e5a.ea089461-0cdd-40ad-80a2-66a7945db2cf {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:05 devstack sudo[101983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8fe3ae7b-59ae-48ed-8982-1e2995d1ff4d.7a5d2dc9-f4e0-4788-ab13-09ef14966d3b Aug 05 10:26:05 devstack sudo[101983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:05 devstack sudo[101984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-718e0616-c93c-41c0-aeb3-5c154d3b5e5a.ea089461-0cdd-40ad-80a2-66a7945db2cf Aug 05 10:26:05 devstack sudo[101984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:05 devstack sudo[101983]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:05 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-aea27ca3-87fc-485e-b0f9-21cdf442924b tempest-VolumesExtendTest-84277837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8fe3ae7b-59ae-48ed-8982-1e2995d1ff4d.7a5d2dc9-f4e0-4788-ab13-09ef14966d3b" returned: 0 in 0.395s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:05 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-aea27ca3-87fc-485e-b0f9-21cdf442924b tempest-VolumesExtendTest-84277837 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8fe3ae7b-59ae-48ed-8982-1e2995d1ff4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88613) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:26:05 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[576b4825-944b-48d4-8b9d-8c7535e70496]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:26:05 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-aea27ca3-87fc-485e-b0f9-21cdf442924b tempest-VolumesExtendTest-84277837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8fe3ae7b-59ae-48ed-8982-1e2995d1ff4d {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:06 devstack sudo[101984]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b9d94875-1e12-4d83-a6b3-3bd19b466bbc tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-718e0616-c93c-41c0-aeb3-5c154d3b5e5a.ea089461-0cdd-40ad-80a2-66a7945db2cf" returned: 0 in 0.445s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:06 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-b9d94875-1e12-4d83-a6b3-3bd19b466bbc tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-718e0616-c93c-41c0-aeb3-5c154d3b5e5a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88613) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:26:06 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0bfcae-e2ea-4f98-8c91-e4e569e9d9d3]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:26:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b9d94875-1e12-4d83-a6b3-3bd19b466bbc tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-718e0616-c93c-41c0-aeb3-5c154d3b5e5a {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:06 devstack sudo[101993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8fe3ae7b-59ae-48ed-8982-1e2995d1ff4d Aug 05 10:26:06 devstack sudo[101993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:06 devstack sudo[101994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-718e0616-c93c-41c0-aeb3-5c154d3b5e5a Aug 05 10:26:06 devstack sudo[101994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:06 devstack sudo[101993]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-aea27ca3-87fc-485e-b0f9-21cdf442924b tempest-VolumesExtendTest-84277837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8fe3ae7b-59ae-48ed-8982-1e2995d1ff4d" returned: 0 in 0.406s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-aea27ca3-87fc-485e-b0f9-21cdf442924b tempest-VolumesExtendTest-84277837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8fe3ae7b-59ae-48ed-8982-1e2995d1ff4d.7a5d2dc9-f4e0-4788-ab13-09ef14966d3b {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:06 devstack sudo[102002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8fe3ae7b-59ae-48ed-8982-1e2995d1ff4d.7a5d2dc9-f4e0-4788-ab13-09ef14966d3b Aug 05 10:26:06 devstack sudo[102002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:06 devstack sudo[101994]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b9d94875-1e12-4d83-a6b3-3bd19b466bbc tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-718e0616-c93c-41c0-aeb3-5c154d3b5e5a" returned: 0 in 0.441s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b9d94875-1e12-4d83-a6b3-3bd19b466bbc tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-718e0616-c93c-41c0-aeb3-5c154d3b5e5a.ea089461-0cdd-40ad-80a2-66a7945db2cf {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:06 devstack sudo[102005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-718e0616-c93c-41c0-aeb3-5c154d3b5e5a.ea089461-0cdd-40ad-80a2-66a7945db2cf Aug 05 10:26:06 devstack sudo[102005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:06 devstack sudo[102002]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-aea27ca3-87fc-485e-b0f9-21cdf442924b tempest-VolumesExtendTest-84277837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8fe3ae7b-59ae-48ed-8982-1e2995d1ff4d.7a5d2dc9-f4e0-4788-ab13-09ef14966d3b" returned: 0 in 0.474s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-aea27ca3-87fc-485e-b0f9-21cdf442924b tempest-VolumesExtendTest-84277837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8fe3ae7b-59ae-48ed-8982-1e2995d1ff4d.7a5d2dc9-f4e0-4788-ab13-09ef14966d3b {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:06 devstack sudo[102005]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b9d94875-1e12-4d83-a6b3-3bd19b466bbc tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-718e0616-c93c-41c0-aeb3-5c154d3b5e5a.ea089461-0cdd-40ad-80a2-66a7945db2cf" returned: 0 in 0.402s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b9d94875-1e12-4d83-a6b3-3bd19b466bbc tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-718e0616-c93c-41c0-aeb3-5c154d3b5e5a.ea089461-0cdd-40ad-80a2-66a7945db2cf {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:06 devstack sudo[102014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8fe3ae7b-59ae-48ed-8982-1e2995d1ff4d.7a5d2dc9-f4e0-4788-ab13-09ef14966d3b Aug 05 10:26:06 devstack sudo[102014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:06 devstack sudo[102016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-718e0616-c93c-41c0-aeb3-5c154d3b5e5a.ea089461-0cdd-40ad-80a2-66a7945db2cf Aug 05 10:26:06 devstack sudo[102016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:07 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-3eee625b-39b8-409a-8aaf-910e8d29ad91 tempest-VolumesNegativeTest-559948873 None] Acquiring lock "cinder-18f5d97b-fddd-4866-97a4-3a18f92be960-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:26:07 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-3eee625b-39b8-409a-8aaf-910e8d29ad91 tempest-VolumesNegativeTest-559948873 None] Lock "cinder-18f5d97b-fddd-4866-97a4-3a18f92be960-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:26:07 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-3eee625b-39b8-409a-8aaf-910e8d29ad91 tempest-VolumesNegativeTest-559948873 None] Acquiring lock "cinder-quobyte-18f5d97b-fddd-4866-97a4-3a18f92be960" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:26:07 devstack sudo[102014]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:07 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-3eee625b-39b8-409a-8aaf-910e8d29ad91 tempest-VolumesNegativeTest-559948873 None] Lock "cinder-quobyte-18f5d97b-fddd-4866-97a4-3a18f92be960" acquired by "delete_volume" :: waited 0.021s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:26:07 devstack sudo[102016]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-aea27ca3-87fc-485e-b0f9-21cdf442924b tempest-VolumesExtendTest-84277837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8fe3ae7b-59ae-48ed-8982-1e2995d1ff4d.7a5d2dc9-f4e0-4788-ab13-09ef14966d3b" returned: 0 in 0.315s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b9d94875-1e12-4d83-a6b3-3bd19b466bbc tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-718e0616-c93c-41c0-aeb3-5c154d3b5e5a.ea089461-0cdd-40ad-80a2-66a7945db2cf" returned: 0 in 0.291s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:07 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a43f2b-88e5-4cf1-9bfd-985ec175acbc]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:26:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3eee625b-39b8-409a-8aaf-910e8d29ad91 tempest-VolumesNegativeTest-559948873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-18f5d97b-fddd-4866-97a4-3a18f92be960 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:07 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-aea27ca3-87fc-485e-b0f9-21cdf442924b tempest-VolumesExtendTest-84277837 None] Lock "cinder-quobyte-7a5d2dc9-f4e0-4788-ab13-09ef14966d3b" released by "_delete_snapshot" :: held 1.769s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:26:07 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-b9d94875-1e12-4d83-a6b3-3bd19b466bbc tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] Lock "cinder-quobyte-ea089461-0cdd-40ad-80a2-66a7945db2cf" released by "_delete_snapshot" :: held 1.745s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:26:07 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-aea27ca3-87fc-485e-b0f9-21cdf442924b tempest-VolumesExtendTest-84277837 None] Lock "cinder-quobyte-8fe3ae7b-59ae-48ed-8982-1e2995d1ff4d" released by "delete_snapshot" :: held 1.816s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:26:07 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-b9d94875-1e12-4d83-a6b3-3bd19b466bbc tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] Lock "cinder-quobyte-718e0616-c93c-41c0-aeb3-5c154d3b5e5a" released by "delete_snapshot" :: held 1.818s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:26:07 devstack sudo[102020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-18f5d97b-fddd-4866-97a4-3a18f92be960 Aug 05 10:26:07 devstack sudo[102020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:07 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-aea27ca3-87fc-485e-b0f9-21cdf442924b tempest-VolumesExtendTest-84277837 None] Created reservations ['52408bdd-47da-4a17-b9a4-d696cab2acea', 'a0a3b4f5-cf15-401d-bf6a-76d038f69c0f', '64ac144e-d785-4ea6-bf0d-898fa432e959', 'e1499cc6-a3ec-4d1e-ac38-6a0b92b167bc'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:26:07 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-b9d94875-1e12-4d83-a6b3-3bd19b466bbc tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] Created reservations ['e95e2723-c7a1-402c-a10c-29169e7737c1', '12797736-9e4c-4a05-9f40-bd559ad5f1f1', '8589bde2-9891-4b22-99e9-759f3a4b7002', '2a1c698c-2e0f-41ed-b542-7f259737cf63'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:26:07 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-b9d94875-1e12-4d83-a6b3-3bd19b466bbc tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] Delete snapshot completed successfully. Aug 05 10:26:07 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-b9d94875-1e12-4d83-a6b3-3bd19b466bbc tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] Lock "cinder-ea089461-0cdd-40ad-80a2-66a7945db2cf-delete_snapshot" released by "delete_snapshot" :: held 2.029s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:26:07 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-aea27ca3-87fc-485e-b0f9-21cdf442924b tempest-VolumesExtendTest-84277837 None] Delete snapshot completed successfully. Aug 05 10:26:07 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-aea27ca3-87fc-485e-b0f9-21cdf442924b tempest-VolumesExtendTest-84277837 None] Lock "cinder-7a5d2dc9-f4e0-4788-ab13-09ef14966d3b-delete_snapshot" released by "delete_snapshot" :: held 2.104s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:26:07 devstack sudo[102020]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3eee625b-39b8-409a-8aaf-910e8d29ad91 tempest-VolumesNegativeTest-559948873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-18f5d97b-fddd-4866-97a4-3a18f92be960" returned: 0 in 0.448s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3eee625b-39b8-409a-8aaf-910e8d29ad91 tempest-VolumesNegativeTest-559948873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-18f5d97b-fddd-4866-97a4-3a18f92be960 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:07 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-35678703-06bd-4ac9-95a3-e80c8b3b7b42 tempest-VolumesExtendTest-84277837 None] Acquiring lock "cinder-8fe3ae7b-59ae-48ed-8982-1e2995d1ff4d-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:26:07 devstack sudo[102025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-18f5d97b-fddd-4866-97a4-3a18f92be960 Aug 05 10:26:07 devstack sudo[102025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:07 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d52ce9e6-f9b1-4595-b467-3de092d2f53f tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] Acquiring lock "cinder-718e0616-c93c-41c0-aeb3-5c154d3b5e5a-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:26:07 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-35678703-06bd-4ac9-95a3-e80c8b3b7b42 tempest-VolumesExtendTest-84277837 None] Lock "cinder-8fe3ae7b-59ae-48ed-8982-1e2995d1ff4d-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:26:07 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d52ce9e6-f9b1-4595-b467-3de092d2f53f tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] Lock "cinder-718e0616-c93c-41c0-aeb3-5c154d3b5e5a-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:26:07 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-35678703-06bd-4ac9-95a3-e80c8b3b7b42 tempest-VolumesExtendTest-84277837 None] Acquiring lock "cinder-quobyte-8fe3ae7b-59ae-48ed-8982-1e2995d1ff4d" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:26:07 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d52ce9e6-f9b1-4595-b467-3de092d2f53f tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] Acquiring lock "cinder-quobyte-718e0616-c93c-41c0-aeb3-5c154d3b5e5a" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:26:07 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-35678703-06bd-4ac9-95a3-e80c8b3b7b42 tempest-VolumesExtendTest-84277837 None] Lock "cinder-quobyte-8fe3ae7b-59ae-48ed-8982-1e2995d1ff4d" acquired by "delete_volume" :: waited 0.029s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:26:07 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d21c9cf-7947-4261-a735-a4dea1af6a00]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:26:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-35678703-06bd-4ac9-95a3-e80c8b3b7b42 tempest-VolumesExtendTest-84277837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8fe3ae7b-59ae-48ed-8982-1e2995d1ff4d {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:07 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d52ce9e6-f9b1-4595-b467-3de092d2f53f tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] Lock "cinder-quobyte-718e0616-c93c-41c0-aeb3-5c154d3b5e5a" acquired by "delete_volume" :: waited 0.058s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:26:07 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb20303-bdab-4eb7-b963-5968e56230e0]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:26:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d52ce9e6-f9b1-4595-b467-3de092d2f53f tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-718e0616-c93c-41c0-aeb3-5c154d3b5e5a {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:07 devstack sudo[102025]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3eee625b-39b8-409a-8aaf-910e8d29ad91 tempest-VolumesNegativeTest-559948873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-18f5d97b-fddd-4866-97a4-3a18f92be960" returned: 0 in 0.289s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:07 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-3eee625b-39b8-409a-8aaf-910e8d29ad91 tempest-VolumesNegativeTest-559948873 None] Lock "cinder-quobyte-18f5d97b-fddd-4866-97a4-3a18f92be960" released by "delete_volume" :: held 0.779s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:26:07 devstack sudo[102030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8fe3ae7b-59ae-48ed-8982-1e2995d1ff4d Aug 05 10:26:07 devstack sudo[102030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:08 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-3eee625b-39b8-409a-8aaf-910e8d29ad91 tempest-VolumesNegativeTest-559948873 None] Created reservations ['bba71cd0-4217-4aa1-b9ad-c634a9ca4afa', '6cc93203-81f6-43fd-9cb4-726cc081ea48', 'b7c23343-e158-4bf7-a17a-06228dc0c346', 'f1f717c6-8441-4dae-8f71-947fb4e2ab54'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:26:08 devstack sudo[102035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-718e0616-c93c-41c0-aeb3-5c154d3b5e5a Aug 05 10:26:08 devstack sudo[102035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-3eee625b-39b8-409a-8aaf-910e8d29ad91 tempest-VolumesNegativeTest-559948873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:26:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-3eee625b-39b8-409a-8aaf-910e8d29ad91 tempest-VolumesNegativeTest-559948873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:26:08 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-3eee625b-39b8-409a-8aaf-910e8d29ad91 tempest-VolumesNegativeTest-559948873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:26:08 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-3eee625b-39b8-409a-8aaf-910e8d29ad91 tempest-VolumesNegativeTest-559948873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:26:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-3eee625b-39b8-409a-8aaf-910e8d29ad91 tempest-VolumesNegativeTest-559948873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:26:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3eee625b-39b8-409a-8aaf-910e8d29ad91 tempest-VolumesNegativeTest-559948873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:08 devstack sudo[102038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:26:08 devstack sudo[102038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:08 devstack sudo[102030]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-35678703-06bd-4ac9-95a3-e80c8b3b7b42 tempest-VolumesExtendTest-84277837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8fe3ae7b-59ae-48ed-8982-1e2995d1ff4d" returned: 0 in 0.426s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-35678703-06bd-4ac9-95a3-e80c8b3b7b42 tempest-VolumesExtendTest-84277837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8fe3ae7b-59ae-48ed-8982-1e2995d1ff4d {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:08 devstack sudo[102045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8fe3ae7b-59ae-48ed-8982-1e2995d1ff4d Aug 05 10:26:08 devstack sudo[102045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:08 devstack sudo[102035]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d52ce9e6-f9b1-4595-b467-3de092d2f53f tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-718e0616-c93c-41c0-aeb3-5c154d3b5e5a" returned: 0 in 0.446s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d52ce9e6-f9b1-4595-b467-3de092d2f53f tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-718e0616-c93c-41c0-aeb3-5c154d3b5e5a {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:08 devstack sudo[102038]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3eee625b-39b8-409a-8aaf-910e8d29ad91 tempest-VolumesNegativeTest-559948873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.291s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:08 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-3eee625b-39b8-409a-8aaf-910e8d29ad91 tempest-VolumesNegativeTest-559948873 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:26:08 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-3eee625b-39b8-409a-8aaf-910e8d29ad91 tempest-VolumesNegativeTest-559948873 None] Deleted volume successfully. Aug 05 10:26:08 devstack sudo[102049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-718e0616-c93c-41c0-aeb3-5c154d3b5e5a Aug 05 10:26:08 devstack sudo[102049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:08 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-3eee625b-39b8-409a-8aaf-910e8d29ad91 tempest-VolumesNegativeTest-559948873 None] Lock "cinder-18f5d97b-fddd-4866-97a4-3a18f92be960-delete_volume" released by "delete_volume" :: held 1.310s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:26:08 devstack sudo[102045]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-35678703-06bd-4ac9-95a3-e80c8b3b7b42 tempest-VolumesExtendTest-84277837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8fe3ae7b-59ae-48ed-8982-1e2995d1ff4d" returned: 0 in 0.309s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:08 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-35678703-06bd-4ac9-95a3-e80c8b3b7b42 tempest-VolumesExtendTest-84277837 None] Lock "cinder-quobyte-8fe3ae7b-59ae-48ed-8982-1e2995d1ff4d" released by "delete_volume" :: held 0.797s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:26:08 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-35678703-06bd-4ac9-95a3-e80c8b3b7b42 tempest-VolumesExtendTest-84277837 None] Created reservations ['f1b3dfb8-64c3-49b7-b2e5-e0eec7693101', 'e5ae2cfd-aecc-4c4f-a729-a86d005265f1', '0af66e03-8204-4946-8d42-84ed6039fed3', '64437d7a-50e2-4c9e-b770-a26c094b51c7'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:26:08 devstack sudo[102049]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d52ce9e6-f9b1-4595-b467-3de092d2f53f tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-718e0616-c93c-41c0-aeb3-5c154d3b5e5a" returned: 0 in 0.317s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:08 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d52ce9e6-f9b1-4595-b467-3de092d2f53f tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] Lock "cinder-quobyte-718e0616-c93c-41c0-aeb3-5c154d3b5e5a" released by "delete_volume" :: held 0.841s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:26:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-35678703-06bd-4ac9-95a3-e80c8b3b7b42 tempest-VolumesExtendTest-84277837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:26:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-35678703-06bd-4ac9-95a3-e80c8b3b7b42 tempest-VolumesExtendTest-84277837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:26:08 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-35678703-06bd-4ac9-95a3-e80c8b3b7b42 tempest-VolumesExtendTest-84277837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:26:08 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-35678703-06bd-4ac9-95a3-e80c8b3b7b42 tempest-VolumesExtendTest-84277837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:26:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-35678703-06bd-4ac9-95a3-e80c8b3b7b42 tempest-VolumesExtendTest-84277837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:26:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-35678703-06bd-4ac9-95a3-e80c8b3b7b42 tempest-VolumesExtendTest-84277837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:08 devstack sudo[102053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:26:08 devstack sudo[102053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:08 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-d52ce9e6-f9b1-4595-b467-3de092d2f53f tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] Created reservations ['2d5eb27a-9b2b-4d5f-bc01-8ac20cf57d82', 'e44bc7ef-b0e7-4689-9415-eeea8431daba', '3fff62c6-f822-4838-8f76-e911f92532c9', '37497938-3616-4341-80cd-2a0dccfe7c5a'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:26:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-d52ce9e6-f9b1-4595-b467-3de092d2f53f tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:26:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-d52ce9e6-f9b1-4595-b467-3de092d2f53f tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:26:08 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-d52ce9e6-f9b1-4595-b467-3de092d2f53f tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:26:08 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-d52ce9e6-f9b1-4595-b467-3de092d2f53f tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:26:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-d52ce9e6-f9b1-4595-b467-3de092d2f53f tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:26:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d52ce9e6-f9b1-4595-b467-3de092d2f53f tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:08 devstack sudo[102055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:26:08 devstack sudo[102055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:09 devstack sudo[102053]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-35678703-06bd-4ac9-95a3-e80c8b3b7b42 tempest-VolumesExtendTest-84277837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.344s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:09 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-35678703-06bd-4ac9-95a3-e80c8b3b7b42 tempest-VolumesExtendTest-84277837 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:26:09 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-35678703-06bd-4ac9-95a3-e80c8b3b7b42 tempest-VolumesExtendTest-84277837 None] Deleted volume successfully. Aug 05 10:26:09 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-35678703-06bd-4ac9-95a3-e80c8b3b7b42 tempest-VolumesExtendTest-84277837 None] Lock "cinder-8fe3ae7b-59ae-48ed-8982-1e2995d1ff4d-delete_volume" released by "delete_volume" :: held 1.427s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:26:09 devstack sudo[102055]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d52ce9e6-f9b1-4595-b467-3de092d2f53f tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.326s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:09 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-d52ce9e6-f9b1-4595-b467-3de092d2f53f tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:26:09 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-d52ce9e6-f9b1-4595-b467-3de092d2f53f tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] Deleted volume successfully. Aug 05 10:26:09 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d52ce9e6-f9b1-4595-b467-3de092d2f53f tempest-VolumesSnapshotNegativeTestJSON-1839179959 None] Lock "cinder-718e0616-c93c-41c0-aeb3-5c154d3b5e5a-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:26:18 devstack cinder-volume[88613]: DEBUG dbcounter [-] [88613] Writing DB stats cinder:SELECT=139,cinder:UPDATE=174,cinder:INSERT=49,cinder:DELETE=12 {{(pid=88613) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:26:19 devstack cinder-volume[88613]: DEBUG dbcounter [-] [88613] Writing DB stats cinder:SELECT=142,cinder:UPDATE=172,cinder:DELETE=16,cinder:INSERT=50 {{(pid=88613) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:26:21 devstack cinder-volume[88613]: DEBUG oslo_service.periodic_task [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88613) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:26:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:26:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:26:21 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:26:21 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:26:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:26:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:21 devstack sudo[102063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:26:21 devstack sudo[102063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:21 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c24eb7a-8e3f-43c3-afcf-b0c56b6a576e tempest-VolumesSnapshotTestJSON-1335946817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:26:21 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0c24eb7a-8e3f-43c3-afcf-b0c56b6a576e tempest-VolumesSnapshotTestJSON-1335946817 None] Flow 'volume_create_manager' (329d8506-df3c-40d9-a4a7-59152901330e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:26:21 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0c24eb7a-8e3f-43c3-afcf-b0c56b6a576e tempest-VolumesSnapshotTestJSON-1335946817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32d62273-7643-43db-8d3f-63ee466f09d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:26:22 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0c24eb7a-8e3f-43c3-afcf-b0c56b6a576e tempest-VolumesSnapshotTestJSON-1335946817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32d62273-7643-43db-8d3f-63ee466f09d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:26:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1881925810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f586eb47-de4f-413d-8453-4791c6d62dfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffebecfb694848ba97e6f9b082ba06a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:26:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:26:22Z,use_quota=True,user_id='920f46ba702e4f74bbbd3a0291380a58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:26:22 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0c24eb7a-8e3f-43c3-afcf-b0c56b6a576e tempest-VolumesSnapshotTestJSON-1335946817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a06c605b-43da-40e2-9bda-8b58f3c38d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:26:22 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0c24eb7a-8e3f-43c3-afcf-b0c56b6a576e tempest-VolumesSnapshotTestJSON-1335946817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a06c605b-43da-40e2-9bda-8b58f3c38d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:26:22 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0c24eb7a-8e3f-43c3-afcf-b0c56b6a576e tempest-VolumesSnapshotTestJSON-1335946817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3589955a-c0be-4d0e-8c16-208173181021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:26:22 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0c24eb7a-8e3f-43c3-afcf-b0c56b6a576e tempest-VolumesSnapshotTestJSON-1335946817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3589955a-c0be-4d0e-8c16-208173181021) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f586eb47-de4f-413d-8453-4791c6d62dfc', 'volume_name': 'volume-f586eb47-de4f-413d-8453-4791c6d62dfc', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:26:22 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0c24eb7a-8e3f-43c3-afcf-b0c56b6a576e tempest-VolumesSnapshotTestJSON-1335946817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21649be3-d8a6-4cae-baf3-6fcf875ccb72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:26:22 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0c24eb7a-8e3f-43c3-afcf-b0c56b6a576e tempest-VolumesSnapshotTestJSON-1335946817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21649be3-d8a6-4cae-baf3-6fcf875ccb72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:26:22 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0c24eb7a-8e3f-43c3-afcf-b0c56b6a576e tempest-VolumesSnapshotTestJSON-1335946817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2932220e-d826-4d2f-be17-33f002daed7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:26:22 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-0c24eb7a-8e3f-43c3-afcf-b0c56b6a576e tempest-VolumesSnapshotTestJSON-1335946817 None] Volume f586eb47-de4f-413d-8453-4791c6d62dfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f586eb47-de4f-413d-8453-4791c6d62dfc', 'volume_size': 1} Aug 05 10:26:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-0c24eb7a-8e3f-43c3-afcf-b0c56b6a576e tempest-VolumesSnapshotTestJSON-1335946817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:26:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-0c24eb7a-8e3f-43c3-afcf-b0c56b6a576e tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:26:22 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-0c24eb7a-8e3f-43c3-afcf-b0c56b6a576e tempest-VolumesSnapshotTestJSON-1335946817 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:26:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1881925810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f586eb47-de4f-413d-8453-4791c6d62dfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffebecfb694848ba97e6f9b082ba06a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:26:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:26:22Z,use_quota=True,user_id='920f46ba702e4f74bbbd3a0291380a58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:26:22 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-0c24eb7a-8e3f-43c3-afcf-b0c56b6a576e tempest-VolumesSnapshotTestJSON-1335946817 None] Creating volume f586eb47-de4f-413d-8453-4791c6d62dfc {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:26:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-0c24eb7a-8e3f-43c3-afcf-b0c56b6a576e tempest-VolumesSnapshotTestJSON-1335946817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:26:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-0c24eb7a-8e3f-43c3-afcf-b0c56b6a576e tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:26:22 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-0c24eb7a-8e3f-43c3-afcf-b0c56b6a576e tempest-VolumesSnapshotTestJSON-1335946817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:26:22 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-0c24eb7a-8e3f-43c3-afcf-b0c56b6a576e tempest-VolumesSnapshotTestJSON-1335946817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:26:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-0c24eb7a-8e3f-43c3-afcf-b0c56b6a576e tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:26:22 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-0c24eb7a-8e3f-43c3-afcf-b0c56b6a576e tempest-VolumesSnapshotTestJSON-1335946817 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:26:22 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-0c24eb7a-8e3f-43c3-afcf-b0c56b6a576e tempest-VolumesSnapshotTestJSON-1335946817 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:26:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-0c24eb7a-8e3f-43c3-afcf-b0c56b6a576e tempest-VolumesSnapshotTestJSON-1335946817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f586eb47-de4f-413d-8453-4791c6d62dfc 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:22 devstack sudo[102063]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.353s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:22 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:26:22 devstack cinder-volume[88613]: DEBUG oslo_service.periodic_task [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Running periodic task VolumeManager._thread_info {{(pid=88613) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:26:22 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] thread count: 28 {{(pid=88613) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 10:26:22 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] thread info: [<_MainThread(MainThread, started 126173666128000)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88613) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 10:26:22 devstack sudo[102066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f586eb47-de4f-413d-8453-4791c6d62dfc 1073741824 Aug 05 10:26:22 devstack sudo[102066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:22 devstack sudo[102066]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-0c24eb7a-8e3f-43c3-afcf-b0c56b6a576e tempest-VolumesSnapshotTestJSON-1335946817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f586eb47-de4f-413d-8453-4791c6d62dfc 1073741824" returned: 0 in 0.572s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-0c24eb7a-8e3f-43c3-afcf-b0c56b6a576e tempest-VolumesSnapshotTestJSON-1335946817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f586eb47-de4f-413d-8453-4791c6d62dfc {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:22 devstack sudo[102072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f586eb47-de4f-413d-8453-4791c6d62dfc Aug 05 10:26:22 devstack sudo[102072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:23 devstack sudo[102072]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-0c24eb7a-8e3f-43c3-afcf-b0c56b6a576e tempest-VolumesSnapshotTestJSON-1335946817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f586eb47-de4f-413d-8453-4791c6d62dfc" returned: 0 in 0.343s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:23 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-0c24eb7a-8e3f-43c3-afcf-b0c56b6a576e tempest-VolumesSnapshotTestJSON-1335946817 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:26:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-0c24eb7a-8e3f-43c3-afcf-b0c56b6a576e tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:26:23 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0c24eb7a-8e3f-43c3-afcf-b0c56b6a576e tempest-VolumesSnapshotTestJSON-1335946817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2932220e-d826-4d2f-be17-33f002daed7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f586eb47-de4f-413d-8453-4791c6d62dfc', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:26:23 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0c24eb7a-8e3f-43c3-afcf-b0c56b6a576e tempest-VolumesSnapshotTestJSON-1335946817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6418f3f-5dc3-48c0-b447-f6b003f24d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:26:23 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-0c24eb7a-8e3f-43c3-afcf-b0c56b6a576e tempest-VolumesSnapshotTestJSON-1335946817 None] Volume volume-f586eb47-de4f-413d-8453-4791c6d62dfc (f586eb47-de4f-413d-8453-4791c6d62dfc): created successfully Aug 05 10:26:23 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0c24eb7a-8e3f-43c3-afcf-b0c56b6a576e tempest-VolumesSnapshotTestJSON-1335946817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6418f3f-5dc3-48c0-b447-f6b003f24d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:26:23 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0c24eb7a-8e3f-43c3-afcf-b0c56b6a576e tempest-VolumesSnapshotTestJSON-1335946817 None] Flow 'volume_create_manager' (329d8506-df3c-40d9-a4a7-59152901330e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:26:23 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-0c24eb7a-8e3f-43c3-afcf-b0c56b6a576e tempest-VolumesSnapshotTestJSON-1335946817 None] Created volume successfully. Aug 05 10:26:24 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-834f1968-736e-48f6-a70e-503af48e25a8 tempest-VolumesSnapshotTestJSON-1335946817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:26:24 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-834f1968-736e-48f6-a70e-503af48e25a8 tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:26:24 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-834f1968-736e-48f6-a70e-503af48e25a8 tempest-VolumesSnapshotTestJSON-1335946817 None] Creating offline snapshot 15de5d28-3c77-43ac-b114-e0e1d34568ee of volume f586eb47-de4f-413d-8453-4791c6d62dfc {{(pid=88613) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:26:24 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aea355a-88bb-48f5-928a-23b644d10964]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:26:24 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-834f1968-736e-48f6-a70e-503af48e25a8 tempest-VolumesSnapshotTestJSON-1335946817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f586eb47-de4f-413d-8453-4791c6d62dfc {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:24 devstack sudo[102075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f586eb47-de4f-413d-8453-4791c6d62dfc Aug 05 10:26:24 devstack sudo[102075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:24 devstack sudo[102075]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:24 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-834f1968-736e-48f6-a70e-503af48e25a8 tempest-VolumesSnapshotTestJSON-1335946817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f586eb47-de4f-413d-8453-4791c6d62dfc" returned: 0 in 0.424s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:24 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-834f1968-736e-48f6-a70e-503af48e25a8 tempest-VolumesSnapshotTestJSON-1335946817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f586eb47-de4f-413d-8453-4791c6d62dfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f586eb47-de4f-413d-8453-4791c6d62dfc.15de5d28-3c77-43ac-b114-e0e1d34568ee 1G {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:24 devstack sudo[102082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f586eb47-de4f-413d-8453-4791c6d62dfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f586eb47-de4f-413d-8453-4791c6d62dfc.15de5d28-3c77-43ac-b114-e0e1d34568ee 1G Aug 05 10:26:24 devstack sudo[102082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:25 devstack sudo[102082]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-834f1968-736e-48f6-a70e-503af48e25a8 tempest-VolumesSnapshotTestJSON-1335946817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f586eb47-de4f-413d-8453-4791c6d62dfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f586eb47-de4f-413d-8453-4791c6d62dfc.15de5d28-3c77-43ac-b114-e0e1d34568ee 1G" returned: 0 in 0.629s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-834f1968-736e-48f6-a70e-503af48e25a8 tempest-VolumesSnapshotTestJSON-1335946817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f586eb47-de4f-413d-8453-4791c6d62dfc -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f586eb47-de4f-413d-8453-4791c6d62dfc.15de5d28-3c77-43ac-b114-e0e1d34568ee {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:25 devstack sudo[102087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f586eb47-de4f-413d-8453-4791c6d62dfc -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f586eb47-de4f-413d-8453-4791c6d62dfc.15de5d28-3c77-43ac-b114-e0e1d34568ee Aug 05 10:26:25 devstack sudo[102087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:25 devstack sudo[102087]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-834f1968-736e-48f6-a70e-503af48e25a8 tempest-VolumesSnapshotTestJSON-1335946817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f586eb47-de4f-413d-8453-4791c6d62dfc -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f586eb47-de4f-413d-8453-4791c6d62dfc.15de5d28-3c77-43ac-b114-e0e1d34568ee" returned: 0 in 0.412s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:25 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-834f1968-736e-48f6-a70e-503af48e25a8 tempest-VolumesSnapshotTestJSON-1335946817 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f586eb47-de4f-413d-8453-4791c6d62dfc.15de5d28-3c77-43ac-b114-e0e1d34568ee is being set with open permissions: ugo+rw Aug 05 10:26:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-834f1968-736e-48f6-a70e-503af48e25a8 tempest-VolumesSnapshotTestJSON-1335946817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f586eb47-de4f-413d-8453-4791c6d62dfc.15de5d28-3c77-43ac-b114-e0e1d34568ee {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:25 devstack sudo[102093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f586eb47-de4f-413d-8453-4791c6d62dfc.15de5d28-3c77-43ac-b114-e0e1d34568ee Aug 05 10:26:25 devstack sudo[102093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:26 devstack sudo[102093]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:26 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-834f1968-736e-48f6-a70e-503af48e25a8 tempest-VolumesSnapshotTestJSON-1335946817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f586eb47-de4f-413d-8453-4791c6d62dfc.15de5d28-3c77-43ac-b114-e0e1d34568ee" returned: 0 in 0.292s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:26 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-834f1968-736e-48f6-a70e-503af48e25a8 tempest-VolumesSnapshotTestJSON-1335946817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f586eb47-de4f-413d-8453-4791c6d62dfc.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:26 devstack sudo[102096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f586eb47-de4f-413d-8453-4791c6d62dfc.info Aug 05 10:26:26 devstack sudo[102096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:26 devstack sudo[102096]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:26 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-834f1968-736e-48f6-a70e-503af48e25a8 tempest-VolumesSnapshotTestJSON-1335946817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f586eb47-de4f-413d-8453-4791c6d62dfc.info" returned: 0 in 0.412s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:26 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-834f1968-736e-48f6-a70e-503af48e25a8 tempest-VolumesSnapshotTestJSON-1335946817 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f586eb47-de4f-413d-8453-4791c6d62dfc.info is being set with open permissions: ugo+rw Aug 05 10:26:26 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-834f1968-736e-48f6-a70e-503af48e25a8 tempest-VolumesSnapshotTestJSON-1335946817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f586eb47-de4f-413d-8453-4791c6d62dfc.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:26 devstack sudo[102099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f586eb47-de4f-413d-8453-4791c6d62dfc.info Aug 05 10:26:26 devstack sudo[102099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:26 devstack sudo[102099]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:26 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-834f1968-736e-48f6-a70e-503af48e25a8 tempest-VolumesSnapshotTestJSON-1335946817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f586eb47-de4f-413d-8453-4791c6d62dfc.info" returned: 0 in 0.281s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:26 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-834f1968-736e-48f6-a70e-503af48e25a8 tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.597s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:26:26 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-834f1968-736e-48f6-a70e-503af48e25a8 tempest-VolumesSnapshotTestJSON-1335946817 None] Create snapshot completed successfully Aug 05 10:26:27 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e2f14513-4d06-4f05-905d-a670764c798f tempest-VolumesSnapshotTestJSON-1335946817 None] Acquiring lock "cinder-15de5d28-3c77-43ac-b114-e0e1d34568ee-delete_snapshot" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:26:27 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e2f14513-4d06-4f05-905d-a670764c798f tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "cinder-15de5d28-3c77-43ac-b114-e0e1d34568ee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:26:27 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e2f14513-4d06-4f05-905d-a670764c798f tempest-VolumesSnapshotTestJSON-1335946817 None] Acquiring lock "cinder-quobyte-f586eb47-de4f-413d-8453-4791c6d62dfc" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:26:27 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e2f14513-4d06-4f05-905d-a670764c798f tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "cinder-quobyte-f586eb47-de4f-413d-8453-4791c6d62dfc" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:26:27 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e2f14513-4d06-4f05-905d-a670764c798f tempest-VolumesSnapshotTestJSON-1335946817 None] Acquiring lock "cinder-quobyte-15de5d28-3c77-43ac-b114-e0e1d34568ee" by "_delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:26:27 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e2f14513-4d06-4f05-905d-a670764c798f tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "cinder-quobyte-15de5d28-3c77-43ac-b114-e0e1d34568ee" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:26:27 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-e2f14513-4d06-4f05-905d-a670764c798f tempest-VolumesSnapshotTestJSON-1335946817 None] Deleting offline snapshot 15de5d28-3c77-43ac-b114-e0e1d34568ee of volume f586eb47-de4f-413d-8453-4791c6d62dfc {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:26:27 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-e2f14513-4d06-4f05-905d-a670764c798f tempest-VolumesSnapshotTestJSON-1335946817 None] snapshot_file for this snap is: volume-f586eb47-de4f-413d-8453-4791c6d62dfc.15de5d28-3c77-43ac-b114-e0e1d34568ee {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:26:27 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc9e90bf-7b62-413e-b39e-f9a028965b6a]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:26:27 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e2f14513-4d06-4f05-905d-a670764c798f tempest-VolumesSnapshotTestJSON-1335946817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f586eb47-de4f-413d-8453-4791c6d62dfc.15de5d28-3c77-43ac-b114-e0e1d34568ee {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:28 devstack sudo[102102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f586eb47-de4f-413d-8453-4791c6d62dfc.15de5d28-3c77-43ac-b114-e0e1d34568ee Aug 05 10:26:28 devstack sudo[102102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:28 devstack sudo[102102]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:28 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e2f14513-4d06-4f05-905d-a670764c798f tempest-VolumesSnapshotTestJSON-1335946817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f586eb47-de4f-413d-8453-4791c6d62dfc.15de5d28-3c77-43ac-b114-e0e1d34568ee" returned: 0 in 0.477s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:28 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-e2f14513-4d06-4f05-905d-a670764c798f tempest-VolumesSnapshotTestJSON-1335946817 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f586eb47-de4f-413d-8453-4791c6d62dfc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88613) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:26:28 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfec1261-374d-4453-91ae-c513a7308861]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:26:28 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e2f14513-4d06-4f05-905d-a670764c798f tempest-VolumesSnapshotTestJSON-1335946817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f586eb47-de4f-413d-8453-4791c6d62dfc {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:28 devstack sudo[102109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f586eb47-de4f-413d-8453-4791c6d62dfc Aug 05 10:26:28 devstack sudo[102109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:28 devstack sudo[102109]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:28 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e2f14513-4d06-4f05-905d-a670764c798f tempest-VolumesSnapshotTestJSON-1335946817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f586eb47-de4f-413d-8453-4791c6d62dfc" returned: 0 in 0.495s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:28 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e2f14513-4d06-4f05-905d-a670764c798f tempest-VolumesSnapshotTestJSON-1335946817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f586eb47-de4f-413d-8453-4791c6d62dfc.15de5d28-3c77-43ac-b114-e0e1d34568ee {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:28 devstack sudo[102114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f586eb47-de4f-413d-8453-4791c6d62dfc.15de5d28-3c77-43ac-b114-e0e1d34568ee Aug 05 10:26:28 devstack sudo[102114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:29 devstack sudo[102114]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:29 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e2f14513-4d06-4f05-905d-a670764c798f tempest-VolumesSnapshotTestJSON-1335946817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f586eb47-de4f-413d-8453-4791c6d62dfc.15de5d28-3c77-43ac-b114-e0e1d34568ee" returned: 0 in 0.400s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:29 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e2f14513-4d06-4f05-905d-a670764c798f tempest-VolumesSnapshotTestJSON-1335946817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f586eb47-de4f-413d-8453-4791c6d62dfc.15de5d28-3c77-43ac-b114-e0e1d34568ee {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:29 devstack sudo[102120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f586eb47-de4f-413d-8453-4791c6d62dfc.15de5d28-3c77-43ac-b114-e0e1d34568ee Aug 05 10:26:29 devstack sudo[102120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:29 devstack sudo[102120]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:29 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e2f14513-4d06-4f05-905d-a670764c798f tempest-VolumesSnapshotTestJSON-1335946817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f586eb47-de4f-413d-8453-4791c6d62dfc.15de5d28-3c77-43ac-b114-e0e1d34568ee" returned: 0 in 0.300s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:29 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e2f14513-4d06-4f05-905d-a670764c798f tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "cinder-quobyte-15de5d28-3c77-43ac-b114-e0e1d34568ee" released by "_delete_snapshot" :: held 1.834s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:26:29 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e2f14513-4d06-4f05-905d-a670764c798f tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "cinder-quobyte-f586eb47-de4f-413d-8453-4791c6d62dfc" released by "delete_snapshot" :: held 1.861s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:26:29 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-e2f14513-4d06-4f05-905d-a670764c798f tempest-VolumesSnapshotTestJSON-1335946817 None] Created reservations ['5f6e5a84-6832-4928-9d0f-c7c8ad30f188', '7b0e36c4-3f32-452b-bc6f-5fac5267b14f', 'fe6b9d79-2201-4c2e-9ec3-d9ddeda1acaf', 'e35089aa-38d7-4ca8-82dd-978fe332918c'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:26:29 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-e2f14513-4d06-4f05-905d-a670764c798f tempest-VolumesSnapshotTestJSON-1335946817 None] Delete snapshot completed successfully. Aug 05 10:26:29 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e2f14513-4d06-4f05-905d-a670764c798f tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "cinder-15de5d28-3c77-43ac-b114-e0e1d34568ee-delete_snapshot" released by "delete_snapshot" :: held 2.095s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:26:30 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd127950-0417-44eb-8e7a-740c97e6a946 tempest-VolumesSnapshotTestJSON-1335946817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:26:30 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-fd127950-0417-44eb-8e7a-740c97e6a946 tempest-VolumesSnapshotTestJSON-1335946817 None] Flow 'volume_create_manager' (cdc34dbd-0755-491e-93f8-f48b9faed457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:26:30 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-fd127950-0417-44eb-8e7a-740c97e6a946 tempest-VolumesSnapshotTestJSON-1335946817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03504b57-bc35-4e6e-8a4f-db5a583e43e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:26:30 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-fd127950-0417-44eb-8e7a-740c97e6a946 tempest-VolumesSnapshotTestJSON-1335946817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03504b57-bc35-4e6e-8a4f-db5a583e43e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:26:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-320930118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=537314d8-2786-43db-a07a-ebf7ada5d0d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffebecfb694848ba97e6f9b082ba06a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:26:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:26:31Z,use_quota=True,user_id='920f46ba702e4f74bbbd3a0291380a58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:26:30 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-fd127950-0417-44eb-8e7a-740c97e6a946 tempest-VolumesSnapshotTestJSON-1335946817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e797cf35-6b63-4c2b-b77f-fc80a37ee919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:26:30 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-fd127950-0417-44eb-8e7a-740c97e6a946 tempest-VolumesSnapshotTestJSON-1335946817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e797cf35-6b63-4c2b-b77f-fc80a37ee919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:26:30 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-fd127950-0417-44eb-8e7a-740c97e6a946 tempest-VolumesSnapshotTestJSON-1335946817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3670b46-a311-4c79-a0bd-54da4b54b573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:26:30 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-fd127950-0417-44eb-8e7a-740c97e6a946 tempest-VolumesSnapshotTestJSON-1335946817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3670b46-a311-4c79-a0bd-54da4b54b573) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '537314d8-2786-43db-a07a-ebf7ada5d0d6', 'volume_name': 'volume-537314d8-2786-43db-a07a-ebf7ada5d0d6', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:26:30 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-fd127950-0417-44eb-8e7a-740c97e6a946 tempest-VolumesSnapshotTestJSON-1335946817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7c6afb9-9ab0-4671-919f-d09854391838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:26:30 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-fd127950-0417-44eb-8e7a-740c97e6a946 tempest-VolumesSnapshotTestJSON-1335946817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7c6afb9-9ab0-4671-919f-d09854391838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:26:30 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-fd127950-0417-44eb-8e7a-740c97e6a946 tempest-VolumesSnapshotTestJSON-1335946817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f762af3-f576-47ed-9c1a-b2a2f93d069e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:26:30 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-fd127950-0417-44eb-8e7a-740c97e6a946 tempest-VolumesSnapshotTestJSON-1335946817 None] Volume 537314d8-2786-43db-a07a-ebf7ada5d0d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-537314d8-2786-43db-a07a-ebf7ada5d0d6', 'volume_size': 1} Aug 05 10:26:30 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-fd127950-0417-44eb-8e7a-740c97e6a946 tempest-VolumesSnapshotTestJSON-1335946817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:26:30 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-fd127950-0417-44eb-8e7a-740c97e6a946 tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:26:30 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-fd127950-0417-44eb-8e7a-740c97e6a946 tempest-VolumesSnapshotTestJSON-1335946817 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:26:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-320930118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=537314d8-2786-43db-a07a-ebf7ada5d0d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffebecfb694848ba97e6f9b082ba06a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:26:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:26:31Z,use_quota=True,user_id='920f46ba702e4f74bbbd3a0291380a58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:26:30 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-fd127950-0417-44eb-8e7a-740c97e6a946 tempest-VolumesSnapshotTestJSON-1335946817 None] Creating volume 537314d8-2786-43db-a07a-ebf7ada5d0d6 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:26:30 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-fd127950-0417-44eb-8e7a-740c97e6a946 tempest-VolumesSnapshotTestJSON-1335946817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:26:30 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-fd127950-0417-44eb-8e7a-740c97e6a946 tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:26:30 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-fd127950-0417-44eb-8e7a-740c97e6a946 tempest-VolumesSnapshotTestJSON-1335946817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:26:30 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-fd127950-0417-44eb-8e7a-740c97e6a946 tempest-VolumesSnapshotTestJSON-1335946817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:26:30 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-fd127950-0417-44eb-8e7a-740c97e6a946 tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:26:30 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-fd127950-0417-44eb-8e7a-740c97e6a946 tempest-VolumesSnapshotTestJSON-1335946817 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:26:30 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-fd127950-0417-44eb-8e7a-740c97e6a946 tempest-VolumesSnapshotTestJSON-1335946817 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:26:30 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-fd127950-0417-44eb-8e7a-740c97e6a946 tempest-VolumesSnapshotTestJSON-1335946817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-537314d8-2786-43db-a07a-ebf7ada5d0d6 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:30 devstack sudo[102123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-537314d8-2786-43db-a07a-ebf7ada5d0d6 1073741824 Aug 05 10:26:30 devstack sudo[102123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:31 devstack sudo[102123]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:31 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-fd127950-0417-44eb-8e7a-740c97e6a946 tempest-VolumesSnapshotTestJSON-1335946817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-537314d8-2786-43db-a07a-ebf7ada5d0d6 1073741824" returned: 0 in 0.636s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:31 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-fd127950-0417-44eb-8e7a-740c97e6a946 tempest-VolumesSnapshotTestJSON-1335946817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-537314d8-2786-43db-a07a-ebf7ada5d0d6 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:31 devstack sudo[102129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-537314d8-2786-43db-a07a-ebf7ada5d0d6 Aug 05 10:26:31 devstack sudo[102129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:31 devstack sudo[102129]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:31 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-fd127950-0417-44eb-8e7a-740c97e6a946 tempest-VolumesSnapshotTestJSON-1335946817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-537314d8-2786-43db-a07a-ebf7ada5d0d6" returned: 0 in 0.348s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:31 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-fd127950-0417-44eb-8e7a-740c97e6a946 tempest-VolumesSnapshotTestJSON-1335946817 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:26:31 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-fd127950-0417-44eb-8e7a-740c97e6a946 tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:26:31 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-fd127950-0417-44eb-8e7a-740c97e6a946 tempest-VolumesSnapshotTestJSON-1335946817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f762af3-f576-47ed-9c1a-b2a2f93d069e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-537314d8-2786-43db-a07a-ebf7ada5d0d6', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:26:31 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-fd127950-0417-44eb-8e7a-740c97e6a946 tempest-VolumesSnapshotTestJSON-1335946817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c481935c-2842-4f74-91cb-d8dc54177584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:26:31 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-fd127950-0417-44eb-8e7a-740c97e6a946 tempest-VolumesSnapshotTestJSON-1335946817 None] Volume volume-537314d8-2786-43db-a07a-ebf7ada5d0d6 (537314d8-2786-43db-a07a-ebf7ada5d0d6): created successfully Aug 05 10:26:31 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-fd127950-0417-44eb-8e7a-740c97e6a946 tempest-VolumesSnapshotTestJSON-1335946817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c481935c-2842-4f74-91cb-d8dc54177584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:26:31 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-fd127950-0417-44eb-8e7a-740c97e6a946 tempest-VolumesSnapshotTestJSON-1335946817 None] Flow 'volume_create_manager' (cdc34dbd-0755-491e-93f8-f48b9faed457) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:26:31 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-fd127950-0417-44eb-8e7a-740c97e6a946 tempest-VolumesSnapshotTestJSON-1335946817 None] Created volume successfully. Aug 05 10:26:32 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-36dcdf32-9817-4ad5-bb2f-92f410d0cbb1 tempest-VolumesSnapshotTestJSON-1335946817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:26:32 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-36dcdf32-9817-4ad5-bb2f-92f410d0cbb1 tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:26:32 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-36dcdf32-9817-4ad5-bb2f-92f410d0cbb1 tempest-VolumesSnapshotTestJSON-1335946817 None] Creating offline snapshot c7b72eb3-4c15-4421-a8cc-8726ca9c38e4 of volume 537314d8-2786-43db-a07a-ebf7ada5d0d6 {{(pid=88613) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:26:32 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f3bd07-ca75-4d93-8277-da71b354ba28]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:26:32 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-36dcdf32-9817-4ad5-bb2f-92f410d0cbb1 tempest-VolumesSnapshotTestJSON-1335946817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-537314d8-2786-43db-a07a-ebf7ada5d0d6 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:33 devstack sudo[102132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-537314d8-2786-43db-a07a-ebf7ada5d0d6 Aug 05 10:26:33 devstack sudo[102132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:33 devstack sudo[102132]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:33 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-36dcdf32-9817-4ad5-bb2f-92f410d0cbb1 tempest-VolumesSnapshotTestJSON-1335946817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-537314d8-2786-43db-a07a-ebf7ada5d0d6" returned: 0 in 0.492s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:33 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-36dcdf32-9817-4ad5-bb2f-92f410d0cbb1 tempest-VolumesSnapshotTestJSON-1335946817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-537314d8-2786-43db-a07a-ebf7ada5d0d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-537314d8-2786-43db-a07a-ebf7ada5d0d6.c7b72eb3-4c15-4421-a8cc-8726ca9c38e4 1G {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:33 devstack sudo[102137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-537314d8-2786-43db-a07a-ebf7ada5d0d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-537314d8-2786-43db-a07a-ebf7ada5d0d6.c7b72eb3-4c15-4421-a8cc-8726ca9c38e4 1G Aug 05 10:26:33 devstack sudo[102137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:33 devstack sudo[102137]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:33 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-36dcdf32-9817-4ad5-bb2f-92f410d0cbb1 tempest-VolumesSnapshotTestJSON-1335946817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-537314d8-2786-43db-a07a-ebf7ada5d0d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-537314d8-2786-43db-a07a-ebf7ada5d0d6.c7b72eb3-4c15-4421-a8cc-8726ca9c38e4 1G" returned: 0 in 0.511s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:33 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-36dcdf32-9817-4ad5-bb2f-92f410d0cbb1 tempest-VolumesSnapshotTestJSON-1335946817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-537314d8-2786-43db-a07a-ebf7ada5d0d6 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-537314d8-2786-43db-a07a-ebf7ada5d0d6.c7b72eb3-4c15-4421-a8cc-8726ca9c38e4 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:33 devstack sudo[102143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-537314d8-2786-43db-a07a-ebf7ada5d0d6 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-537314d8-2786-43db-a07a-ebf7ada5d0d6.c7b72eb3-4c15-4421-a8cc-8726ca9c38e4 Aug 05 10:26:33 devstack sudo[102143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:34 devstack sudo[102143]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:34 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-36dcdf32-9817-4ad5-bb2f-92f410d0cbb1 tempest-VolumesSnapshotTestJSON-1335946817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-537314d8-2786-43db-a07a-ebf7ada5d0d6 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-537314d8-2786-43db-a07a-ebf7ada5d0d6.c7b72eb3-4c15-4421-a8cc-8726ca9c38e4" returned: 0 in 0.392s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:34 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-36dcdf32-9817-4ad5-bb2f-92f410d0cbb1 tempest-VolumesSnapshotTestJSON-1335946817 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-537314d8-2786-43db-a07a-ebf7ada5d0d6.c7b72eb3-4c15-4421-a8cc-8726ca9c38e4 is being set with open permissions: ugo+rw Aug 05 10:26:34 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-36dcdf32-9817-4ad5-bb2f-92f410d0cbb1 tempest-VolumesSnapshotTestJSON-1335946817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-537314d8-2786-43db-a07a-ebf7ada5d0d6.c7b72eb3-4c15-4421-a8cc-8726ca9c38e4 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:34 devstack sudo[102149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-537314d8-2786-43db-a07a-ebf7ada5d0d6.c7b72eb3-4c15-4421-a8cc-8726ca9c38e4 Aug 05 10:26:34 devstack sudo[102149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:34 devstack sudo[102149]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:34 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-36dcdf32-9817-4ad5-bb2f-92f410d0cbb1 tempest-VolumesSnapshotTestJSON-1335946817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-537314d8-2786-43db-a07a-ebf7ada5d0d6.c7b72eb3-4c15-4421-a8cc-8726ca9c38e4" returned: 0 in 0.295s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:34 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-36dcdf32-9817-4ad5-bb2f-92f410d0cbb1 tempest-VolumesSnapshotTestJSON-1335946817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-537314d8-2786-43db-a07a-ebf7ada5d0d6.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:34 devstack sudo[102153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-537314d8-2786-43db-a07a-ebf7ada5d0d6.info Aug 05 10:26:34 devstack sudo[102153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:35 devstack sudo[102153]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:35 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-36dcdf32-9817-4ad5-bb2f-92f410d0cbb1 tempest-VolumesSnapshotTestJSON-1335946817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-537314d8-2786-43db-a07a-ebf7ada5d0d6.info" returned: 0 in 0.329s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:35 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-36dcdf32-9817-4ad5-bb2f-92f410d0cbb1 tempest-VolumesSnapshotTestJSON-1335946817 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-537314d8-2786-43db-a07a-ebf7ada5d0d6.info is being set with open permissions: ugo+rw Aug 05 10:26:35 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-36dcdf32-9817-4ad5-bb2f-92f410d0cbb1 tempest-VolumesSnapshotTestJSON-1335946817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-537314d8-2786-43db-a07a-ebf7ada5d0d6.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:35 devstack sudo[102156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-537314d8-2786-43db-a07a-ebf7ada5d0d6.info Aug 05 10:26:35 devstack sudo[102156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:35 devstack sudo[102156]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:35 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-36dcdf32-9817-4ad5-bb2f-92f410d0cbb1 tempest-VolumesSnapshotTestJSON-1335946817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-537314d8-2786-43db-a07a-ebf7ada5d0d6.info" returned: 0 in 0.281s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:35 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-36dcdf32-9817-4ad5-bb2f-92f410d0cbb1 tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.424s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:26:35 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-36dcdf32-9817-4ad5-bb2f-92f410d0cbb1 tempest-VolumesSnapshotTestJSON-1335946817 None] Create snapshot completed successfully Aug 05 10:26:36 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-d48e9fa2-87be-485d-96ea-0672655fda18 tempest-VolumesSnapshotTestJSON-1335946817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:26:36 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d48e9fa2-87be-485d-96ea-0672655fda18 tempest-VolumesSnapshotTestJSON-1335946817 None] Flow 'volume_create_manager' (4bf08a88-9b65-4bfb-ab3c-75a482d67002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:26:36 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d48e9fa2-87be-485d-96ea-0672655fda18 tempest-VolumesSnapshotTestJSON-1335946817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f9edb2a-d81c-4c08-9396-01a0b780ce8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:26:36 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d48e9fa2-87be-485d-96ea-0672655fda18 tempest-VolumesSnapshotTestJSON-1335946817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f9edb2a-d81c-4c08-9396-01a0b780ce8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:26:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1957292736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5f9b295-327f-4729-aa11-ddce443d787c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffebecfb694848ba97e6f9b082ba06a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:26:37Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=c7b72eb3-4c15-4421-a8cc-8726ca9c38e4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:26:37Z,use_quota=True,user_id='920f46ba702e4f74bbbd3a0291380a58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:26:36 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d48e9fa2-87be-485d-96ea-0672655fda18 tempest-VolumesSnapshotTestJSON-1335946817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6017cf4-4a96-4e2e-8cdb-c3129b968baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:26:36 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d48e9fa2-87be-485d-96ea-0672655fda18 tempest-VolumesSnapshotTestJSON-1335946817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6017cf4-4a96-4e2e-8cdb-c3129b968baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:26:36 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d48e9fa2-87be-485d-96ea-0672655fda18 tempest-VolumesSnapshotTestJSON-1335946817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56f99030-c037-4613-8683-d6f23f1e4d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:26:36 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d48e9fa2-87be-485d-96ea-0672655fda18 tempest-VolumesSnapshotTestJSON-1335946817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56f99030-c037-4613-8683-d6f23f1e4d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a5f9b295-327f-4729-aa11-ddce443d787c', 'volume_name': 'volume-a5f9b295-327f-4729-aa11-ddce443d787c', 'volume_size': 2, 'snapshot_id': 'c7b72eb3-4c15-4421-a8cc-8726ca9c38e4'}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:26:36 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d48e9fa2-87be-485d-96ea-0672655fda18 tempest-VolumesSnapshotTestJSON-1335946817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e21e382-854f-4a4c-b3e8-ffc09cfe52fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:26:36 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d48e9fa2-87be-485d-96ea-0672655fda18 tempest-VolumesSnapshotTestJSON-1335946817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e21e382-854f-4a4c-b3e8-ffc09cfe52fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:26:36 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d48e9fa2-87be-485d-96ea-0672655fda18 tempest-VolumesSnapshotTestJSON-1335946817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8728813e-ea8e-4572-bd09-6a0b63c6d41a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:26:36 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-d48e9fa2-87be-485d-96ea-0672655fda18 tempest-VolumesSnapshotTestJSON-1335946817 None] Volume a5f9b295-327f-4729-aa11-ddce443d787c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a5f9b295-327f-4729-aa11-ddce443d787c', 'volume_size': 2, 'snapshot_id': 'c7b72eb3-4c15-4421-a8cc-8726ca9c38e4'} Aug 05 10:26:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-d48e9fa2-87be-485d-96ea-0672655fda18 tempest-VolumesSnapshotTestJSON-1335946817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:26:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-d48e9fa2-87be-485d-96ea-0672655fda18 tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:26:37 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d48e9fa2-87be-485d-96ea-0672655fda18 tempest-VolumesSnapshotTestJSON-1335946817 None] Acquiring lock "cinder-quobyte-c7b72eb3-4c15-4421-a8cc-8726ca9c38e4-a5f9b295-327f-4729-aa11-ddce443d787c" by "_create_volume_from_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:26:37 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d48e9fa2-87be-485d-96ea-0672655fda18 tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "cinder-quobyte-c7b72eb3-4c15-4421-a8cc-8726ca9c38e4-a5f9b295-327f-4729-aa11-ddce443d787c" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:26:37 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-d48e9fa2-87be-485d-96ea-0672655fda18 tempest-VolumesSnapshotTestJSON-1335946817 None] Creating volume a5f9b295-327f-4729-aa11-ddce443d787c from snapshot c7b72eb3-4c15-4421-a8cc-8726ca9c38e4 {{(pid=88613) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 05 10:26:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-d48e9fa2-87be-485d-96ea-0672655fda18 tempest-VolumesSnapshotTestJSON-1335946817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:26:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-d48e9fa2-87be-485d-96ea-0672655fda18 tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:26:37 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-d48e9fa2-87be-485d-96ea-0672655fda18 tempest-VolumesSnapshotTestJSON-1335946817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:26:37 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-d48e9fa2-87be-485d-96ea-0672655fda18 tempest-VolumesSnapshotTestJSON-1335946817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:26:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-d48e9fa2-87be-485d-96ea-0672655fda18 tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:26:37 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-d48e9fa2-87be-485d-96ea-0672655fda18 tempest-VolumesSnapshotTestJSON-1335946817 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:26:37 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d48e9fa2-87be-485d-96ea-0672655fda18 tempest-VolumesSnapshotTestJSON-1335946817 None] Acquiring lock "cinder-quobyte-a5f9b295-327f-4729-aa11-ddce443d787c" by "_copy_volume_from_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:26:37 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d48e9fa2-87be-485d-96ea-0672655fda18 tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "cinder-quobyte-a5f9b295-327f-4729-aa11-ddce443d787c" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:26:37 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-d48e9fa2-87be-485d-96ea-0672655fda18 tempest-VolumesSnapshotTestJSON-1335946817 None] snapshot: c7b72eb3-4c15-4421-a8cc-8726ca9c38e4, volume: a5f9b295-327f-4729-aa11-ddce443d787c, {{(pid=88613) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 05 10:26:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-d48e9fa2-87be-485d-96ea-0672655fda18 tempest-VolumesSnapshotTestJSON-1335946817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:26:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-d48e9fa2-87be-485d-96ea-0672655fda18 tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:26:37 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-d48e9fa2-87be-485d-96ea-0672655fda18 tempest-VolumesSnapshotTestJSON-1335946817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:26:37 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-d48e9fa2-87be-485d-96ea-0672655fda18 tempest-VolumesSnapshotTestJSON-1335946817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:26:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-d48e9fa2-87be-485d-96ea-0672655fda18 tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:26:37 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[048671fc-1306-43d2-89e4-af66ed1f65ce]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:26:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d48e9fa2-87be-485d-96ea-0672655fda18 tempest-VolumesSnapshotTestJSON-1335946817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-537314d8-2786-43db-a07a-ebf7ada5d0d6.c7b72eb3-4c15-4421-a8cc-8726ca9c38e4 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:37 devstack sudo[102163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-537314d8-2786-43db-a07a-ebf7ada5d0d6.c7b72eb3-4c15-4421-a8cc-8726ca9c38e4 Aug 05 10:26:37 devstack sudo[102163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:37 devstack sudo[102163]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d48e9fa2-87be-485d-96ea-0672655fda18 tempest-VolumesSnapshotTestJSON-1335946817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-537314d8-2786-43db-a07a-ebf7ada5d0d6.c7b72eb3-4c15-4421-a8cc-8726ca9c38e4" returned: 0 in 0.567s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:37 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-d48e9fa2-87be-485d-96ea-0672655fda18 tempest-VolumesSnapshotTestJSON-1335946817 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-537314d8-2786-43db-a07a-ebf7ada5d0d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88613) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:26:37 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[265bfcea-77b1-44ea-a8f8-740fbcb57776]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:26:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d48e9fa2-87be-485d-96ea-0672655fda18 tempest-VolumesSnapshotTestJSON-1335946817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-537314d8-2786-43db-a07a-ebf7ada5d0d6 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:37 devstack sudo[102169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-537314d8-2786-43db-a07a-ebf7ada5d0d6 Aug 05 10:26:37 devstack sudo[102169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:38 devstack sudo[102169]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:38 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d48e9fa2-87be-485d-96ea-0672655fda18 tempest-VolumesSnapshotTestJSON-1335946817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-537314d8-2786-43db-a07a-ebf7ada5d0d6" returned: 0 in 0.487s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:38 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-d48e9fa2-87be-485d-96ea-0672655fda18 tempest-VolumesSnapshotTestJSON-1335946817 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-537314d8-2786-43db-a07a-ebf7ada5d0d6 {{(pid=88613) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 05 10:26:38 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-d48e9fa2-87be-485d-96ea-0672655fda18 tempest-VolumesSnapshotTestJSON-1335946817 None] Creating direct copy from snapshot {{(pid=88613) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 05 10:26:38 devstack cinder-volume[88613]: DEBUG cinder.utils [None req-d48e9fa2-87be-485d-96ea-0672655fda18 tempest-VolumesSnapshotTestJSON-1335946817 None] Path /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a5f9b295-327f-4729-aa11-ddce443d787c not found in is_blk_device check {{(pid=88613) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 05 10:26:38 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d48e9fa2-87be-485d-96ea-0672655fda18 tempest-VolumesSnapshotTestJSON-1335946817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-537314d8-2786-43db-a07a-ebf7ada5d0d6 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a5f9b295-327f-4729-aa11-ddce443d787c {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:38 devstack sudo[102174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-537314d8-2786-43db-a07a-ebf7ada5d0d6 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a5f9b295-327f-4729-aa11-ddce443d787c Aug 05 10:26:38 devstack sudo[102174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:44 devstack sudo[102174]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d48e9fa2-87be-485d-96ea-0672655fda18 tempest-VolumesSnapshotTestJSON-1335946817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-537314d8-2786-43db-a07a-ebf7ada5d0d6 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a5f9b295-327f-4729-aa11-ddce443d787c" returned: 0 in 5.814s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:44 devstack cinder-volume[88613]: DEBUG cinder.image.image_utils [None req-d48e9fa2-87be-485d-96ea-0672655fda18 tempest-VolumesSnapshotTestJSON-1335946817 None] Image conversion details: src /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-537314d8-2786-43db-a07a-ebf7ada5d0d6, size 1024.00 MB, duration 5.81 sec, destination /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a5f9b295-327f-4729-aa11-ddce443d787c {{(pid=88613) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 10:26:44 devstack cinder-volume[88613]: INFO cinder.image.image_utils [None req-d48e9fa2-87be-485d-96ea-0672655fda18 tempest-VolumesSnapshotTestJSON-1335946817 None] Converted 1024.00 MB image at 176.10 MB/s Aug 05 10:26:44 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-d48e9fa2-87be-485d-96ea-0672655fda18 tempest-VolumesSnapshotTestJSON-1335946817 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a5f9b295-327f-4729-aa11-ddce443d787c is being set with open permissions: ugo+rw Aug 05 10:26:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d48e9fa2-87be-485d-96ea-0672655fda18 tempest-VolumesSnapshotTestJSON-1335946817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a5f9b295-327f-4729-aa11-ddce443d787c {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:44 devstack sudo[102187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a5f9b295-327f-4729-aa11-ddce443d787c Aug 05 10:26:44 devstack sudo[102187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:44 devstack sudo[102187]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d48e9fa2-87be-485d-96ea-0672655fda18 tempest-VolumesSnapshotTestJSON-1335946817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a5f9b295-327f-4729-aa11-ddce443d787c" returned: 0 in 0.299s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:44 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d48e9fa2-87be-485d-96ea-0672655fda18 tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "cinder-quobyte-a5f9b295-327f-4729-aa11-ddce443d787c" released by "_copy_volume_from_snapshot" :: held 7.319s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:26:44 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d48e9fa2-87be-485d-96ea-0672655fda18 tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "cinder-quobyte-c7b72eb3-4c15-4421-a8cc-8726ca9c38e4-a5f9b295-327f-4729-aa11-ddce443d787c" released by "_create_volume_from_snapshot" :: held 7.426s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:26:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-d48e9fa2-87be-485d-96ea-0672655fda18 tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.447s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:26:44 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d48e9fa2-87be-485d-96ea-0672655fda18 tempest-VolumesSnapshotTestJSON-1335946817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8728813e-ea8e-4572-bd09-6a0b63c6d41a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5f9b295-327f-4729-aa11-ddce443d787c', 'volume_size': 2, 'snapshot_id': 'c7b72eb3-4c15-4421-a8cc-8726ca9c38e4'}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:26:44 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d48e9fa2-87be-485d-96ea-0672655fda18 tempest-VolumesSnapshotTestJSON-1335946817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f421b88c-8885-4ca4-ad02-a2cb8ae1f4d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:26:44 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-d48e9fa2-87be-485d-96ea-0672655fda18 tempest-VolumesSnapshotTestJSON-1335946817 None] Volume volume-a5f9b295-327f-4729-aa11-ddce443d787c (a5f9b295-327f-4729-aa11-ddce443d787c): created successfully Aug 05 10:26:44 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d48e9fa2-87be-485d-96ea-0672655fda18 tempest-VolumesSnapshotTestJSON-1335946817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f421b88c-8885-4ca4-ad02-a2cb8ae1f4d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:26:44 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d48e9fa2-87be-485d-96ea-0672655fda18 tempest-VolumesSnapshotTestJSON-1335946817 None] Flow 'volume_create_manager' (4bf08a88-9b65-4bfb-ab3c-75a482d67002) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:26:44 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-d48e9fa2-87be-485d-96ea-0672655fda18 tempest-VolumesSnapshotTestJSON-1335946817 None] Created volume successfully. Aug 05 10:26:44 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-470444a0-156c-4eb5-920a-9b79ab776852 tempest-VolumesSnapshotTestJSON-1335946817 None] Acquiring lock "cinder-a5f9b295-327f-4729-aa11-ddce443d787c-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:26:44 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-470444a0-156c-4eb5-920a-9b79ab776852 tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "cinder-a5f9b295-327f-4729-aa11-ddce443d787c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:26:45 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-470444a0-156c-4eb5-920a-9b79ab776852 tempest-VolumesSnapshotTestJSON-1335946817 None] Acquiring lock "cinder-quobyte-a5f9b295-327f-4729-aa11-ddce443d787c" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:26:45 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-470444a0-156c-4eb5-920a-9b79ab776852 tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "cinder-quobyte-a5f9b295-327f-4729-aa11-ddce443d787c" acquired by "delete_volume" :: waited 0.021s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:26:45 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd50f15-ae81-4f61-aedb-f9d974f8ac49]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:26:45 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-470444a0-156c-4eb5-920a-9b79ab776852 tempest-VolumesSnapshotTestJSON-1335946817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a5f9b295-327f-4729-aa11-ddce443d787c {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:45 devstack sudo[102191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a5f9b295-327f-4729-aa11-ddce443d787c Aug 05 10:26:45 devstack sudo[102191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:45 devstack sudo[102191]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:45 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-470444a0-156c-4eb5-920a-9b79ab776852 tempest-VolumesSnapshotTestJSON-1335946817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a5f9b295-327f-4729-aa11-ddce443d787c" returned: 0 in 0.483s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:45 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-470444a0-156c-4eb5-920a-9b79ab776852 tempest-VolumesSnapshotTestJSON-1335946817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a5f9b295-327f-4729-aa11-ddce443d787c {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:45 devstack sudo[102196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a5f9b295-327f-4729-aa11-ddce443d787c Aug 05 10:26:45 devstack sudo[102196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:45 devstack sudo[102196]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:45 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-470444a0-156c-4eb5-920a-9b79ab776852 tempest-VolumesSnapshotTestJSON-1335946817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a5f9b295-327f-4729-aa11-ddce443d787c" returned: 0 in 0.275s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:45 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-470444a0-156c-4eb5-920a-9b79ab776852 tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "cinder-quobyte-a5f9b295-327f-4729-aa11-ddce443d787c" released by "delete_volume" :: held 0.816s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:26:45 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-470444a0-156c-4eb5-920a-9b79ab776852 tempest-VolumesSnapshotTestJSON-1335946817 None] Created reservations ['9baac07d-e102-4ed0-8eba-e3ae37eae7c0', '088d5bea-ba11-4a94-a068-bfc77d6f4a1f', '25b27855-b764-4c25-aefc-77957f54f63f', '48e4621d-804b-4c5a-93a9-e6b7284a046e'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:26:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-470444a0-156c-4eb5-920a-9b79ab776852 tempest-VolumesSnapshotTestJSON-1335946817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:26:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-470444a0-156c-4eb5-920a-9b79ab776852 tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:26:46 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-470444a0-156c-4eb5-920a-9b79ab776852 tempest-VolumesSnapshotTestJSON-1335946817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:26:46 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-470444a0-156c-4eb5-920a-9b79ab776852 tempest-VolumesSnapshotTestJSON-1335946817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:26:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-470444a0-156c-4eb5-920a-9b79ab776852 tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:26:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-470444a0-156c-4eb5-920a-9b79ab776852 tempest-VolumesSnapshotTestJSON-1335946817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:46 devstack sudo[102199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:26:46 devstack sudo[102199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:46 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-3660997d-0521-4852-b77e-171c1212468a tempest-VolumesSnapshotTestJSON-1335946817 None] Acquiring lock "cinder-c7b72eb3-4c15-4421-a8cc-8726ca9c38e4-delete_snapshot" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:26:46 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-3660997d-0521-4852-b77e-171c1212468a tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "cinder-c7b72eb3-4c15-4421-a8cc-8726ca9c38e4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:26:46 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-3660997d-0521-4852-b77e-171c1212468a tempest-VolumesSnapshotTestJSON-1335946817 None] Acquiring lock "cinder-quobyte-537314d8-2786-43db-a07a-ebf7ada5d0d6" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:26:46 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-3660997d-0521-4852-b77e-171c1212468a tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "cinder-quobyte-537314d8-2786-43db-a07a-ebf7ada5d0d6" acquired by "delete_snapshot" :: waited 0.034s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:26:46 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-3660997d-0521-4852-b77e-171c1212468a tempest-VolumesSnapshotTestJSON-1335946817 None] Acquiring lock "cinder-quobyte-c7b72eb3-4c15-4421-a8cc-8726ca9c38e4" by "_delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:26:46 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-3660997d-0521-4852-b77e-171c1212468a tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "cinder-quobyte-c7b72eb3-4c15-4421-a8cc-8726ca9c38e4" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:26:46 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-3660997d-0521-4852-b77e-171c1212468a tempest-VolumesSnapshotTestJSON-1335946817 None] Deleting offline snapshot c7b72eb3-4c15-4421-a8cc-8726ca9c38e4 of volume 537314d8-2786-43db-a07a-ebf7ada5d0d6 {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:26:46 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-3660997d-0521-4852-b77e-171c1212468a tempest-VolumesSnapshotTestJSON-1335946817 None] snapshot_file for this snap is: volume-537314d8-2786-43db-a07a-ebf7ada5d0d6.c7b72eb3-4c15-4421-a8cc-8726ca9c38e4 {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:26:46 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e04a57-93db-4d5c-b5fa-015126079a29]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:26:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3660997d-0521-4852-b77e-171c1212468a tempest-VolumesSnapshotTestJSON-1335946817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-537314d8-2786-43db-a07a-ebf7ada5d0d6.c7b72eb3-4c15-4421-a8cc-8726ca9c38e4 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:46 devstack sudo[102199]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-470444a0-156c-4eb5-920a-9b79ab776852 tempest-VolumesSnapshotTestJSON-1335946817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.371s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:46 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-470444a0-156c-4eb5-920a-9b79ab776852 tempest-VolumesSnapshotTestJSON-1335946817 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:26:46 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-470444a0-156c-4eb5-920a-9b79ab776852 tempest-VolumesSnapshotTestJSON-1335946817 None] Deleted volume successfully. Aug 05 10:26:46 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-470444a0-156c-4eb5-920a-9b79ab776852 tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "cinder-a5f9b295-327f-4729-aa11-ddce443d787c-delete_volume" released by "delete_volume" :: held 1.513s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:26:46 devstack sudo[102202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-537314d8-2786-43db-a07a-ebf7ada5d0d6.c7b72eb3-4c15-4421-a8cc-8726ca9c38e4 Aug 05 10:26:46 devstack sudo[102202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:46 devstack sudo[102202]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3660997d-0521-4852-b77e-171c1212468a tempest-VolumesSnapshotTestJSON-1335946817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-537314d8-2786-43db-a07a-ebf7ada5d0d6.c7b72eb3-4c15-4421-a8cc-8726ca9c38e4" returned: 0 in 0.530s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:46 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-3660997d-0521-4852-b77e-171c1212468a tempest-VolumesSnapshotTestJSON-1335946817 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-537314d8-2786-43db-a07a-ebf7ada5d0d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88613) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:26:46 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b7b8ed9-ae60-41e0-b326-8db512126b34]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:26:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3660997d-0521-4852-b77e-171c1212468a tempest-VolumesSnapshotTestJSON-1335946817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-537314d8-2786-43db-a07a-ebf7ada5d0d6 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:47 devstack sudo[102208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-537314d8-2786-43db-a07a-ebf7ada5d0d6 Aug 05 10:26:47 devstack sudo[102208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:47 devstack sudo[102208]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:47 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3660997d-0521-4852-b77e-171c1212468a tempest-VolumesSnapshotTestJSON-1335946817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-537314d8-2786-43db-a07a-ebf7ada5d0d6" returned: 0 in 0.753s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:47 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3660997d-0521-4852-b77e-171c1212468a tempest-VolumesSnapshotTestJSON-1335946817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-537314d8-2786-43db-a07a-ebf7ada5d0d6.c7b72eb3-4c15-4421-a8cc-8726ca9c38e4 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:47 devstack sudo[102213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-537314d8-2786-43db-a07a-ebf7ada5d0d6.c7b72eb3-4c15-4421-a8cc-8726ca9c38e4 Aug 05 10:26:47 devstack sudo[102213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:47 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-6836b918-a4fe-4ff5-9323-2d682b300b18 tempest-TestShelveInstance-935146468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:26:47 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-6836b918-a4fe-4ff5-9323-2d682b300b18 tempest-TestShelveInstance-935146468 None] Flow 'volume_create_manager' (5f75b078-7dbb-410e-819e-251f61dd667c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:26:47 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-6836b918-a4fe-4ff5-9323-2d682b300b18 tempest-TestShelveInstance-935146468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0e2528c-f6cf-475f-8fa6-0caa31513c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:26:47 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-6836b918-a4fe-4ff5-9323-2d682b300b18 tempest-TestShelveInstance-935146468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0e2528c-f6cf-475f-8fa6-0caa31513c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:26:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-397524476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fe47a64-a0d9-4e29-92ca-7b581432d637,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4abb630226248a5a4234cff8714359d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:26:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:26:48Z,use_quota=True,user_id='ef4163672cdb4bbcad8d653c443f6805',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:26:47 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-6836b918-a4fe-4ff5-9323-2d682b300b18 tempest-TestShelveInstance-935146468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34f05bcc-8b33-4cc1-b2e8-29dff300f009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:26:47 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-6836b918-a4fe-4ff5-9323-2d682b300b18 tempest-TestShelveInstance-935146468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34f05bcc-8b33-4cc1-b2e8-29dff300f009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:26:47 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-6836b918-a4fe-4ff5-9323-2d682b300b18 tempest-TestShelveInstance-935146468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f63b50c9-789e-4964-84f8-67f50c8a9ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:26:47 devstack cinder-volume[88613]: DEBUG cinder.image.glance [None req-6836b918-a4fe-4ff5-9323-2d682b300b18 tempest-TestShelveInstance-935146468 None] Creating Keystone auth plugin from conf {{(pid=88613) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 05 10:26:48 devstack sudo[102213]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:48 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3660997d-0521-4852-b77e-171c1212468a tempest-VolumesSnapshotTestJSON-1335946817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-537314d8-2786-43db-a07a-ebf7ada5d0d6.c7b72eb3-4c15-4421-a8cc-8726ca9c38e4" returned: 0 in 0.425s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:48 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3660997d-0521-4852-b77e-171c1212468a tempest-VolumesSnapshotTestJSON-1335946817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-537314d8-2786-43db-a07a-ebf7ada5d0d6.c7b72eb3-4c15-4421-a8cc-8726ca9c38e4 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:48 devstack sudo[102218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-537314d8-2786-43db-a07a-ebf7ada5d0d6.c7b72eb3-4c15-4421-a8cc-8726ca9c38e4 Aug 05 10:26:48 devstack sudo[102218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:48 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-6836b918-a4fe-4ff5-9323-2d682b300b18 tempest-TestShelveInstance-935146468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f63b50c9-789e-4964-84f8-67f50c8a9ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6fe47a64-a0d9-4e29-92ca-7b581432d637', 'volume_name': 'volume-6fe47a64-a0d9-4e29-92ca-7b581432d637', 'volume_size': 1, 'image_id': '89278436-b56f-45f7-8c42-c9afd7bd7453', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/89278436-b56f-45f7-8c42-c9afd7bd7453', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '654c7af809d145caaadc8738d3dc3df2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '89278436-b56f-45f7-8c42-c9afd7bd7453', 'created_at': datetime.datetime(2026, 8, 5, 8, 7, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 8, 7, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/89278436-b56f-45f7-8c42-c9afd7bd7453/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:26:48 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-6836b918-a4fe-4ff5-9323-2d682b300b18 tempest-TestShelveInstance-935146468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a689004-3976-4163-a19e-b518cf27463c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:26:48 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-6836b918-a4fe-4ff5-9323-2d682b300b18 tempest-TestShelveInstance-935146468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a689004-3976-4163-a19e-b518cf27463c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:26:48 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-6836b918-a4fe-4ff5-9323-2d682b300b18 tempest-TestShelveInstance-935146468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81057596-98ac-4076-afdf-471ec6a6ecbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:26:48 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-6836b918-a4fe-4ff5-9323-2d682b300b18 tempest-TestShelveInstance-935146468 None] Volume 6fe47a64-a0d9-4e29-92ca-7b581432d637: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6fe47a64-a0d9-4e29-92ca-7b581432d637', 'volume_size': 1, 'image_id': '89278436-b56f-45f7-8c42-c9afd7bd7453', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/89278436-b56f-45f7-8c42-c9afd7bd7453', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '654c7af809d145caaadc8738d3dc3df2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '89278436-b56f-45f7-8c42-c9afd7bd7453', 'created_at': datetime.datetime(2026, 8, 5, 8, 7, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 8, 7, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/89278436-b56f-45f7-8c42-c9afd7bd7453/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 05 10:26:48 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-6836b918-a4fe-4ff5-9323-2d682b300b18 tempest-TestShelveInstance-935146468 None] Trying to clone 6fe47a64-a0d9-4e29-92ca-7b581432d637 from image 89278436-b56f-45f7-8c42-c9afd7bd7453 at location (None, [{'url': 'file:///opt/stack/data/glance/images/89278436-b56f-45f7-8c42-c9afd7bd7453', 'metadata': {}}]). {{(pid=88613) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 05 10:26:48 devstack sudo[102218]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:48 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3660997d-0521-4852-b77e-171c1212468a tempest-VolumesSnapshotTestJSON-1335946817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-537314d8-2786-43db-a07a-ebf7ada5d0d6.c7b72eb3-4c15-4421-a8cc-8726ca9c38e4" returned: 0 in 0.302s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:48 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-3660997d-0521-4852-b77e-171c1212468a tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "cinder-quobyte-c7b72eb3-4c15-4421-a8cc-8726ca9c38e4" released by "_delete_snapshot" :: held 2.173s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:26:48 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-3660997d-0521-4852-b77e-171c1212468a tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "cinder-quobyte-537314d8-2786-43db-a07a-ebf7ada5d0d6" released by "delete_snapshot" :: held 2.226s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:26:48 devstack cinder-volume[88613]: DEBUG cinder.image.image_utils [None req-6836b918-a4fe-4ff5-9323-2d682b300b18 tempest-TestShelveInstance-935146468 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_89278436-b56f-45f7-8c42-c9afd7bd7453_vgz2258ndevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88613) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 05 10:26:48 devstack cinder-volume[88613]: INFO cinder.image.image_utils [None req-6836b918-a4fe-4ff5-9323-2d682b300b18 tempest-TestShelveInstance-935146468 None] Image download 20.69 MB at 20.69 MB/s Aug 05 10:26:48 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-3660997d-0521-4852-b77e-171c1212468a tempest-VolumesSnapshotTestJSON-1335946817 None] Created reservations ['b3a3057e-e7af-49ee-939f-1bb31bc27ddd', '1690a7ed-b3ce-4a95-aec4-db09e0dee253', 'fd8da145-cb8d-44a8-aa30-ea679a57caa1', '5375e801-9051-48c2-b6d8-231d0dec0e11'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:26:48 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d81bda-5ccc-464c-8c15-6d90012020b3]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:26:48 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6836b918-a4fe-4ff5-9323-2d682b300b18 tempest-TestShelveInstance-935146468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89278436-b56f-45f7-8c42-c9afd7bd7453_vgz2258ndevstack@QuobyteHD {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:48 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-3660997d-0521-4852-b77e-171c1212468a tempest-VolumesSnapshotTestJSON-1335946817 None] Delete snapshot completed successfully. Aug 05 10:26:48 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-3660997d-0521-4852-b77e-171c1212468a tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "cinder-c7b72eb3-4c15-4421-a8cc-8726ca9c38e4-delete_snapshot" released by "delete_snapshot" :: held 2.571s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:26:48 devstack sudo[102222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89278436-b56f-45f7-8c42-c9afd7bd7453_vgz2258ndevstack@QuobyteHD Aug 05 10:26:48 devstack sudo[102222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:49 devstack sudo[102222]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6836b918-a4fe-4ff5-9323-2d682b300b18 tempest-TestShelveInstance-935146468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89278436-b56f-45f7-8c42-c9afd7bd7453_vgz2258ndevstack@QuobyteHD" returned: 0 in 0.344s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:49 devstack cinder-volume[88613]: DEBUG cinder.image.image_utils [None req-6836b918-a4fe-4ff5-9323-2d682b300b18 tempest-TestShelveInstance-935146468 None] Temporary image 89278436-b56f-45f7-8c42-c9afd7bd7453 is fetched for user ef4163672cdb4bbcad8d653c443f6805. {{(pid=88613) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 05 10:26:49 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d22fea-870d-4df6-858f-19177bea8727]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:26:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6836b918-a4fe-4ff5-9323-2d682b300b18 tempest-TestShelveInstance-935146468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89278436-b56f-45f7-8c42-c9afd7bd7453_vgz2258ndevstack@QuobyteHD {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:49 devstack sudo[102228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89278436-b56f-45f7-8c42-c9afd7bd7453_vgz2258ndevstack@QuobyteHD Aug 05 10:26:49 devstack sudo[102228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:49 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-af4c910c-3f5a-4431-bb55-701bd83fa7b4 tempest-VolumesSnapshotTestJSON-1335946817 None] Acquiring lock "cinder-537314d8-2786-43db-a07a-ebf7ada5d0d6-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:26:49 devstack sudo[102228]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6836b918-a4fe-4ff5-9323-2d682b300b18 tempest-TestShelveInstance-935146468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89278436-b56f-45f7-8c42-c9afd7bd7453_vgz2258ndevstack@QuobyteHD" returned: 0 in 0.366s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-6836b918-a4fe-4ff5-9323-2d682b300b18 tempest-TestShelveInstance-935146468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:26:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-6836b918-a4fe-4ff5-9323-2d682b300b18 tempest-TestShelveInstance-935146468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:26:49 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-6836b918-a4fe-4ff5-9323-2d682b300b18 tempest-TestShelveInstance-935146468 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:26:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-397524476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fe47a64-a0d9-4e29-92ca-7b581432d637,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4abb630226248a5a4234cff8714359d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:26:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:26:48Z,use_quota=True,user_id='ef4163672cdb4bbcad8d653c443f6805',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:26:49 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-6836b918-a4fe-4ff5-9323-2d682b300b18 tempest-TestShelveInstance-935146468 None] Creating volume 6fe47a64-a0d9-4e29-92ca-7b581432d637 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:26:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-6836b918-a4fe-4ff5-9323-2d682b300b18 tempest-TestShelveInstance-935146468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:26:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-6836b918-a4fe-4ff5-9323-2d682b300b18 tempest-TestShelveInstance-935146468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:26:49 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-6836b918-a4fe-4ff5-9323-2d682b300b18 tempest-TestShelveInstance-935146468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:26:49 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-6836b918-a4fe-4ff5-9323-2d682b300b18 tempest-TestShelveInstance-935146468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:26:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-6836b918-a4fe-4ff5-9323-2d682b300b18 tempest-TestShelveInstance-935146468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:26:49 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-6836b918-a4fe-4ff5-9323-2d682b300b18 tempest-TestShelveInstance-935146468 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:26:49 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-6836b918-a4fe-4ff5-9323-2d682b300b18 tempest-TestShelveInstance-935146468 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:26:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6836b918-a4fe-4ff5-9323-2d682b300b18 tempest-TestShelveInstance-935146468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6fe47a64-a0d9-4e29-92ca-7b581432d637 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:49 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-af4c910c-3f5a-4431-bb55-701bd83fa7b4 tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "cinder-537314d8-2786-43db-a07a-ebf7ada5d0d6-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:26:49 devstack sudo[102233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6fe47a64-a0d9-4e29-92ca-7b581432d637 1073741824 Aug 05 10:26:49 devstack sudo[102233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:49 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-af4c910c-3f5a-4431-bb55-701bd83fa7b4 tempest-VolumesSnapshotTestJSON-1335946817 None] Acquiring lock "cinder-quobyte-537314d8-2786-43db-a07a-ebf7ada5d0d6" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:26:49 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-af4c910c-3f5a-4431-bb55-701bd83fa7b4 tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "cinder-quobyte-537314d8-2786-43db-a07a-ebf7ada5d0d6" acquired by "delete_volume" :: waited 0.022s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:26:49 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[17428696-ee3c-4a65-94c5-a647ebf5a658]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:26:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-af4c910c-3f5a-4431-bb55-701bd83fa7b4 tempest-VolumesSnapshotTestJSON-1335946817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-537314d8-2786-43db-a07a-ebf7ada5d0d6 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:49 devstack sudo[102235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-537314d8-2786-43db-a07a-ebf7ada5d0d6 Aug 05 10:26:49 devstack sudo[102235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:50 devstack sudo[102233]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6836b918-a4fe-4ff5-9323-2d682b300b18 tempest-TestShelveInstance-935146468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6fe47a64-a0d9-4e29-92ca-7b581432d637 1073741824" returned: 0 in 0.555s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:50 devstack sudo[102235]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-af4c910c-3f5a-4431-bb55-701bd83fa7b4 tempest-VolumesSnapshotTestJSON-1335946817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-537314d8-2786-43db-a07a-ebf7ada5d0d6" returned: 0 in 0.439s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-af4c910c-3f5a-4431-bb55-701bd83fa7b4 tempest-VolumesSnapshotTestJSON-1335946817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-537314d8-2786-43db-a07a-ebf7ada5d0d6 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6836b918-a4fe-4ff5-9323-2d682b300b18 tempest-TestShelveInstance-935146468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6fe47a64-a0d9-4e29-92ca-7b581432d637 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:50 devstack sudo[102246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-537314d8-2786-43db-a07a-ebf7ada5d0d6 Aug 05 10:26:50 devstack sudo[102246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:50 devstack sudo[102247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6fe47a64-a0d9-4e29-92ca-7b581432d637 Aug 05 10:26:50 devstack sudo[102247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:50 devstack sudo[102246]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-af4c910c-3f5a-4431-bb55-701bd83fa7b4 tempest-VolumesSnapshotTestJSON-1335946817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-537314d8-2786-43db-a07a-ebf7ada5d0d6" returned: 0 in 0.263s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:50 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-af4c910c-3f5a-4431-bb55-701bd83fa7b4 tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "cinder-quobyte-537314d8-2786-43db-a07a-ebf7ada5d0d6" released by "delete_volume" :: held 0.775s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:26:50 devstack sudo[102247]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6836b918-a4fe-4ff5-9323-2d682b300b18 tempest-TestShelveInstance-935146468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6fe47a64-a0d9-4e29-92ca-7b581432d637" returned: 0 in 0.291s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:50 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-6836b918-a4fe-4ff5-9323-2d682b300b18 tempest-TestShelveInstance-935146468 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:26:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-6836b918-a4fe-4ff5-9323-2d682b300b18 tempest-TestShelveInstance-935146468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:26:50 devstack cinder-volume[88613]: DEBUG cinder.volume.volume_utils [None req-6836b918-a4fe-4ff5-9323-2d682b300b18 tempest-TestShelveInstance-935146468 None] Attempting download of 89278436-b56f-45f7-8c42-c9afd7bd7453 ((None, [{'url': 'file:///opt/stack/data/glance/images/89278436-b56f-45f7-8c42-c9afd7bd7453', 'metadata': {}}])) to volume 6fe47a64-a0d9-4e29-92ca-7b581432d637. {{(pid=88613) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 05 10:26:50 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-af4c910c-3f5a-4431-bb55-701bd83fa7b4 tempest-VolumesSnapshotTestJSON-1335946817 None] Created reservations ['d7ca8e44-d962-4b9e-8e6e-e8fbe2e16e30', '7dd078ae-9af3-4e40-a82a-7280ed98d548', '5d58ae74-8214-4769-91b7-7b9b4d7158c6', '401ea933-d7af-4c0f-9219-da758f387938'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:26:50 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf79334-9d6c-430f-9471-2fd7bd5d4df9]: (4, 'raw') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:26:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6836b918-a4fe-4ff5-9323-2d682b300b18 tempest-TestShelveInstance-935146468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_89278436-b56f-45f7-8c42-c9afd7bd7453_v3apgit1 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-af4c910c-3f5a-4431-bb55-701bd83fa7b4 tempest-VolumesSnapshotTestJSON-1335946817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:26:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-af4c910c-3f5a-4431-bb55-701bd83fa7b4 tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:26:50 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-af4c910c-3f5a-4431-bb55-701bd83fa7b4 tempest-VolumesSnapshotTestJSON-1335946817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:26:50 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-af4c910c-3f5a-4431-bb55-701bd83fa7b4 tempest-VolumesSnapshotTestJSON-1335946817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:26:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-af4c910c-3f5a-4431-bb55-701bd83fa7b4 tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:26:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-af4c910c-3f5a-4431-bb55-701bd83fa7b4 tempest-VolumesSnapshotTestJSON-1335946817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:50 devstack sudo[102253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:26:50 devstack sudo[102253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:50 devstack sudo[102252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_89278436-b56f-45f7-8c42-c9afd7bd7453_v3apgit1 Aug 05 10:26:50 devstack sudo[102252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:51 devstack sudo[102253]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-af4c910c-3f5a-4431-bb55-701bd83fa7b4 tempest-VolumesSnapshotTestJSON-1335946817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.323s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:51 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-af4c910c-3f5a-4431-bb55-701bd83fa7b4 tempest-VolumesSnapshotTestJSON-1335946817 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:26:51 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-af4c910c-3f5a-4431-bb55-701bd83fa7b4 tempest-VolumesSnapshotTestJSON-1335946817 None] Deleted volume successfully. Aug 05 10:26:51 devstack sudo[102252]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6836b918-a4fe-4ff5-9323-2d682b300b18 tempest-TestShelveInstance-935146468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_89278436-b56f-45f7-8c42-c9afd7bd7453_v3apgit1" returned: 0 in 0.456s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6836b918-a4fe-4ff5-9323-2d682b300b18 tempest-TestShelveInstance-935146468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_89278436-b56f-45f7-8c42-c9afd7bd7453_v3apgit1 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:51 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-af4c910c-3f5a-4431-bb55-701bd83fa7b4 tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "cinder-537314d8-2786-43db-a07a-ebf7ada5d0d6-delete_volume" released by "delete_volume" :: held 1.485s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:26:51 devstack sudo[102259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_89278436-b56f-45f7-8c42-c9afd7bd7453_v3apgit1 Aug 05 10:26:51 devstack sudo[102259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:51 devstack sudo[102259]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6836b918-a4fe-4ff5-9323-2d682b300b18 tempest-TestShelveInstance-935146468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_89278436-b56f-45f7-8c42-c9afd7bd7453_v3apgit1" returned: 1 in 0.383s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6836b918-a4fe-4ff5-9323-2d682b300b18 tempest-TestShelveInstance-935146468 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_89278436-b56f-45f7-8c42-c9afd7bd7453_v3apgit1' failed. Not Retrying. {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 10:26:51 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f3086a-b87e-49c1-acf8-c6e707ee510b]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:26:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6836b918-a4fe-4ff5-9323-2d682b300b18 tempest-TestShelveInstance-935146468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89278436-b56f-45f7-8c42-c9afd7bd7453_vgz2258ndevstack@QuobyteHD {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:51 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-d97bf695-2c4b-44e2-a1f5-28c2126b3dc4 tempest-VolumesSnapshotTestJSON-1335946817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:26:51 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d97bf695-2c4b-44e2-a1f5-28c2126b3dc4 tempest-VolumesSnapshotTestJSON-1335946817 None] Flow 'volume_create_manager' (54e8ee08-e5c7-451b-8fad-52a66fca52a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:26:51 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d97bf695-2c4b-44e2-a1f5-28c2126b3dc4 tempest-VolumesSnapshotTestJSON-1335946817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c354eb69-efed-4491-ac8c-4d70275cd6ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:26:51 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d97bf695-2c4b-44e2-a1f5-28c2126b3dc4 tempest-VolumesSnapshotTestJSON-1335946817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c354eb69-efed-4491-ac8c-4d70275cd6ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:26:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2085363982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0220dd61-369f-418e-9d95-e34aa3e855b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffebecfb694848ba97e6f9b082ba06a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:26:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:26:51Z,use_quota=True,user_id='920f46ba702e4f74bbbd3a0291380a58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:26:51 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d97bf695-2c4b-44e2-a1f5-28c2126b3dc4 tempest-VolumesSnapshotTestJSON-1335946817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85cd840c-2336-485f-8e06-703a7ef9934b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:26:51 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d97bf695-2c4b-44e2-a1f5-28c2126b3dc4 tempest-VolumesSnapshotTestJSON-1335946817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85cd840c-2336-485f-8e06-703a7ef9934b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:26:51 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d97bf695-2c4b-44e2-a1f5-28c2126b3dc4 tempest-VolumesSnapshotTestJSON-1335946817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0a6e8a0-1672-47db-be2e-355d3e0da75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:26:51 devstack sudo[102263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89278436-b56f-45f7-8c42-c9afd7bd7453_vgz2258ndevstack@QuobyteHD Aug 05 10:26:51 devstack sudo[102263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:51 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d97bf695-2c4b-44e2-a1f5-28c2126b3dc4 tempest-VolumesSnapshotTestJSON-1335946817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0a6e8a0-1672-47db-be2e-355d3e0da75b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0220dd61-369f-418e-9d95-e34aa3e855b8', 'volume_name': 'volume-0220dd61-369f-418e-9d95-e34aa3e855b8', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:26:51 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d97bf695-2c4b-44e2-a1f5-28c2126b3dc4 tempest-VolumesSnapshotTestJSON-1335946817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd75e6e8-26d1-4d00-9b4d-0407efeb0c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:26:51 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d97bf695-2c4b-44e2-a1f5-28c2126b3dc4 tempest-VolumesSnapshotTestJSON-1335946817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd75e6e8-26d1-4d00-9b4d-0407efeb0c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:26:51 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d97bf695-2c4b-44e2-a1f5-28c2126b3dc4 tempest-VolumesSnapshotTestJSON-1335946817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d11adb01-697b-45c1-a0bc-29d2d348a397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:26:51 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-d97bf695-2c4b-44e2-a1f5-28c2126b3dc4 tempest-VolumesSnapshotTestJSON-1335946817 None] Volume 0220dd61-369f-418e-9d95-e34aa3e855b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0220dd61-369f-418e-9d95-e34aa3e855b8', 'volume_size': 1} Aug 05 10:26:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-d97bf695-2c4b-44e2-a1f5-28c2126b3dc4 tempest-VolumesSnapshotTestJSON-1335946817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:26:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-d97bf695-2c4b-44e2-a1f5-28c2126b3dc4 tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:26:51 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-d97bf695-2c4b-44e2-a1f5-28c2126b3dc4 tempest-VolumesSnapshotTestJSON-1335946817 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:26:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2085363982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0220dd61-369f-418e-9d95-e34aa3e855b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffebecfb694848ba97e6f9b082ba06a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:26:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:26:51Z,use_quota=True,user_id='920f46ba702e4f74bbbd3a0291380a58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:26:51 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-d97bf695-2c4b-44e2-a1f5-28c2126b3dc4 tempest-VolumesSnapshotTestJSON-1335946817 None] Creating volume 0220dd61-369f-418e-9d95-e34aa3e855b8 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:26:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-d97bf695-2c4b-44e2-a1f5-28c2126b3dc4 tempest-VolumesSnapshotTestJSON-1335946817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:26:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-d97bf695-2c4b-44e2-a1f5-28c2126b3dc4 tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:26:51 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-d97bf695-2c4b-44e2-a1f5-28c2126b3dc4 tempest-VolumesSnapshotTestJSON-1335946817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:26:51 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-d97bf695-2c4b-44e2-a1f5-28c2126b3dc4 tempest-VolumesSnapshotTestJSON-1335946817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:26:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-d97bf695-2c4b-44e2-a1f5-28c2126b3dc4 tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:26:51 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-d97bf695-2c4b-44e2-a1f5-28c2126b3dc4 tempest-VolumesSnapshotTestJSON-1335946817 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:26:51 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-d97bf695-2c4b-44e2-a1f5-28c2126b3dc4 tempest-VolumesSnapshotTestJSON-1335946817 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:26:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d97bf695-2c4b-44e2-a1f5-28c2126b3dc4 tempest-VolumesSnapshotTestJSON-1335946817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0220dd61-369f-418e-9d95-e34aa3e855b8 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:51 devstack sudo[102265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0220dd61-369f-418e-9d95-e34aa3e855b8 1073741824 Aug 05 10:26:51 devstack sudo[102265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:51 devstack sudo[102263]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6836b918-a4fe-4ff5-9323-2d682b300b18 tempest-TestShelveInstance-935146468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89278436-b56f-45f7-8c42-c9afd7bd7453_vgz2258ndevstack@QuobyteHD" returned: 0 in 0.381s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:51 devstack cinder-volume[88613]: DEBUG cinder.image.image_utils [None req-6836b918-a4fe-4ff5-9323-2d682b300b18 tempest-TestShelveInstance-935146468 None] 89278436-b56f-45f7-8c42-c9afd7bd7453 was qcow2, converting to qcow2 {{(pid=88613) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 05 10:26:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6836b918-a4fe-4ff5-9323-2d682b300b18 tempest-TestShelveInstance-935146468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_89278436-b56f-45f7-8c42-c9afd7bd7453_vgz2258ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6fe47a64-a0d9-4e29-92ca-7b581432d637 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:51 devstack sudo[102271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_89278436-b56f-45f7-8c42-c9afd7bd7453_vgz2258ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6fe47a64-a0d9-4e29-92ca-7b581432d637 Aug 05 10:26:51 devstack sudo[102271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:52 devstack sudo[102265]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d97bf695-2c4b-44e2-a1f5-28c2126b3dc4 tempest-VolumesSnapshotTestJSON-1335946817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0220dd61-369f-418e-9d95-e34aa3e855b8 1073741824" returned: 0 in 0.526s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d97bf695-2c4b-44e2-a1f5-28c2126b3dc4 tempest-VolumesSnapshotTestJSON-1335946817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0220dd61-369f-418e-9d95-e34aa3e855b8 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:52 devstack sudo[102281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0220dd61-369f-418e-9d95-e34aa3e855b8 Aug 05 10:26:52 devstack sudo[102281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:52 devstack sudo[102281]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d97bf695-2c4b-44e2-a1f5-28c2126b3dc4 tempest-VolumesSnapshotTestJSON-1335946817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0220dd61-369f-418e-9d95-e34aa3e855b8" returned: 0 in 0.422s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:52 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-d97bf695-2c4b-44e2-a1f5-28c2126b3dc4 tempest-VolumesSnapshotTestJSON-1335946817 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:26:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-d97bf695-2c4b-44e2-a1f5-28c2126b3dc4 tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:26:52 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d97bf695-2c4b-44e2-a1f5-28c2126b3dc4 tempest-VolumesSnapshotTestJSON-1335946817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d11adb01-697b-45c1-a0bc-29d2d348a397) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0220dd61-369f-418e-9d95-e34aa3e855b8', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:26:52 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d97bf695-2c4b-44e2-a1f5-28c2126b3dc4 tempest-VolumesSnapshotTestJSON-1335946817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (155a7d74-1e67-47cc-9d81-f2439521276a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:26:52 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-d97bf695-2c4b-44e2-a1f5-28c2126b3dc4 tempest-VolumesSnapshotTestJSON-1335946817 None] Volume volume-0220dd61-369f-418e-9d95-e34aa3e855b8 (0220dd61-369f-418e-9d95-e34aa3e855b8): created successfully Aug 05 10:26:52 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d97bf695-2c4b-44e2-a1f5-28c2126b3dc4 tempest-VolumesSnapshotTestJSON-1335946817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (155a7d74-1e67-47cc-9d81-f2439521276a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:26:52 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d97bf695-2c4b-44e2-a1f5-28c2126b3dc4 tempest-VolumesSnapshotTestJSON-1335946817 None] Flow 'volume_create_manager' (54e8ee08-e5c7-451b-8fad-52a66fca52a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:26:52 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-d97bf695-2c4b-44e2-a1f5-28c2126b3dc4 tempest-VolumesSnapshotTestJSON-1335946817 None] Created volume successfully. Aug 05 10:26:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-f401782e-cf62-4691-803d-941b8b2540ad tempest-VolumesSnapshotTestJSON-1335946817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:26:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-f401782e-cf62-4691-803d-941b8b2540ad tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:26:53 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-f401782e-cf62-4691-803d-941b8b2540ad tempest-VolumesSnapshotTestJSON-1335946817 None] Creating offline snapshot 2b7e6d06-891a-458e-b9c9-642bf4b6a7f7 of volume 0220dd61-369f-418e-9d95-e34aa3e855b8 {{(pid=88613) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:26:53 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e2d368a-dabc-48da-8986-24e1d7c31cb2]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:26:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f401782e-cf62-4691-803d-941b8b2540ad tempest-VolumesSnapshotTestJSON-1335946817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0220dd61-369f-418e-9d95-e34aa3e855b8 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:53 devstack sudo[102287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0220dd61-369f-418e-9d95-e34aa3e855b8 Aug 05 10:26:53 devstack sudo[102287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:53 devstack sudo[102271]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6836b918-a4fe-4ff5-9323-2d682b300b18 tempest-TestShelveInstance-935146468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_89278436-b56f-45f7-8c42-c9afd7bd7453_vgz2258ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6fe47a64-a0d9-4e29-92ca-7b581432d637" returned: 0 in 2.175s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:54 devstack cinder-volume[88613]: DEBUG cinder.image.image_utils [None req-6836b918-a4fe-4ff5-9323-2d682b300b18 tempest-TestShelveInstance-935146468 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_89278436-b56f-45f7-8c42-c9afd7bd7453_vgz2258ndevstack@QuobyteHD, size 112.00 MB, duration 2.18 sec, destination /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6fe47a64-a0d9-4e29-92ca-7b581432d637 {{(pid=88613) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 10:26:54 devstack cinder-volume[88613]: INFO cinder.image.image_utils [None req-6836b918-a4fe-4ff5-9323-2d682b300b18 tempest-TestShelveInstance-935146468 None] Converted 112.00 MB image at 51.48 MB/s Aug 05 10:26:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6836b918-a4fe-4ff5-9323-2d682b300b18 tempest-TestShelveInstance-935146468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6fe47a64-a0d9-4e29-92ca-7b581432d637 1G {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:54 devstack sudo[102289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6fe47a64-a0d9-4e29-92ca-7b581432d637 1G Aug 05 10:26:54 devstack sudo[102289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:54 devstack sudo[102287]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f401782e-cf62-4691-803d-941b8b2540ad tempest-VolumesSnapshotTestJSON-1335946817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0220dd61-369f-418e-9d95-e34aa3e855b8" returned: 0 in 0.425s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f401782e-cf62-4691-803d-941b8b2540ad tempest-VolumesSnapshotTestJSON-1335946817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0220dd61-369f-418e-9d95-e34aa3e855b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0220dd61-369f-418e-9d95-e34aa3e855b8.2b7e6d06-891a-458e-b9c9-642bf4b6a7f7 1G {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:54 devstack sudo[102297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0220dd61-369f-418e-9d95-e34aa3e855b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0220dd61-369f-418e-9d95-e34aa3e855b8.2b7e6d06-891a-458e-b9c9-642bf4b6a7f7 1G Aug 05 10:26:54 devstack sudo[102297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:54 devstack sudo[102289]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6836b918-a4fe-4ff5-9323-2d682b300b18 tempest-TestShelveInstance-935146468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6fe47a64-a0d9-4e29-92ca-7b581432d637 1G" returned: 0 in 0.355s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:54 devstack cinder-volume[88613]: DEBUG cinder.volume.volume_utils [None req-6836b918-a4fe-4ff5-9323-2d682b300b18 tempest-TestShelveInstance-935146468 None] Downloaded image 89278436-b56f-45f7-8c42-c9afd7bd7453 ((None, [{'url': 'file:///opt/stack/data/glance/images/89278436-b56f-45f7-8c42-c9afd7bd7453', 'metadata': {}}])) to volume 6fe47a64-a0d9-4e29-92ca-7b581432d637 successfully. {{(pid=88613) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 05 10:26:54 devstack cinder-volume[88613]: DEBUG cinder.image.image_utils [None req-6836b918-a4fe-4ff5-9323-2d682b300b18 tempest-TestShelveInstance-935146468 None] Temporary image 89278436-b56f-45f7-8c42-c9afd7bd7453 for user ef4163672cdb4bbcad8d653c443f6805 is deleted. {{(pid=88613) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 05 10:26:54 devstack cinder-volume[88613]: DEBUG cinder.volume.volume_utils [None req-6836b918-a4fe-4ff5-9323-2d682b300b18 tempest-TestShelveInstance-935146468 None] Marking volume 6fe47a64-a0d9-4e29-92ca-7b581432d637 as bootable. {{(pid=88613) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 05 10:26:54 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-6836b918-a4fe-4ff5-9323-2d682b300b18 tempest-TestShelveInstance-935146468 None] Copying metadata from image 89278436-b56f-45f7-8c42-c9afd7bd7453 to 6fe47a64-a0d9-4e29-92ca-7b581432d637. {{(pid=88613) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 05 10:26:54 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-6836b918-a4fe-4ff5-9323-2d682b300b18 tempest-TestShelveInstance-935146468 None] Creating volume glance metadata for volume 6fe47a64-a0d9-4e29-92ca-7b581432d637 backed by image 89278436-b56f-45f7-8c42-c9afd7bd7453 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '89278436-b56f-45f7-8c42-c9afd7bd7453', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88613) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 05 10:26:54 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-6836b918-a4fe-4ff5-9323-2d682b300b18 tempest-TestShelveInstance-935146468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81057596-98ac-4076-afdf-471ec6a6ecbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fe47a64-a0d9-4e29-92ca-7b581432d637', 'volume_size': 1, 'image_id': '89278436-b56f-45f7-8c42-c9afd7bd7453', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/89278436-b56f-45f7-8c42-c9afd7bd7453', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '654c7af809d145caaadc8738d3dc3df2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '89278436-b56f-45f7-8c42-c9afd7bd7453', 'created_at': datetime.datetime(2026, 8, 5, 8, 7, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 8, 7, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/89278436-b56f-45f7-8c42-c9afd7bd7453/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:26:54 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-6836b918-a4fe-4ff5-9323-2d682b300b18 tempest-TestShelveInstance-935146468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef1ecb37-fc6f-4a39-b3f2-5dd33d87bc57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:26:54 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-6836b918-a4fe-4ff5-9323-2d682b300b18 tempest-TestShelveInstance-935146468 None] Volume volume-6fe47a64-a0d9-4e29-92ca-7b581432d637 (6fe47a64-a0d9-4e29-92ca-7b581432d637): created successfully Aug 05 10:26:54 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-6836b918-a4fe-4ff5-9323-2d682b300b18 tempest-TestShelveInstance-935146468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef1ecb37-fc6f-4a39-b3f2-5dd33d87bc57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:26:54 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-6836b918-a4fe-4ff5-9323-2d682b300b18 tempest-TestShelveInstance-935146468 None] Flow 'volume_create_manager' (5f75b078-7dbb-410e-819e-251f61dd667c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:26:54 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-6836b918-a4fe-4ff5-9323-2d682b300b18 tempest-TestShelveInstance-935146468 None] Created volume successfully. Aug 05 10:26:54 devstack sudo[102297]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f401782e-cf62-4691-803d-941b8b2540ad tempest-VolumesSnapshotTestJSON-1335946817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0220dd61-369f-418e-9d95-e34aa3e855b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0220dd61-369f-418e-9d95-e34aa3e855b8.2b7e6d06-891a-458e-b9c9-642bf4b6a7f7 1G" returned: 0 in 0.430s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f401782e-cf62-4691-803d-941b8b2540ad tempest-VolumesSnapshotTestJSON-1335946817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0220dd61-369f-418e-9d95-e34aa3e855b8 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0220dd61-369f-418e-9d95-e34aa3e855b8.2b7e6d06-891a-458e-b9c9-642bf4b6a7f7 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:54 devstack sudo[102303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0220dd61-369f-418e-9d95-e34aa3e855b8 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0220dd61-369f-418e-9d95-e34aa3e855b8.2b7e6d06-891a-458e-b9c9-642bf4b6a7f7 Aug 05 10:26:54 devstack sudo[102303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:54 devstack sudo[102303]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f401782e-cf62-4691-803d-941b8b2540ad tempest-VolumesSnapshotTestJSON-1335946817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0220dd61-369f-418e-9d95-e34aa3e855b8 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0220dd61-369f-418e-9d95-e34aa3e855b8.2b7e6d06-891a-458e-b9c9-642bf4b6a7f7" returned: 0 in 0.283s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:54 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-f401782e-cf62-4691-803d-941b8b2540ad tempest-VolumesSnapshotTestJSON-1335946817 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0220dd61-369f-418e-9d95-e34aa3e855b8.2b7e6d06-891a-458e-b9c9-642bf4b6a7f7 is being set with open permissions: ugo+rw Aug 05 10:26:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f401782e-cf62-4691-803d-941b8b2540ad tempest-VolumesSnapshotTestJSON-1335946817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0220dd61-369f-418e-9d95-e34aa3e855b8.2b7e6d06-891a-458e-b9c9-642bf4b6a7f7 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:55 devstack sudo[102308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0220dd61-369f-418e-9d95-e34aa3e855b8.2b7e6d06-891a-458e-b9c9-642bf4b6a7f7 Aug 05 10:26:55 devstack sudo[102308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:55 devstack sudo[102308]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:55 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f401782e-cf62-4691-803d-941b8b2540ad tempest-VolumesSnapshotTestJSON-1335946817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0220dd61-369f-418e-9d95-e34aa3e855b8.2b7e6d06-891a-458e-b9c9-642bf4b6a7f7" returned: 0 in 0.248s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:55 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f401782e-cf62-4691-803d-941b8b2540ad tempest-VolumesSnapshotTestJSON-1335946817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0220dd61-369f-418e-9d95-e34aa3e855b8.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:55 devstack sudo[102311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0220dd61-369f-418e-9d95-e34aa3e855b8.info Aug 05 10:26:55 devstack sudo[102311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:55 devstack sudo[102311]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:55 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f401782e-cf62-4691-803d-941b8b2540ad tempest-VolumesSnapshotTestJSON-1335946817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0220dd61-369f-418e-9d95-e34aa3e855b8.info" returned: 0 in 0.282s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:55 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-f401782e-cf62-4691-803d-941b8b2540ad tempest-VolumesSnapshotTestJSON-1335946817 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0220dd61-369f-418e-9d95-e34aa3e855b8.info is being set with open permissions: ugo+rw Aug 05 10:26:55 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f401782e-cf62-4691-803d-941b8b2540ad tempest-VolumesSnapshotTestJSON-1335946817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0220dd61-369f-418e-9d95-e34aa3e855b8.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:55 devstack sudo[102314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0220dd61-369f-418e-9d95-e34aa3e855b8.info Aug 05 10:26:55 devstack sudo[102314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:55 devstack sudo[102314]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:55 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f401782e-cf62-4691-803d-941b8b2540ad tempest-VolumesSnapshotTestJSON-1335946817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0220dd61-369f-418e-9d95-e34aa3e855b8.info" returned: 0 in 0.329s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:55 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-f401782e-cf62-4691-803d-941b8b2540ad tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.138s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:26:55 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-f401782e-cf62-4691-803d-941b8b2540ad tempest-VolumesSnapshotTestJSON-1335946817 None] Create snapshot completed successfully Aug 05 10:26:56 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bc62669-fa57-4c9c-9cf0-aadd02c29831 tempest-TestStampPattern-1347312802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:26:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-8bc62669-fa57-4c9c-9cf0-aadd02c29831 tempest-TestStampPattern-1347312802 None] Flow 'volume_create_manager' (db508a29-e305-4184-9e2e-f282e5ff7bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:26:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-8bc62669-fa57-4c9c-9cf0-aadd02c29831 tempest-TestStampPattern-1347312802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da4c825c-c40f-4cf8-8809-7a4fd1777330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:26:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-8bc62669-fa57-4c9c-9cf0-aadd02c29831 tempest-TestStampPattern-1347312802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da4c825c-c40f-4cf8-8809-7a4fd1777330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:26:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-752703237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6236f049-52b3-4312-ae8a-d9135aba9288,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a65f134bfe7437699790af3763ee410',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:26:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:26:56Z,use_quota=True,user_id='63948bc935ad43e1b61470cfb8f90a8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:26:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-8bc62669-fa57-4c9c-9cf0-aadd02c29831 tempest-TestStampPattern-1347312802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (717ccc7f-aae2-4e76-ae73-4aad9f4b274a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:26:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-8bc62669-fa57-4c9c-9cf0-aadd02c29831 tempest-TestStampPattern-1347312802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (717ccc7f-aae2-4e76-ae73-4aad9f4b274a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:26:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-8bc62669-fa57-4c9c-9cf0-aadd02c29831 tempest-TestStampPattern-1347312802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (825cb858-e9d8-4552-9c76-10efd3e74a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:26:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-8bc62669-fa57-4c9c-9cf0-aadd02c29831 tempest-TestStampPattern-1347312802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (825cb858-e9d8-4552-9c76-10efd3e74a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6236f049-52b3-4312-ae8a-d9135aba9288', 'volume_name': 'volume-6236f049-52b3-4312-ae8a-d9135aba9288', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:26:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-8bc62669-fa57-4c9c-9cf0-aadd02c29831 tempest-TestStampPattern-1347312802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc45cdce-fd4d-4a68-bcc7-00a21d31ae25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:26:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-8bc62669-fa57-4c9c-9cf0-aadd02c29831 tempest-TestStampPattern-1347312802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc45cdce-fd4d-4a68-bcc7-00a21d31ae25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:26:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-8bc62669-fa57-4c9c-9cf0-aadd02c29831 tempest-TestStampPattern-1347312802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4ac96e7-af18-4525-871a-180841ad05c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:26:56 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-8bc62669-fa57-4c9c-9cf0-aadd02c29831 tempest-TestStampPattern-1347312802 None] Volume 6236f049-52b3-4312-ae8a-d9135aba9288: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6236f049-52b3-4312-ae8a-d9135aba9288', 'volume_size': 1} Aug 05 10:26:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-8bc62669-fa57-4c9c-9cf0-aadd02c29831 tempest-TestStampPattern-1347312802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:26:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-8bc62669-fa57-4c9c-9cf0-aadd02c29831 tempest-TestStampPattern-1347312802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:26:56 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-8bc62669-fa57-4c9c-9cf0-aadd02c29831 tempest-TestStampPattern-1347312802 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:26:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-752703237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6236f049-52b3-4312-ae8a-d9135aba9288,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a65f134bfe7437699790af3763ee410',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:26:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:26:56Z,use_quota=True,user_id='63948bc935ad43e1b61470cfb8f90a8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:26:56 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-8bc62669-fa57-4c9c-9cf0-aadd02c29831 tempest-TestStampPattern-1347312802 None] Creating volume 6236f049-52b3-4312-ae8a-d9135aba9288 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:26:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-8bc62669-fa57-4c9c-9cf0-aadd02c29831 tempest-TestStampPattern-1347312802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:26:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-8bc62669-fa57-4c9c-9cf0-aadd02c29831 tempest-TestStampPattern-1347312802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:26:56 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-8bc62669-fa57-4c9c-9cf0-aadd02c29831 tempest-TestStampPattern-1347312802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:26:56 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-8bc62669-fa57-4c9c-9cf0-aadd02c29831 tempest-TestStampPattern-1347312802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:26:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-8bc62669-fa57-4c9c-9cf0-aadd02c29831 tempest-TestStampPattern-1347312802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:26:56 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-8bc62669-fa57-4c9c-9cf0-aadd02c29831 tempest-TestStampPattern-1347312802 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:26:56 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-8bc62669-fa57-4c9c-9cf0-aadd02c29831 tempest-TestStampPattern-1347312802 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:26:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-8bc62669-fa57-4c9c-9cf0-aadd02c29831 tempest-TestStampPattern-1347312802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6236f049-52b3-4312-ae8a-d9135aba9288 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:56 devstack sudo[102317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6236f049-52b3-4312-ae8a-d9135aba9288 1073741824 Aug 05 10:26:56 devstack sudo[102317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:56 devstack sudo[102317]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-8bc62669-fa57-4c9c-9cf0-aadd02c29831 tempest-TestStampPattern-1347312802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6236f049-52b3-4312-ae8a-d9135aba9288 1073741824" returned: 0 in 0.540s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-8bc62669-fa57-4c9c-9cf0-aadd02c29831 tempest-TestStampPattern-1347312802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6236f049-52b3-4312-ae8a-d9135aba9288 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:56 devstack sudo[102327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6236f049-52b3-4312-ae8a-d9135aba9288 Aug 05 10:26:56 devstack sudo[102327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:57 devstack sudo[102327]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-8bc62669-fa57-4c9c-9cf0-aadd02c29831 tempest-TestStampPattern-1347312802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6236f049-52b3-4312-ae8a-d9135aba9288" returned: 0 in 0.366s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:57 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-8bc62669-fa57-4c9c-9cf0-aadd02c29831 tempest-TestStampPattern-1347312802 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:26:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-8bc62669-fa57-4c9c-9cf0-aadd02c29831 tempest-TestStampPattern-1347312802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:26:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-8bc62669-fa57-4c9c-9cf0-aadd02c29831 tempest-TestStampPattern-1347312802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4ac96e7-af18-4525-871a-180841ad05c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6236f049-52b3-4312-ae8a-d9135aba9288', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:26:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-8bc62669-fa57-4c9c-9cf0-aadd02c29831 tempest-TestStampPattern-1347312802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dadaaf2-5da8-46c7-9ce3-9401e25f6c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:26:57 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-8bc62669-fa57-4c9c-9cf0-aadd02c29831 tempest-TestStampPattern-1347312802 None] Volume volume-6236f049-52b3-4312-ae8a-d9135aba9288 (6236f049-52b3-4312-ae8a-d9135aba9288): created successfully Aug 05 10:26:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-8bc62669-fa57-4c9c-9cf0-aadd02c29831 tempest-TestStampPattern-1347312802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dadaaf2-5da8-46c7-9ce3-9401e25f6c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:26:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-8bc62669-fa57-4c9c-9cf0-aadd02c29831 tempest-TestStampPattern-1347312802 None] Flow 'volume_create_manager' (db508a29-e305-4184-9e2e-f282e5ff7bd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:26:57 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-8bc62669-fa57-4c9c-9cf0-aadd02c29831 tempest-TestStampPattern-1347312802 None] Created volume successfully. Aug 05 10:26:57 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-a14e3906-9582-48ed-aa9f-62f6e675f4e9 tempest-VolumesSnapshotTestJSON-1335946817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:26:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a14e3906-9582-48ed-aa9f-62f6e675f4e9 tempest-VolumesSnapshotTestJSON-1335946817 None] Flow 'volume_create_manager' (f7ebad5a-9490-45e2-8546-529939c3a64f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:26:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a14e3906-9582-48ed-aa9f-62f6e675f4e9 tempest-VolumesSnapshotTestJSON-1335946817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9f0c9b4-957c-4588-a4b6-9cc7163e1f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:26:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a14e3906-9582-48ed-aa9f-62f6e675f4e9 tempest-VolumesSnapshotTestJSON-1335946817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9f0c9b4-957c-4588-a4b6-9cc7163e1f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:26:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-463075139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=582c7cc0-a8da-4a45-88a4-3972d1b2047f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffebecfb694848ba97e6f9b082ba06a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:26:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2b7e6d06-891a-458e-b9c9-642bf4b6a7f7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:26:58Z,use_quota=True,user_id='920f46ba702e4f74bbbd3a0291380a58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:26:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a14e3906-9582-48ed-aa9f-62f6e675f4e9 tempest-VolumesSnapshotTestJSON-1335946817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5ae886c-02ee-4133-a687-17da16654cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:26:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a14e3906-9582-48ed-aa9f-62f6e675f4e9 tempest-VolumesSnapshotTestJSON-1335946817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5ae886c-02ee-4133-a687-17da16654cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:26:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a14e3906-9582-48ed-aa9f-62f6e675f4e9 tempest-VolumesSnapshotTestJSON-1335946817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d79337a7-7190-46b9-9f70-5078bebcb828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:26:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a14e3906-9582-48ed-aa9f-62f6e675f4e9 tempest-VolumesSnapshotTestJSON-1335946817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d79337a7-7190-46b9-9f70-5078bebcb828) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '582c7cc0-a8da-4a45-88a4-3972d1b2047f', 'volume_name': 'volume-582c7cc0-a8da-4a45-88a4-3972d1b2047f', 'volume_size': 1, 'snapshot_id': '2b7e6d06-891a-458e-b9c9-642bf4b6a7f7'}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:26:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a14e3906-9582-48ed-aa9f-62f6e675f4e9 tempest-VolumesSnapshotTestJSON-1335946817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75219e76-4e0c-4177-bd52-066fbd8cb0db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:26:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a14e3906-9582-48ed-aa9f-62f6e675f4e9 tempest-VolumesSnapshotTestJSON-1335946817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75219e76-4e0c-4177-bd52-066fbd8cb0db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:26:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a14e3906-9582-48ed-aa9f-62f6e675f4e9 tempest-VolumesSnapshotTestJSON-1335946817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0b8a554-5a62-4171-b4a0-971fdfb4f6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:26:57 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-a14e3906-9582-48ed-aa9f-62f6e675f4e9 tempest-VolumesSnapshotTestJSON-1335946817 None] Volume 582c7cc0-a8da-4a45-88a4-3972d1b2047f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-582c7cc0-a8da-4a45-88a4-3972d1b2047f', 'volume_size': 1, 'snapshot_id': '2b7e6d06-891a-458e-b9c9-642bf4b6a7f7'} Aug 05 10:26:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a14e3906-9582-48ed-aa9f-62f6e675f4e9 tempest-VolumesSnapshotTestJSON-1335946817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:26:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a14e3906-9582-48ed-aa9f-62f6e675f4e9 tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:26:57 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-a14e3906-9582-48ed-aa9f-62f6e675f4e9 tempest-VolumesSnapshotTestJSON-1335946817 None] Acquiring lock "cinder-quobyte-2b7e6d06-891a-458e-b9c9-642bf4b6a7f7-582c7cc0-a8da-4a45-88a4-3972d1b2047f" by "_create_volume_from_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:26:57 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-a14e3906-9582-48ed-aa9f-62f6e675f4e9 tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "cinder-quobyte-2b7e6d06-891a-458e-b9c9-642bf4b6a7f7-582c7cc0-a8da-4a45-88a4-3972d1b2047f" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:26:57 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-a14e3906-9582-48ed-aa9f-62f6e675f4e9 tempest-VolumesSnapshotTestJSON-1335946817 None] Creating volume 582c7cc0-a8da-4a45-88a4-3972d1b2047f from snapshot 2b7e6d06-891a-458e-b9c9-642bf4b6a7f7 {{(pid=88613) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 05 10:26:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a14e3906-9582-48ed-aa9f-62f6e675f4e9 tempest-VolumesSnapshotTestJSON-1335946817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:26:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a14e3906-9582-48ed-aa9f-62f6e675f4e9 tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:26:57 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-a14e3906-9582-48ed-aa9f-62f6e675f4e9 tempest-VolumesSnapshotTestJSON-1335946817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:26:57 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-a14e3906-9582-48ed-aa9f-62f6e675f4e9 tempest-VolumesSnapshotTestJSON-1335946817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:26:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a14e3906-9582-48ed-aa9f-62f6e675f4e9 tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:26:57 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-a14e3906-9582-48ed-aa9f-62f6e675f4e9 tempest-VolumesSnapshotTestJSON-1335946817 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:26:57 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-a14e3906-9582-48ed-aa9f-62f6e675f4e9 tempest-VolumesSnapshotTestJSON-1335946817 None] Acquiring lock "cinder-quobyte-582c7cc0-a8da-4a45-88a4-3972d1b2047f" by "_copy_volume_from_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:26:57 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-a14e3906-9582-48ed-aa9f-62f6e675f4e9 tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "cinder-quobyte-582c7cc0-a8da-4a45-88a4-3972d1b2047f" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:26:57 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-a14e3906-9582-48ed-aa9f-62f6e675f4e9 tempest-VolumesSnapshotTestJSON-1335946817 None] snapshot: 2b7e6d06-891a-458e-b9c9-642bf4b6a7f7, volume: 582c7cc0-a8da-4a45-88a4-3972d1b2047f, {{(pid=88613) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 05 10:26:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a14e3906-9582-48ed-aa9f-62f6e675f4e9 tempest-VolumesSnapshotTestJSON-1335946817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:26:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a14e3906-9582-48ed-aa9f-62f6e675f4e9 tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:26:57 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-a14e3906-9582-48ed-aa9f-62f6e675f4e9 tempest-VolumesSnapshotTestJSON-1335946817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:26:57 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-a14e3906-9582-48ed-aa9f-62f6e675f4e9 tempest-VolumesSnapshotTestJSON-1335946817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:26:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a14e3906-9582-48ed-aa9f-62f6e675f4e9 tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:26:57 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d7a4c3-c5a5-4621-adba-8059ac317f58]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:26:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a14e3906-9582-48ed-aa9f-62f6e675f4e9 tempest-VolumesSnapshotTestJSON-1335946817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0220dd61-369f-418e-9d95-e34aa3e855b8.2b7e6d06-891a-458e-b9c9-642bf4b6a7f7 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:58 devstack sudo[102368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0220dd61-369f-418e-9d95-e34aa3e855b8.2b7e6d06-891a-458e-b9c9-642bf4b6a7f7 Aug 05 10:26:58 devstack sudo[102368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:58 devstack sudo[102368]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a14e3906-9582-48ed-aa9f-62f6e675f4e9 tempest-VolumesSnapshotTestJSON-1335946817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0220dd61-369f-418e-9d95-e34aa3e855b8.2b7e6d06-891a-458e-b9c9-642bf4b6a7f7" returned: 0 in 0.404s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:58 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-a14e3906-9582-48ed-aa9f-62f6e675f4e9 tempest-VolumesSnapshotTestJSON-1335946817 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0220dd61-369f-418e-9d95-e34aa3e855b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88613) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:26:58 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[657f9409-3803-4fbf-bdec-0298ebb440bb]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:26:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a14e3906-9582-48ed-aa9f-62f6e675f4e9 tempest-VolumesSnapshotTestJSON-1335946817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0220dd61-369f-418e-9d95-e34aa3e855b8 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:58 devstack sudo[102373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0220dd61-369f-418e-9d95-e34aa3e855b8 Aug 05 10:26:58 devstack sudo[102373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:58 devstack sudo[102373]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a14e3906-9582-48ed-aa9f-62f6e675f4e9 tempest-VolumesSnapshotTestJSON-1335946817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0220dd61-369f-418e-9d95-e34aa3e855b8" returned: 0 in 0.549s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:58 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-a14e3906-9582-48ed-aa9f-62f6e675f4e9 tempest-VolumesSnapshotTestJSON-1335946817 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0220dd61-369f-418e-9d95-e34aa3e855b8 {{(pid=88613) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 05 10:26:58 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-a14e3906-9582-48ed-aa9f-62f6e675f4e9 tempest-VolumesSnapshotTestJSON-1335946817 None] Creating direct copy from snapshot {{(pid=88613) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 05 10:26:58 devstack cinder-volume[88613]: DEBUG cinder.utils [None req-a14e3906-9582-48ed-aa9f-62f6e675f4e9 tempest-VolumesSnapshotTestJSON-1335946817 None] Path /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-582c7cc0-a8da-4a45-88a4-3972d1b2047f not found in is_blk_device check {{(pid=88613) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 05 10:26:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a14e3906-9582-48ed-aa9f-62f6e675f4e9 tempest-VolumesSnapshotTestJSON-1335946817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0220dd61-369f-418e-9d95-e34aa3e855b8 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-582c7cc0-a8da-4a45-88a4-3972d1b2047f {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:58 devstack sudo[102385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0220dd61-369f-418e-9d95-e34aa3e855b8 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-582c7cc0-a8da-4a45-88a4-3972d1b2047f Aug 05 10:26:58 devstack sudo[102385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-a0120674-1e27-43ce-b1ac-d979a5b96e06 req-f96225d7-9925-4a5c-9f5a-7130a0d5e702 tempest-TestShelveInstance-935146468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:27:04 devstack sudo[102385]: pam_unix(sudo:session): session closed for user root Aug 05 10:27:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a14e3906-9582-48ed-aa9f-62f6e675f4e9 tempest-VolumesSnapshotTestJSON-1335946817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0220dd61-369f-418e-9d95-e34aa3e855b8 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-582c7cc0-a8da-4a45-88a4-3972d1b2047f" returned: 0 in 5.958s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:27:04 devstack cinder-volume[88613]: DEBUG cinder.image.image_utils [None req-a14e3906-9582-48ed-aa9f-62f6e675f4e9 tempest-VolumesSnapshotTestJSON-1335946817 None] Image conversion details: src /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0220dd61-369f-418e-9d95-e34aa3e855b8, size 1024.00 MB, duration 5.96 sec, destination /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-582c7cc0-a8da-4a45-88a4-3972d1b2047f {{(pid=88613) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 10:27:04 devstack cinder-volume[88613]: INFO cinder.image.image_utils [None req-a14e3906-9582-48ed-aa9f-62f6e675f4e9 tempest-VolumesSnapshotTestJSON-1335946817 None] Converted 1024.00 MB image at 171.84 MB/s Aug 05 10:27:04 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-a14e3906-9582-48ed-aa9f-62f6e675f4e9 tempest-VolumesSnapshotTestJSON-1335946817 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-582c7cc0-a8da-4a45-88a4-3972d1b2047f is being set with open permissions: ugo+rw Aug 05 10:27:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a14e3906-9582-48ed-aa9f-62f6e675f4e9 tempest-VolumesSnapshotTestJSON-1335946817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-582c7cc0-a8da-4a45-88a4-3972d1b2047f {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:27:04 devstack sudo[102420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-582c7cc0-a8da-4a45-88a4-3972d1b2047f Aug 05 10:27:04 devstack sudo[102420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:27:05 devstack sudo[102420]: pam_unix(sudo:session): session closed for user root Aug 05 10:27:05 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a14e3906-9582-48ed-aa9f-62f6e675f4e9 tempest-VolumesSnapshotTestJSON-1335946817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-582c7cc0-a8da-4a45-88a4-3972d1b2047f" returned: 0 in 0.300s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:27:05 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-a14e3906-9582-48ed-aa9f-62f6e675f4e9 tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "cinder-quobyte-582c7cc0-a8da-4a45-88a4-3972d1b2047f" released by "_copy_volume_from_snapshot" :: held 7.305s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:27:05 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-a14e3906-9582-48ed-aa9f-62f6e675f4e9 tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "cinder-quobyte-2b7e6d06-891a-458e-b9c9-642bf4b6a7f7-582c7cc0-a8da-4a45-88a4-3972d1b2047f" released by "_create_volume_from_snapshot" :: held 7.374s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:27:05 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a14e3906-9582-48ed-aa9f-62f6e675f4e9 tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.392s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:27:05 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-a0120674-1e27-43ce-b1ac-d979a5b96e06 req-f96225d7-9925-4a5c-9f5a-7130a0d5e702 tempest-TestShelveInstance-935146468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 6.091s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:27:05 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-a0120674-1e27-43ce-b1ac-d979a5b96e06 req-f96225d7-9925-4a5c-9f5a-7130a0d5e702 tempest-TestShelveInstance-935146468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:27:05 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a14e3906-9582-48ed-aa9f-62f6e675f4e9 tempest-VolumesSnapshotTestJSON-1335946817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0b8a554-5a62-4171-b4a0-971fdfb4f6a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-582c7cc0-a8da-4a45-88a4-3972d1b2047f', 'volume_size': 1, 'snapshot_id': '2b7e6d06-891a-458e-b9c9-642bf4b6a7f7'}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:27:05 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a14e3906-9582-48ed-aa9f-62f6e675f4e9 tempest-VolumesSnapshotTestJSON-1335946817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (690b41bb-d17f-4d04-9196-bcd165ab8df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:27:05 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-a14e3906-9582-48ed-aa9f-62f6e675f4e9 tempest-VolumesSnapshotTestJSON-1335946817 None] Volume volume-582c7cc0-a8da-4a45-88a4-3972d1b2047f (582c7cc0-a8da-4a45-88a4-3972d1b2047f): created successfully Aug 05 10:27:05 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a14e3906-9582-48ed-aa9f-62f6e675f4e9 tempest-VolumesSnapshotTestJSON-1335946817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (690b41bb-d17f-4d04-9196-bcd165ab8df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:27:05 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a14e3906-9582-48ed-aa9f-62f6e675f4e9 tempest-VolumesSnapshotTestJSON-1335946817 None] Flow 'volume_create_manager' (f7ebad5a-9490-45e2-8546-529939c3a64f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:27:05 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [req-a0120674-1e27-43ce-b1ac-d979a5b96e06 req-f96225d7-9925-4a5c-9f5a-7130a0d5e702 tempest-TestShelveInstance-935146468 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1', 'name': 'volume-6fe47a64-a0d9-4e29-92ca-7b581432d637', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'aac401b9-e16f-4e1b-a14e-406568cf3a19', 'enforce_multipath': True} {{(pid=88613) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 10:27:05 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-a14e3906-9582-48ed-aa9f-62f6e675f4e9 tempest-VolumesSnapshotTestJSON-1335946817 None] Created volume successfully. Aug 05 10:27:05 devstack cinder-volume[88613]: INFO cinder.volume.manager [req-a0120674-1e27-43ce-b1ac-d979a5b96e06 req-f96225d7-9925-4a5c-9f5a-7130a0d5e702 tempest-TestShelveInstance-935146468 None] attachment_update completed successfully. Aug 05 10:27:05 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-098e604f-8888-49b4-adc2-6b139b38afbc tempest-VolumesSnapshotTestJSON-1335946817 None] Acquiring lock "cinder-582c7cc0-a8da-4a45-88a4-3972d1b2047f-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:27:06 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-098e604f-8888-49b4-adc2-6b139b38afbc tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "cinder-582c7cc0-a8da-4a45-88a4-3972d1b2047f-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:27:06 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-098e604f-8888-49b4-adc2-6b139b38afbc tempest-VolumesSnapshotTestJSON-1335946817 None] Acquiring lock "cinder-quobyte-582c7cc0-a8da-4a45-88a4-3972d1b2047f" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:27:06 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-098e604f-8888-49b4-adc2-6b139b38afbc tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "cinder-quobyte-582c7cc0-a8da-4a45-88a4-3972d1b2047f" acquired by "delete_volume" :: waited 0.040s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:27:06 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[24baea5e-6cbd-4e66-9d47-afb283f549ee]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:27:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-098e604f-8888-49b4-adc2-6b139b38afbc tempest-VolumesSnapshotTestJSON-1335946817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-582c7cc0-a8da-4a45-88a4-3972d1b2047f {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:27:06 devstack sudo[102469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-582c7cc0-a8da-4a45-88a4-3972d1b2047f Aug 05 10:27:06 devstack sudo[102469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:27:06 devstack sudo[102469]: pam_unix(sudo:session): session closed for user root Aug 05 10:27:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-098e604f-8888-49b4-adc2-6b139b38afbc tempest-VolumesSnapshotTestJSON-1335946817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-582c7cc0-a8da-4a45-88a4-3972d1b2047f" returned: 0 in 0.728s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:27:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-098e604f-8888-49b4-adc2-6b139b38afbc tempest-VolumesSnapshotTestJSON-1335946817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-582c7cc0-a8da-4a45-88a4-3972d1b2047f {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:27:07 devstack sudo[102569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-582c7cc0-a8da-4a45-88a4-3972d1b2047f Aug 05 10:27:07 devstack sudo[102569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:27:07 devstack sudo[102569]: pam_unix(sudo:session): session closed for user root Aug 05 10:27:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-098e604f-8888-49b4-adc2-6b139b38afbc tempest-VolumesSnapshotTestJSON-1335946817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-582c7cc0-a8da-4a45-88a4-3972d1b2047f" returned: 0 in 0.383s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:27:07 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-098e604f-8888-49b4-adc2-6b139b38afbc tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "cinder-quobyte-582c7cc0-a8da-4a45-88a4-3972d1b2047f" released by "delete_volume" :: held 1.208s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:27:07 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-098e604f-8888-49b4-adc2-6b139b38afbc tempest-VolumesSnapshotTestJSON-1335946817 None] Created reservations ['978e5163-4e71-42be-8674-d6eed7739610', '2559d86c-51f6-4914-a94d-0c0835696058', '98cca164-de23-49db-82f8-77152c238253', 'd7173587-a0c4-46c9-a384-5c101263c849'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:27:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-098e604f-8888-49b4-adc2-6b139b38afbc tempest-VolumesSnapshotTestJSON-1335946817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:27:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-098e604f-8888-49b4-adc2-6b139b38afbc tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:27:07 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-098e604f-8888-49b4-adc2-6b139b38afbc tempest-VolumesSnapshotTestJSON-1335946817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:27:07 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-098e604f-8888-49b4-adc2-6b139b38afbc tempest-VolumesSnapshotTestJSON-1335946817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:27:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-098e604f-8888-49b4-adc2-6b139b38afbc tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:27:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-098e604f-8888-49b4-adc2-6b139b38afbc tempest-VolumesSnapshotTestJSON-1335946817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:27:07 devstack sudo[102918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:27:07 devstack sudo[102918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:27:07 devstack sudo[102918]: pam_unix(sudo:session): session closed for user root Aug 05 10:27:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-098e604f-8888-49b4-adc2-6b139b38afbc tempest-VolumesSnapshotTestJSON-1335946817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.339s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:27:07 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-098e604f-8888-49b4-adc2-6b139b38afbc tempest-VolumesSnapshotTestJSON-1335946817 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:27:07 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-098e604f-8888-49b4-adc2-6b139b38afbc tempest-VolumesSnapshotTestJSON-1335946817 None] Deleted volume successfully. Aug 05 10:27:07 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-098e604f-8888-49b4-adc2-6b139b38afbc tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "cinder-582c7cc0-a8da-4a45-88a4-3972d1b2047f-delete_volume" released by "delete_volume" :: held 1.956s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:27:08 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-af0b9913-b90d-4843-b54e-a5db1fc8ddb0 tempest-VolumesSnapshotTestJSON-1335946817 None] Acquiring lock "cinder-2b7e6d06-891a-458e-b9c9-642bf4b6a7f7-delete_snapshot" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:27:08 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-af0b9913-b90d-4843-b54e-a5db1fc8ddb0 tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "cinder-2b7e6d06-891a-458e-b9c9-642bf4b6a7f7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:27:08 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-af0b9913-b90d-4843-b54e-a5db1fc8ddb0 tempest-VolumesSnapshotTestJSON-1335946817 None] Acquiring lock "cinder-quobyte-0220dd61-369f-418e-9d95-e34aa3e855b8" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:27:08 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-af0b9913-b90d-4843-b54e-a5db1fc8ddb0 tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "cinder-quobyte-0220dd61-369f-418e-9d95-e34aa3e855b8" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:27:08 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-af0b9913-b90d-4843-b54e-a5db1fc8ddb0 tempest-VolumesSnapshotTestJSON-1335946817 None] Acquiring lock "cinder-quobyte-2b7e6d06-891a-458e-b9c9-642bf4b6a7f7" by "_delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:27:08 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-af0b9913-b90d-4843-b54e-a5db1fc8ddb0 tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "cinder-quobyte-2b7e6d06-891a-458e-b9c9-642bf4b6a7f7" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:27:08 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-af0b9913-b90d-4843-b54e-a5db1fc8ddb0 tempest-VolumesSnapshotTestJSON-1335946817 None] Deleting offline snapshot 2b7e6d06-891a-458e-b9c9-642bf4b6a7f7 of volume 0220dd61-369f-418e-9d95-e34aa3e855b8 {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:27:08 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-af0b9913-b90d-4843-b54e-a5db1fc8ddb0 tempest-VolumesSnapshotTestJSON-1335946817 None] snapshot_file for this snap is: volume-0220dd61-369f-418e-9d95-e34aa3e855b8.2b7e6d06-891a-458e-b9c9-642bf4b6a7f7 {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:27:08 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c48254-523a-40e7-ac0e-e782a9fd56c7]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:27:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-af0b9913-b90d-4843-b54e-a5db1fc8ddb0 tempest-VolumesSnapshotTestJSON-1335946817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0220dd61-369f-418e-9d95-e34aa3e855b8.2b7e6d06-891a-458e-b9c9-642bf4b6a7f7 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:27:08 devstack sudo[102952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0220dd61-369f-418e-9d95-e34aa3e855b8.2b7e6d06-891a-458e-b9c9-642bf4b6a7f7 Aug 05 10:27:08 devstack sudo[102952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:27:08 devstack sudo[102952]: pam_unix(sudo:session): session closed for user root Aug 05 10:27:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-af0b9913-b90d-4843-b54e-a5db1fc8ddb0 tempest-VolumesSnapshotTestJSON-1335946817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0220dd61-369f-418e-9d95-e34aa3e855b8.2b7e6d06-891a-458e-b9c9-642bf4b6a7f7" returned: 0 in 0.411s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:27:08 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-af0b9913-b90d-4843-b54e-a5db1fc8ddb0 tempest-VolumesSnapshotTestJSON-1335946817 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0220dd61-369f-418e-9d95-e34aa3e855b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88613) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:27:08 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[504e802a-c891-4c20-9eba-6b44cbaa2e51]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:27:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-af0b9913-b90d-4843-b54e-a5db1fc8ddb0 tempest-VolumesSnapshotTestJSON-1335946817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0220dd61-369f-418e-9d95-e34aa3e855b8 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:27:08 devstack sudo[102976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0220dd61-369f-418e-9d95-e34aa3e855b8 Aug 05 10:27:08 devstack sudo[102976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:27:09 devstack sudo[102976]: pam_unix(sudo:session): session closed for user root Aug 05 10:27:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-af0b9913-b90d-4843-b54e-a5db1fc8ddb0 tempest-VolumesSnapshotTestJSON-1335946817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0220dd61-369f-418e-9d95-e34aa3e855b8" returned: 0 in 0.827s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:27:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-af0b9913-b90d-4843-b54e-a5db1fc8ddb0 tempest-VolumesSnapshotTestJSON-1335946817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0220dd61-369f-418e-9d95-e34aa3e855b8.2b7e6d06-891a-458e-b9c9-642bf4b6a7f7 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:27:09 devstack sudo[102983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0220dd61-369f-418e-9d95-e34aa3e855b8.2b7e6d06-891a-458e-b9c9-642bf4b6a7f7 Aug 05 10:27:09 devstack sudo[102983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:27:10 devstack sudo[102983]: pam_unix(sudo:session): session closed for user root Aug 05 10:27:10 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-af0b9913-b90d-4843-b54e-a5db1fc8ddb0 tempest-VolumesSnapshotTestJSON-1335946817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0220dd61-369f-418e-9d95-e34aa3e855b8.2b7e6d06-891a-458e-b9c9-642bf4b6a7f7" returned: 0 in 0.527s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:27:10 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-af0b9913-b90d-4843-b54e-a5db1fc8ddb0 tempest-VolumesSnapshotTestJSON-1335946817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0220dd61-369f-418e-9d95-e34aa3e855b8.2b7e6d06-891a-458e-b9c9-642bf4b6a7f7 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:27:10 devstack sudo[102991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0220dd61-369f-418e-9d95-e34aa3e855b8.2b7e6d06-891a-458e-b9c9-642bf4b6a7f7 Aug 05 10:27:10 devstack sudo[102991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:27:10 devstack sudo[102991]: pam_unix(sudo:session): session closed for user root Aug 05 10:27:10 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-af0b9913-b90d-4843-b54e-a5db1fc8ddb0 tempest-VolumesSnapshotTestJSON-1335946817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0220dd61-369f-418e-9d95-e34aa3e855b8.2b7e6d06-891a-458e-b9c9-642bf4b6a7f7" returned: 0 in 0.450s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:27:10 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-af0b9913-b90d-4843-b54e-a5db1fc8ddb0 tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "cinder-quobyte-2b7e6d06-891a-458e-b9c9-642bf4b6a7f7" released by "_delete_snapshot" :: held 2.416s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:27:10 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-af0b9913-b90d-4843-b54e-a5db1fc8ddb0 tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "cinder-quobyte-0220dd61-369f-418e-9d95-e34aa3e855b8" released by "delete_snapshot" :: held 2.447s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:27:10 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-af0b9913-b90d-4843-b54e-a5db1fc8ddb0 tempest-VolumesSnapshotTestJSON-1335946817 None] Created reservations ['52226c3b-ed73-4b5a-8dce-c759f5eab43a', '14dd9e65-db14-42e3-80a2-42c5b24d2e09', 'e7c68d84-d97f-4474-809d-822f2e15fec5', '7252c2a3-e23b-49c4-8073-2aa6fe48097a'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:27:10 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-af0b9913-b90d-4843-b54e-a5db1fc8ddb0 tempest-VolumesSnapshotTestJSON-1335946817 None] Delete snapshot completed successfully. Aug 05 10:27:10 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-af0b9913-b90d-4843-b54e-a5db1fc8ddb0 tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "cinder-2b7e6d06-891a-458e-b9c9-642bf4b6a7f7-delete_snapshot" released by "delete_snapshot" :: held 2.699s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:27:11 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-3c3dc303-63e4-42d9-b126-3bb01af6926c tempest-VolumesSnapshotTestJSON-1335946817 None] Acquiring lock "cinder-0220dd61-369f-418e-9d95-e34aa3e855b8-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:27:11 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-3c3dc303-63e4-42d9-b126-3bb01af6926c tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "cinder-0220dd61-369f-418e-9d95-e34aa3e855b8-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:27:11 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-3c3dc303-63e4-42d9-b126-3bb01af6926c tempest-VolumesSnapshotTestJSON-1335946817 None] Acquiring lock "cinder-quobyte-0220dd61-369f-418e-9d95-e34aa3e855b8" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:27:11 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-3c3dc303-63e4-42d9-b126-3bb01af6926c tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "cinder-quobyte-0220dd61-369f-418e-9d95-e34aa3e855b8" acquired by "delete_volume" :: waited 0.036s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:27:12 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd204996-ce63-444f-8578-b385d4e45830]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:27:12 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3c3dc303-63e4-42d9-b126-3bb01af6926c tempest-VolumesSnapshotTestJSON-1335946817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0220dd61-369f-418e-9d95-e34aa3e855b8 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:27:12 devstack sudo[102994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0220dd61-369f-418e-9d95-e34aa3e855b8 Aug 05 10:27:12 devstack sudo[102994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:27:12 devstack sudo[102994]: pam_unix(sudo:session): session closed for user root Aug 05 10:27:12 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3c3dc303-63e4-42d9-b126-3bb01af6926c tempest-VolumesSnapshotTestJSON-1335946817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0220dd61-369f-418e-9d95-e34aa3e855b8" returned: 0 in 0.829s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:27:12 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3c3dc303-63e4-42d9-b126-3bb01af6926c tempest-VolumesSnapshotTestJSON-1335946817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0220dd61-369f-418e-9d95-e34aa3e855b8 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:27:12 devstack sudo[102999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0220dd61-369f-418e-9d95-e34aa3e855b8 Aug 05 10:27:12 devstack sudo[102999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:27:13 devstack sudo[102999]: pam_unix(sudo:session): session closed for user root Aug 05 10:27:13 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3c3dc303-63e4-42d9-b126-3bb01af6926c tempest-VolumesSnapshotTestJSON-1335946817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0220dd61-369f-418e-9d95-e34aa3e855b8" returned: 0 in 0.519s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:27:13 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-3c3dc303-63e4-42d9-b126-3bb01af6926c tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "cinder-quobyte-0220dd61-369f-418e-9d95-e34aa3e855b8" released by "delete_volume" :: held 1.469s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:27:13 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-3c3dc303-63e4-42d9-b126-3bb01af6926c tempest-VolumesSnapshotTestJSON-1335946817 None] Created reservations ['6f75c485-4213-46e2-b47e-b3c94edc2815', 'e4585597-2a97-485a-8d35-403273596c90', '078a6bfd-f543-4b81-9b2b-097a7a288a21', '63434338-8a15-480e-96fc-507ccef2c85e'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:27:13 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-3c3dc303-63e4-42d9-b126-3bb01af6926c tempest-VolumesSnapshotTestJSON-1335946817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:27:13 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-3c3dc303-63e4-42d9-b126-3bb01af6926c tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:27:13 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-3c3dc303-63e4-42d9-b126-3bb01af6926c tempest-VolumesSnapshotTestJSON-1335946817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:27:13 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-3c3dc303-63e4-42d9-b126-3bb01af6926c tempest-VolumesSnapshotTestJSON-1335946817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:27:13 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-3c3dc303-63e4-42d9-b126-3bb01af6926c tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:27:13 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3c3dc303-63e4-42d9-b126-3bb01af6926c tempest-VolumesSnapshotTestJSON-1335946817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:27:13 devstack sudo[103003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:27:13 devstack sudo[103003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:27:14 devstack sudo[103003]: pam_unix(sudo:session): session closed for user root Aug 05 10:27:14 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3c3dc303-63e4-42d9-b126-3bb01af6926c tempest-VolumesSnapshotTestJSON-1335946817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.707s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:27:14 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-3c3dc303-63e4-42d9-b126-3bb01af6926c tempest-VolumesSnapshotTestJSON-1335946817 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:27:14 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-3c3dc303-63e4-42d9-b126-3bb01af6926c tempest-VolumesSnapshotTestJSON-1335946817 None] Deleted volume successfully. Aug 05 10:27:14 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-3c3dc303-63e4-42d9-b126-3bb01af6926c tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "cinder-0220dd61-369f-418e-9d95-e34aa3e855b8-delete_volume" released by "delete_volume" :: held 2.677s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:27:14 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-5b361ee3-9f02-485d-95c5-b189256b26d5 tempest-VolumesSnapshotTestJSON-1335946817 None] Acquiring lock "cinder-f586eb47-de4f-413d-8453-4791c6d62dfc-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:27:14 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-5b361ee3-9f02-485d-95c5-b189256b26d5 tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "cinder-f586eb47-de4f-413d-8453-4791c6d62dfc-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:27:14 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-5b361ee3-9f02-485d-95c5-b189256b26d5 tempest-VolumesSnapshotTestJSON-1335946817 None] Acquiring lock "cinder-quobyte-f586eb47-de4f-413d-8453-4791c6d62dfc" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:27:14 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-5b361ee3-9f02-485d-95c5-b189256b26d5 tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "cinder-quobyte-f586eb47-de4f-413d-8453-4791c6d62dfc" acquired by "delete_volume" :: waited 0.020s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:27:14 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[87bfb56b-a5dd-46eb-8501-be611f63538c]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:27:14 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5b361ee3-9f02-485d-95c5-b189256b26d5 tempest-VolumesSnapshotTestJSON-1335946817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f586eb47-de4f-413d-8453-4791c6d62dfc {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:27:15 devstack sudo[103008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f586eb47-de4f-413d-8453-4791c6d62dfc Aug 05 10:27:15 devstack sudo[103008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:27:15 devstack sudo[103008]: pam_unix(sudo:session): session closed for user root Aug 05 10:27:15 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5b361ee3-9f02-485d-95c5-b189256b26d5 tempest-VolumesSnapshotTestJSON-1335946817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f586eb47-de4f-413d-8453-4791c6d62dfc" returned: 0 in 0.646s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:27:15 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5b361ee3-9f02-485d-95c5-b189256b26d5 tempest-VolumesSnapshotTestJSON-1335946817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f586eb47-de4f-413d-8453-4791c6d62dfc {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:27:15 devstack sudo[103015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f586eb47-de4f-413d-8453-4791c6d62dfc Aug 05 10:27:15 devstack sudo[103015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:27:15 devstack sudo[103015]: pam_unix(sudo:session): session closed for user root Aug 05 10:27:15 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5b361ee3-9f02-485d-95c5-b189256b26d5 tempest-VolumesSnapshotTestJSON-1335946817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f586eb47-de4f-413d-8453-4791c6d62dfc" returned: 0 in 0.441s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:27:15 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-5b361ee3-9f02-485d-95c5-b189256b26d5 tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "cinder-quobyte-f586eb47-de4f-413d-8453-4791c6d62dfc" released by "delete_volume" :: held 1.225s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:27:16 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-5b361ee3-9f02-485d-95c5-b189256b26d5 tempest-VolumesSnapshotTestJSON-1335946817 None] Created reservations ['bda78276-3e7a-4842-bb61-5a41545a1af6', '292751e1-1e79-47f9-9c18-0b4f9a0f395d', '8db0b834-c77e-4d09-ab56-7e1802eef65b', '63f4894e-0900-4702-b6c1-f318390c5dd6'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:27:16 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5b361ee3-9f02-485d-95c5-b189256b26d5 tempest-VolumesSnapshotTestJSON-1335946817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:27:16 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5b361ee3-9f02-485d-95c5-b189256b26d5 tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:27:16 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-5b361ee3-9f02-485d-95c5-b189256b26d5 tempest-VolumesSnapshotTestJSON-1335946817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:27:16 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-5b361ee3-9f02-485d-95c5-b189256b26d5 tempest-VolumesSnapshotTestJSON-1335946817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:27:16 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5b361ee3-9f02-485d-95c5-b189256b26d5 tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:27:16 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5b361ee3-9f02-485d-95c5-b189256b26d5 tempest-VolumesSnapshotTestJSON-1335946817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:27:16 devstack sudo[103020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:27:16 devstack sudo[103020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:27:16 devstack sudo[103020]: pam_unix(sudo:session): session closed for user root Aug 05 10:27:16 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5b361ee3-9f02-485d-95c5-b189256b26d5 tempest-VolumesSnapshotTestJSON-1335946817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.611s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:27:16 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-5b361ee3-9f02-485d-95c5-b189256b26d5 tempest-VolumesSnapshotTestJSON-1335946817 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:27:16 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-5b361ee3-9f02-485d-95c5-b189256b26d5 tempest-VolumesSnapshotTestJSON-1335946817 None] Deleted volume successfully. Aug 05 10:27:16 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-5b361ee3-9f02-485d-95c5-b189256b26d5 tempest-VolumesSnapshotTestJSON-1335946817 None] Lock "cinder-f586eb47-de4f-413d-8453-4791c6d62dfc-delete_volume" released by "delete_volume" :: held 2.340s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:27:21 devstack cinder-volume[88613]: DEBUG oslo_service.periodic_task [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88613) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:27:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:27:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:27:21 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:27:21 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:27:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:27:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:27:21 devstack sudo[103026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:27:21 devstack sudo[103026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:27:22 devstack sudo[103026]: pam_unix(sudo:session): session closed for user root Aug 05 10:27:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.383s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:27:22 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:27:22 devstack cinder-volume[88613]: DEBUG oslo_service.periodic_task [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Running periodic task VolumeManager._thread_info {{(pid=88613) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:27:22 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] thread count: 28 {{(pid=88613) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 10:27:22 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] thread info: [<_MainThread(MainThread, started 126173666128000)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88613) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 10:27:26 devstack cinder-volume[88613]: DEBUG dbcounter [-] [88613] Writing DB stats cinder:UPDATE=82,cinder:INSERT=26,cinder:DELETE=9,cinder:SELECT=87 {{(pid=88613) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:27:26 devstack cinder-volume[88613]: DEBUG dbcounter [-] [88613] Writing DB stats cinder:SELECT=92,cinder:UPDATE=90,cinder:INSERT=29,cinder:DELETE=6 {{(pid=88613) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:27:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-56ce25b1-2a42-4429-b5fc-8f5387320971 req-c542f8f9-ca30-4e27-908f-d06760d2be7e tempest-TestStampPattern-1347312802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:27:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-56ce25b1-2a42-4429-b5fc-8f5387320971 req-c542f8f9-ca30-4e27-908f-d06760d2be7e tempest-TestStampPattern-1347312802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:27:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-56ce25b1-2a42-4429-b5fc-8f5387320971 req-c542f8f9-ca30-4e27-908f-d06760d2be7e tempest-TestStampPattern-1347312802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:27:37 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [req-56ce25b1-2a42-4429-b5fc-8f5387320971 req-c542f8f9-ca30-4e27-908f-d06760d2be7e tempest-TestStampPattern-1347312802 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1', 'name': 'volume-6236f049-52b3-4312-ae8a-d9135aba9288', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fe7aaa37-587b-4d76-b4ed-e41fc1b8552a', 'enforce_multipath': True} {{(pid=88613) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 10:27:37 devstack cinder-volume[88613]: INFO cinder.volume.manager [req-56ce25b1-2a42-4429-b5fc-8f5387320971 req-c542f8f9-ca30-4e27-908f-d06760d2be7e tempest-TestStampPattern-1347312802 None] attachment_update completed successfully. Aug 05 10:27:43 devstack cinder-volume[88613]: INFO cinder.volume.manager [req-fa67d523-ce55-4f68-b524-c3d0adaa088c req-683d7e47-ed8e-4005-bc8f-a347ad92ca7c tempest-TestStampPattern-1347312802 None] Terminate volume connection completed successfully. Aug 05 10:27:43 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [req-fa67d523-ce55-4f68-b524-c3d0adaa088c req-683d7e47-ed8e-4005-bc8f-a347ad92ca7c tempest-TestStampPattern-1347312802 None] Deleting attachment fe7aaa37-587b-4d76-b4ed-e41fc1b8552a. {{(pid=88613) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 10:27:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-6ba4cb6a-fb5a-4f2e-95aa-f39f4c3a67be tempest-TestStampPattern-1347312802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:27:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-6ba4cb6a-fb5a-4f2e-95aa-f39f4c3a67be tempest-TestStampPattern-1347312802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:27:44 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-6ba4cb6a-fb5a-4f2e-95aa-f39f4c3a67be tempest-TestStampPattern-1347312802 None] Creating offline snapshot e3210311-74ec-422e-9c30-8c96ef59a3b4 of volume 6236f049-52b3-4312-ae8a-d9135aba9288 {{(pid=88613) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:27:44 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4458164-914d-48a1-8e40-0f6365930a1e]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:27:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6ba4cb6a-fb5a-4f2e-95aa-f39f4c3a67be tempest-TestStampPattern-1347312802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6236f049-52b3-4312-ae8a-d9135aba9288 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:27:44 devstack sudo[103166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6236f049-52b3-4312-ae8a-d9135aba9288 Aug 05 10:27:44 devstack sudo[103166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:27:44 devstack sudo[103166]: pam_unix(sudo:session): session closed for user root Aug 05 10:27:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6ba4cb6a-fb5a-4f2e-95aa-f39f4c3a67be tempest-TestStampPattern-1347312802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6236f049-52b3-4312-ae8a-d9135aba9288" returned: 0 in 0.410s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:27:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6ba4cb6a-fb5a-4f2e-95aa-f39f4c3a67be tempest-TestStampPattern-1347312802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6236f049-52b3-4312-ae8a-d9135aba9288,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6236f049-52b3-4312-ae8a-d9135aba9288.e3210311-74ec-422e-9c30-8c96ef59a3b4 1G {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:27:44 devstack sudo[103172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6236f049-52b3-4312-ae8a-d9135aba9288,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6236f049-52b3-4312-ae8a-d9135aba9288.e3210311-74ec-422e-9c30-8c96ef59a3b4 1G Aug 05 10:27:44 devstack sudo[103172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:27:45 devstack sudo[103172]: pam_unix(sudo:session): session closed for user root Aug 05 10:27:45 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6ba4cb6a-fb5a-4f2e-95aa-f39f4c3a67be tempest-TestStampPattern-1347312802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6236f049-52b3-4312-ae8a-d9135aba9288,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6236f049-52b3-4312-ae8a-d9135aba9288.e3210311-74ec-422e-9c30-8c96ef59a3b4 1G" returned: 0 in 0.520s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:27:45 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6ba4cb6a-fb5a-4f2e-95aa-f39f4c3a67be tempest-TestStampPattern-1347312802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6236f049-52b3-4312-ae8a-d9135aba9288 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6236f049-52b3-4312-ae8a-d9135aba9288.e3210311-74ec-422e-9c30-8c96ef59a3b4 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:27:45 devstack sudo[103178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6236f049-52b3-4312-ae8a-d9135aba9288 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6236f049-52b3-4312-ae8a-d9135aba9288.e3210311-74ec-422e-9c30-8c96ef59a3b4 Aug 05 10:27:45 devstack sudo[103178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:27:45 devstack sudo[103178]: pam_unix(sudo:session): session closed for user root Aug 05 10:27:45 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6ba4cb6a-fb5a-4f2e-95aa-f39f4c3a67be tempest-TestStampPattern-1347312802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6236f049-52b3-4312-ae8a-d9135aba9288 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6236f049-52b3-4312-ae8a-d9135aba9288.e3210311-74ec-422e-9c30-8c96ef59a3b4" returned: 0 in 0.325s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:27:45 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-6ba4cb6a-fb5a-4f2e-95aa-f39f4c3a67be tempest-TestStampPattern-1347312802 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6236f049-52b3-4312-ae8a-d9135aba9288.e3210311-74ec-422e-9c30-8c96ef59a3b4 is being set with open permissions: ugo+rw Aug 05 10:27:45 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6ba4cb6a-fb5a-4f2e-95aa-f39f4c3a67be tempest-TestStampPattern-1347312802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6236f049-52b3-4312-ae8a-d9135aba9288.e3210311-74ec-422e-9c30-8c96ef59a3b4 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:27:45 devstack sudo[103183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6236f049-52b3-4312-ae8a-d9135aba9288.e3210311-74ec-422e-9c30-8c96ef59a3b4 Aug 05 10:27:45 devstack sudo[103183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:27:45 devstack sudo[103183]: pam_unix(sudo:session): session closed for user root Aug 05 10:27:45 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6ba4cb6a-fb5a-4f2e-95aa-f39f4c3a67be tempest-TestStampPattern-1347312802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6236f049-52b3-4312-ae8a-d9135aba9288.e3210311-74ec-422e-9c30-8c96ef59a3b4" returned: 0 in 0.270s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:27:45 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6ba4cb6a-fb5a-4f2e-95aa-f39f4c3a67be tempest-TestStampPattern-1347312802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6236f049-52b3-4312-ae8a-d9135aba9288.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:27:45 devstack sudo[103186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6236f049-52b3-4312-ae8a-d9135aba9288.info Aug 05 10:27:45 devstack sudo[103186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:27:46 devstack sudo[103186]: pam_unix(sudo:session): session closed for user root Aug 05 10:27:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6ba4cb6a-fb5a-4f2e-95aa-f39f4c3a67be tempest-TestStampPattern-1347312802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6236f049-52b3-4312-ae8a-d9135aba9288.info" returned: 0 in 0.257s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:27:46 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-6ba4cb6a-fb5a-4f2e-95aa-f39f4c3a67be tempest-TestStampPattern-1347312802 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6236f049-52b3-4312-ae8a-d9135aba9288.info is being set with open permissions: ugo+rw Aug 05 10:27:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6ba4cb6a-fb5a-4f2e-95aa-f39f4c3a67be tempest-TestStampPattern-1347312802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6236f049-52b3-4312-ae8a-d9135aba9288.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:27:46 devstack sudo[103189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6236f049-52b3-4312-ae8a-d9135aba9288.info Aug 05 10:27:46 devstack sudo[103189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:27:46 devstack sudo[103189]: pam_unix(sudo:session): session closed for user root Aug 05 10:27:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6ba4cb6a-fb5a-4f2e-95aa-f39f4c3a67be tempest-TestStampPattern-1347312802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6236f049-52b3-4312-ae8a-d9135aba9288.info" returned: 0 in 0.270s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:27:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-6ba4cb6a-fb5a-4f2e-95aa-f39f4c3a67be tempest-TestStampPattern-1347312802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.187s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:27:46 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-6ba4cb6a-fb5a-4f2e-95aa-f39f4c3a67be tempest-TestStampPattern-1347312802 None] Create snapshot completed successfully Aug 05 10:27:56 devstack cinder-volume[88613]: INFO cinder.volume.manager [req-a84b151b-6f3a-4c82-877b-1a133cc55205 req-897cb590-6541-42ca-8464-5cab744c0c59 tempest-TestShelveInstance-935146468 None] Terminate volume connection completed successfully. Aug 05 10:27:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [req-a84b151b-6f3a-4c82-877b-1a133cc55205 req-897cb590-6541-42ca-8464-5cab744c0c59 tempest-TestShelveInstance-935146468 None] Deleting attachment aac401b9-e16f-4e1b-a14e-406568cf3a19. {{(pid=88613) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 10:27:57 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6e0ca06-f07e-48cb-8461-2199bbfb8002 tempest-TestStampPattern-1347312802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:27:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-e6e0ca06-f07e-48cb-8461-2199bbfb8002 tempest-TestStampPattern-1347312802 None] Flow 'volume_create_manager' (fed6b9ab-1ca0-4440-a30c-5abf49a2603d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:27:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-e6e0ca06-f07e-48cb-8461-2199bbfb8002 tempest-TestStampPattern-1347312802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e645ca1d-5ab1-4cdf-914b-bf9d7e1d9044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:27:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-e6e0ca06-f07e-48cb-8461-2199bbfb8002 tempest-TestStampPattern-1347312802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e645ca1d-5ab1-4cdf-914b-bf9d7e1d9044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:27:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-237691429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25f99c74-8969-493b-8711-65ccd62f0c80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a65f134bfe7437699790af3763ee410',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:27:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e3210311-74ec-422e-9c30-8c96ef59a3b4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:27:58Z,use_quota=True,user_id='63948bc935ad43e1b61470cfb8f90a8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:27:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-e6e0ca06-f07e-48cb-8461-2199bbfb8002 tempest-TestStampPattern-1347312802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ef66be5-f5f3-47c5-aab3-992712f327d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:27:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-e6e0ca06-f07e-48cb-8461-2199bbfb8002 tempest-TestStampPattern-1347312802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ef66be5-f5f3-47c5-aab3-992712f327d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:27:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-e6e0ca06-f07e-48cb-8461-2199bbfb8002 tempest-TestStampPattern-1347312802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63525c69-e247-49d9-8318-c2070b50332e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:27:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-e6e0ca06-f07e-48cb-8461-2199bbfb8002 tempest-TestStampPattern-1347312802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63525c69-e247-49d9-8318-c2070b50332e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '25f99c74-8969-493b-8711-65ccd62f0c80', 'volume_name': 'volume-25f99c74-8969-493b-8711-65ccd62f0c80', 'volume_size': 1, 'snapshot_id': 'e3210311-74ec-422e-9c30-8c96ef59a3b4'}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:27:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-e6e0ca06-f07e-48cb-8461-2199bbfb8002 tempest-TestStampPattern-1347312802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a820cc79-d317-4b56-896c-9a9a446868e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:27:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-e6e0ca06-f07e-48cb-8461-2199bbfb8002 tempest-TestStampPattern-1347312802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a820cc79-d317-4b56-896c-9a9a446868e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:27:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-e6e0ca06-f07e-48cb-8461-2199bbfb8002 tempest-TestStampPattern-1347312802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4fdd149-a9bb-4325-9f21-d462d6097e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:27:57 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-e6e0ca06-f07e-48cb-8461-2199bbfb8002 tempest-TestStampPattern-1347312802 None] Volume 25f99c74-8969-493b-8711-65ccd62f0c80: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-25f99c74-8969-493b-8711-65ccd62f0c80', 'volume_size': 1, 'snapshot_id': 'e3210311-74ec-422e-9c30-8c96ef59a3b4'} Aug 05 10:27:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-e6e0ca06-f07e-48cb-8461-2199bbfb8002 tempest-TestStampPattern-1347312802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:27:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-e6e0ca06-f07e-48cb-8461-2199bbfb8002 tempest-TestStampPattern-1347312802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:27:57 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e6e0ca06-f07e-48cb-8461-2199bbfb8002 tempest-TestStampPattern-1347312802 None] Acquiring lock "cinder-quobyte-e3210311-74ec-422e-9c30-8c96ef59a3b4-25f99c74-8969-493b-8711-65ccd62f0c80" by "_create_volume_from_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:27:57 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e6e0ca06-f07e-48cb-8461-2199bbfb8002 tempest-TestStampPattern-1347312802 None] Lock "cinder-quobyte-e3210311-74ec-422e-9c30-8c96ef59a3b4-25f99c74-8969-493b-8711-65ccd62f0c80" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:27:57 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-e6e0ca06-f07e-48cb-8461-2199bbfb8002 tempest-TestStampPattern-1347312802 None] Creating volume 25f99c74-8969-493b-8711-65ccd62f0c80 from snapshot e3210311-74ec-422e-9c30-8c96ef59a3b4 {{(pid=88613) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 05 10:27:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-e6e0ca06-f07e-48cb-8461-2199bbfb8002 tempest-TestStampPattern-1347312802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:27:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-e6e0ca06-f07e-48cb-8461-2199bbfb8002 tempest-TestStampPattern-1347312802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:27:57 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-e6e0ca06-f07e-48cb-8461-2199bbfb8002 tempest-TestStampPattern-1347312802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:27:57 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-e6e0ca06-f07e-48cb-8461-2199bbfb8002 tempest-TestStampPattern-1347312802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:27:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-e6e0ca06-f07e-48cb-8461-2199bbfb8002 tempest-TestStampPattern-1347312802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:27:57 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-e6e0ca06-f07e-48cb-8461-2199bbfb8002 tempest-TestStampPattern-1347312802 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:27:57 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e6e0ca06-f07e-48cb-8461-2199bbfb8002 tempest-TestStampPattern-1347312802 None] Acquiring lock "cinder-quobyte-25f99c74-8969-493b-8711-65ccd62f0c80" by "_copy_volume_from_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:27:57 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e6e0ca06-f07e-48cb-8461-2199bbfb8002 tempest-TestStampPattern-1347312802 None] Lock "cinder-quobyte-25f99c74-8969-493b-8711-65ccd62f0c80" acquired by "_copy_volume_from_snapshot" :: waited 0.040s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:27:57 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-e6e0ca06-f07e-48cb-8461-2199bbfb8002 tempest-TestStampPattern-1347312802 None] snapshot: e3210311-74ec-422e-9c30-8c96ef59a3b4, volume: 25f99c74-8969-493b-8711-65ccd62f0c80, {{(pid=88613) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 05 10:27:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-e6e0ca06-f07e-48cb-8461-2199bbfb8002 tempest-TestStampPattern-1347312802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:27:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-e6e0ca06-f07e-48cb-8461-2199bbfb8002 tempest-TestStampPattern-1347312802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:27:57 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-e6e0ca06-f07e-48cb-8461-2199bbfb8002 tempest-TestStampPattern-1347312802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:27:57 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-e6e0ca06-f07e-48cb-8461-2199bbfb8002 tempest-TestStampPattern-1347312802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:27:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-e6e0ca06-f07e-48cb-8461-2199bbfb8002 tempest-TestStampPattern-1347312802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:27:57 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be03205-5e35-4c20-bdde-f52b96252540]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:27:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e6e0ca06-f07e-48cb-8461-2199bbfb8002 tempest-TestStampPattern-1347312802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6236f049-52b3-4312-ae8a-d9135aba9288.e3210311-74ec-422e-9c30-8c96ef59a3b4 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:27:58 devstack sudo[103422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6236f049-52b3-4312-ae8a-d9135aba9288.e3210311-74ec-422e-9c30-8c96ef59a3b4 Aug 05 10:27:58 devstack sudo[103422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:27:58 devstack sudo[103422]: pam_unix(sudo:session): session closed for user root Aug 05 10:27:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e6e0ca06-f07e-48cb-8461-2199bbfb8002 tempest-TestStampPattern-1347312802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6236f049-52b3-4312-ae8a-d9135aba9288.e3210311-74ec-422e-9c30-8c96ef59a3b4" returned: 0 in 0.772s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:27:58 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-e6e0ca06-f07e-48cb-8461-2199bbfb8002 tempest-TestStampPattern-1347312802 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6236f049-52b3-4312-ae8a-d9135aba9288(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88613) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:27:58 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea13ca26-6d08-4c2d-a486-529f30181840]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:27:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e6e0ca06-f07e-48cb-8461-2199bbfb8002 tempest-TestStampPattern-1347312802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6236f049-52b3-4312-ae8a-d9135aba9288 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:27:58 devstack sudo[103432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6236f049-52b3-4312-ae8a-d9135aba9288 Aug 05 10:27:58 devstack sudo[103432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:27:59 devstack sudo[103432]: pam_unix(sudo:session): session closed for user root Aug 05 10:27:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e6e0ca06-f07e-48cb-8461-2199bbfb8002 tempest-TestStampPattern-1347312802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6236f049-52b3-4312-ae8a-d9135aba9288" returned: 0 in 0.735s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:27:59 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-e6e0ca06-f07e-48cb-8461-2199bbfb8002 tempest-TestStampPattern-1347312802 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6236f049-52b3-4312-ae8a-d9135aba9288 {{(pid=88613) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 05 10:27:59 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-e6e0ca06-f07e-48cb-8461-2199bbfb8002 tempest-TestStampPattern-1347312802 None] Creating direct copy from snapshot {{(pid=88613) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 05 10:27:59 devstack cinder-volume[88613]: DEBUG cinder.utils [None req-e6e0ca06-f07e-48cb-8461-2199bbfb8002 tempest-TestStampPattern-1347312802 None] Path /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-25f99c74-8969-493b-8711-65ccd62f0c80 not found in is_blk_device check {{(pid=88613) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 05 10:27:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e6e0ca06-f07e-48cb-8461-2199bbfb8002 tempest-TestStampPattern-1347312802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6236f049-52b3-4312-ae8a-d9135aba9288 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-25f99c74-8969-493b-8711-65ccd62f0c80 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:27:59 devstack sudo[103440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6236f049-52b3-4312-ae8a-d9135aba9288 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-25f99c74-8969-493b-8711-65ccd62f0c80 Aug 05 10:27:59 devstack sudo[103440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:00 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-746cff5a-e5f6-4d78-9831-7e5498b9176f req-e7f7e8e1-1da4-4c3d-bad2-ad8c3e6414bd tempest-TestShelveInstance-935146468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:28:01 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-a676fb3f-d445-4448-90d2-eb66509038c9 tempest-TestMinimumBasicScenario-1660464696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:28:01 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a676fb3f-d445-4448-90d2-eb66509038c9 tempest-TestMinimumBasicScenario-1660464696 None] Flow 'volume_create_manager' (5bdda1e1-3b5b-4010-9fbc-38838d09bea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:28:01 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a676fb3f-d445-4448-90d2-eb66509038c9 tempest-TestMinimumBasicScenario-1660464696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (994fe64a-04be-4d24-8501-473a85e421e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:28:01 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a676fb3f-d445-4448-90d2-eb66509038c9 tempest-TestMinimumBasicScenario-1660464696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (994fe64a-04be-4d24-8501-473a85e421e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-937400548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88e6a16c-40e1-4a72-886e-61af510fc570,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c913d5db564b4f56b1d187faac713257',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:28:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:28:01Z,use_quota=True,user_id='e562841c69dd44f1b303e4288ad4ba1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:28:01 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a676fb3f-d445-4448-90d2-eb66509038c9 tempest-TestMinimumBasicScenario-1660464696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdd3672d-46f1-468a-85a2-291222e2f0fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:28:01 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a676fb3f-d445-4448-90d2-eb66509038c9 tempest-TestMinimumBasicScenario-1660464696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdd3672d-46f1-468a-85a2-291222e2f0fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:28:01 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a676fb3f-d445-4448-90d2-eb66509038c9 tempest-TestMinimumBasicScenario-1660464696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dd30eba-0fd4-4b83-9609-4dcfa1f6dcdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:28:01 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a676fb3f-d445-4448-90d2-eb66509038c9 tempest-TestMinimumBasicScenario-1660464696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dd30eba-0fd4-4b83-9609-4dcfa1f6dcdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88e6a16c-40e1-4a72-886e-61af510fc570', 'volume_name': 'volume-88e6a16c-40e1-4a72-886e-61af510fc570', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:28:01 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a676fb3f-d445-4448-90d2-eb66509038c9 tempest-TestMinimumBasicScenario-1660464696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27dca36c-d21e-422b-a11e-2aaf74a6b522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:28:01 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a676fb3f-d445-4448-90d2-eb66509038c9 tempest-TestMinimumBasicScenario-1660464696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27dca36c-d21e-422b-a11e-2aaf74a6b522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:28:01 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a676fb3f-d445-4448-90d2-eb66509038c9 tempest-TestMinimumBasicScenario-1660464696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e2c869f-aaf8-4144-a579-3c1724d5fc14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:28:01 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-a676fb3f-d445-4448-90d2-eb66509038c9 tempest-TestMinimumBasicScenario-1660464696 None] Volume 88e6a16c-40e1-4a72-886e-61af510fc570: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88e6a16c-40e1-4a72-886e-61af510fc570', 'volume_size': 1} Aug 05 10:28:01 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a676fb3f-d445-4448-90d2-eb66509038c9 tempest-TestMinimumBasicScenario-1660464696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:28:07 devstack sudo[103440]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e6e0ca06-f07e-48cb-8461-2199bbfb8002 tempest-TestStampPattern-1347312802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6236f049-52b3-4312-ae8a-d9135aba9288 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-25f99c74-8969-493b-8711-65ccd62f0c80" returned: 0 in 7.832s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:07 devstack cinder-volume[88613]: DEBUG cinder.image.image_utils [None req-e6e0ca06-f07e-48cb-8461-2199bbfb8002 tempest-TestStampPattern-1347312802 None] Image conversion details: src /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6236f049-52b3-4312-ae8a-d9135aba9288, size 1024.00 MB, duration 7.84 sec, destination /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-25f99c74-8969-493b-8711-65ccd62f0c80 {{(pid=88613) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 10:28:07 devstack cinder-volume[88613]: INFO cinder.image.image_utils [None req-e6e0ca06-f07e-48cb-8461-2199bbfb8002 tempest-TestStampPattern-1347312802 None] Converted 1024.00 MB image at 130.69 MB/s Aug 05 10:28:07 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-e6e0ca06-f07e-48cb-8461-2199bbfb8002 tempest-TestStampPattern-1347312802 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-25f99c74-8969-493b-8711-65ccd62f0c80 is being set with open permissions: ugo+rw Aug 05 10:28:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e6e0ca06-f07e-48cb-8461-2199bbfb8002 tempest-TestStampPattern-1347312802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-25f99c74-8969-493b-8711-65ccd62f0c80 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:07 devstack sudo[103462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-25f99c74-8969-493b-8711-65ccd62f0c80 Aug 05 10:28:07 devstack sudo[103462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:07 devstack sudo[103462]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e6e0ca06-f07e-48cb-8461-2199bbfb8002 tempest-TestStampPattern-1347312802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-25f99c74-8969-493b-8711-65ccd62f0c80" returned: 0 in 0.423s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:07 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e6e0ca06-f07e-48cb-8461-2199bbfb8002 tempest-TestStampPattern-1347312802 None] Lock "cinder-quobyte-25f99c74-8969-493b-8711-65ccd62f0c80" released by "_copy_volume_from_snapshot" :: held 9.894s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:28:07 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e6e0ca06-f07e-48cb-8461-2199bbfb8002 tempest-TestStampPattern-1347312802 None] Lock "cinder-quobyte-e3210311-74ec-422e-9c30-8c96ef59a3b4-25f99c74-8969-493b-8711-65ccd62f0c80" released by "_create_volume_from_snapshot" :: held 10.007s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:28:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-e6e0ca06-f07e-48cb-8461-2199bbfb8002 tempest-TestStampPattern-1347312802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.028s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:28:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-746cff5a-e5f6-4d78-9831-7e5498b9176f req-e7f7e8e1-1da4-4c3d-bad2-ad8c3e6414bd tempest-TestShelveInstance-935146468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.656s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:28:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-746cff5a-e5f6-4d78-9831-7e5498b9176f req-e7f7e8e1-1da4-4c3d-bad2-ad8c3e6414bd tempest-TestShelveInstance-935146468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:28:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a676fb3f-d445-4448-90d2-eb66509038c9 tempest-TestMinimumBasicScenario-1660464696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.353s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:28:07 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-a676fb3f-d445-4448-90d2-eb66509038c9 tempest-TestMinimumBasicScenario-1660464696 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-937400548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88e6a16c-40e1-4a72-886e-61af510fc570,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c913d5db564b4f56b1d187faac713257',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:28:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:28:01Z,use_quota=True,user_id='e562841c69dd44f1b303e4288ad4ba1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:28:07 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-a676fb3f-d445-4448-90d2-eb66509038c9 tempest-TestMinimumBasicScenario-1660464696 None] Creating volume 88e6a16c-40e1-4a72-886e-61af510fc570 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:28:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a676fb3f-d445-4448-90d2-eb66509038c9 tempest-TestMinimumBasicScenario-1660464696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:28:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a676fb3f-d445-4448-90d2-eb66509038c9 tempest-TestMinimumBasicScenario-1660464696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:28:07 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-a676fb3f-d445-4448-90d2-eb66509038c9 tempest-TestMinimumBasicScenario-1660464696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:28:07 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-a676fb3f-d445-4448-90d2-eb66509038c9 tempest-TestMinimumBasicScenario-1660464696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:28:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a676fb3f-d445-4448-90d2-eb66509038c9 tempest-TestMinimumBasicScenario-1660464696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:28:07 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-a676fb3f-d445-4448-90d2-eb66509038c9 tempest-TestMinimumBasicScenario-1660464696 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:28:07 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-a676fb3f-d445-4448-90d2-eb66509038c9 tempest-TestMinimumBasicScenario-1660464696 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:28:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a676fb3f-d445-4448-90d2-eb66509038c9 tempest-TestMinimumBasicScenario-1660464696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-88e6a16c-40e1-4a72-886e-61af510fc570 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:07 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-e6e0ca06-f07e-48cb-8461-2199bbfb8002 tempest-TestStampPattern-1347312802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4fdd149-a9bb-4325-9f21-d462d6097e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25f99c74-8969-493b-8711-65ccd62f0c80', 'volume_size': 1, 'snapshot_id': 'e3210311-74ec-422e-9c30-8c96ef59a3b4'}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:28:07 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-e6e0ca06-f07e-48cb-8461-2199bbfb8002 tempest-TestStampPattern-1347312802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f94dc4da-815b-4285-a3b3-dfa39845b440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:28:07 devstack sudo[103465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-88e6a16c-40e1-4a72-886e-61af510fc570 1073741824 Aug 05 10:28:07 devstack sudo[103465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:07 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-e6e0ca06-f07e-48cb-8461-2199bbfb8002 tempest-TestStampPattern-1347312802 None] Volume volume-25f99c74-8969-493b-8711-65ccd62f0c80 (25f99c74-8969-493b-8711-65ccd62f0c80): created successfully Aug 05 10:28:07 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-e6e0ca06-f07e-48cb-8461-2199bbfb8002 tempest-TestStampPattern-1347312802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f94dc4da-815b-4285-a3b3-dfa39845b440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:28:07 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-e6e0ca06-f07e-48cb-8461-2199bbfb8002 tempest-TestStampPattern-1347312802 None] Flow 'volume_create_manager' (fed6b9ab-1ca0-4440-a30c-5abf49a2603d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:28:08 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [req-746cff5a-e5f6-4d78-9831-7e5498b9176f req-e7f7e8e1-1da4-4c3d-bad2-ad8c3e6414bd tempest-TestShelveInstance-935146468 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1', 'name': 'volume-6fe47a64-a0d9-4e29-92ca-7b581432d637', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '692cb34c-89f1-424e-b703-827562b14100', 'enforce_multipath': True} {{(pid=88613) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 10:28:08 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-e6e0ca06-f07e-48cb-8461-2199bbfb8002 tempest-TestStampPattern-1347312802 None] Created volume successfully. Aug 05 10:28:08 devstack cinder-volume[88613]: INFO cinder.volume.manager [req-746cff5a-e5f6-4d78-9831-7e5498b9176f req-e7f7e8e1-1da4-4c3d-bad2-ad8c3e6414bd tempest-TestShelveInstance-935146468 None] attachment_update completed successfully. Aug 05 10:28:08 devstack sudo[103465]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a676fb3f-d445-4448-90d2-eb66509038c9 tempest-TestMinimumBasicScenario-1660464696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-88e6a16c-40e1-4a72-886e-61af510fc570 1073741824" returned: 0 in 1.030s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a676fb3f-d445-4448-90d2-eb66509038c9 tempest-TestMinimumBasicScenario-1660464696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-88e6a16c-40e1-4a72-886e-61af510fc570 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:09 devstack sudo[103504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-88e6a16c-40e1-4a72-886e-61af510fc570 Aug 05 10:28:09 devstack sudo[103504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:09 devstack sudo[103504]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a676fb3f-d445-4448-90d2-eb66509038c9 tempest-TestMinimumBasicScenario-1660464696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-88e6a16c-40e1-4a72-886e-61af510fc570" returned: 0 in 0.369s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:09 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-a676fb3f-d445-4448-90d2-eb66509038c9 tempest-TestMinimumBasicScenario-1660464696 None] <== create_volume: return (1470ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:28:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a676fb3f-d445-4448-90d2-eb66509038c9 tempest-TestMinimumBasicScenario-1660464696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.473s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:28:09 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a676fb3f-d445-4448-90d2-eb66509038c9 tempest-TestMinimumBasicScenario-1660464696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e2c869f-aaf8-4144-a579-3c1724d5fc14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88e6a16c-40e1-4a72-886e-61af510fc570', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:28:09 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a676fb3f-d445-4448-90d2-eb66509038c9 tempest-TestMinimumBasicScenario-1660464696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01f4da40-a619-4273-8077-f8aa2782efa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:28:09 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-a676fb3f-d445-4448-90d2-eb66509038c9 tempest-TestMinimumBasicScenario-1660464696 None] Volume volume-88e6a16c-40e1-4a72-886e-61af510fc570 (88e6a16c-40e1-4a72-886e-61af510fc570): created successfully Aug 05 10:28:09 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a676fb3f-d445-4448-90d2-eb66509038c9 tempest-TestMinimumBasicScenario-1660464696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01f4da40-a619-4273-8077-f8aa2782efa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:28:09 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a676fb3f-d445-4448-90d2-eb66509038c9 tempest-TestMinimumBasicScenario-1660464696 None] Flow 'volume_create_manager' (5bdda1e1-3b5b-4010-9fbc-38838d09bea2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:28:09 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-a676fb3f-d445-4448-90d2-eb66509038c9 tempest-TestMinimumBasicScenario-1660464696 None] Created volume successfully. Aug 05 10:28:11 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-ecfaf0df-4449-46f1-bf23-aa9c28163627 req-dd9b8a89-d1a3-40cb-bb3c-6dd58a58b1e0 tempest-TestMinimumBasicScenario-1660464696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:28:11 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-ecfaf0df-4449-46f1-bf23-aa9c28163627 req-dd9b8a89-d1a3-40cb-bb3c-6dd58a58b1e0 tempest-TestMinimumBasicScenario-1660464696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:28:11 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-ecfaf0df-4449-46f1-bf23-aa9c28163627 req-dd9b8a89-d1a3-40cb-bb3c-6dd58a58b1e0 tempest-TestMinimumBasicScenario-1660464696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:28:11 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [req-ecfaf0df-4449-46f1-bf23-aa9c28163627 req-dd9b8a89-d1a3-40cb-bb3c-6dd58a58b1e0 tempest-TestMinimumBasicScenario-1660464696 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1', 'name': 'volume-88e6a16c-40e1-4a72-886e-61af510fc570', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '253ecaa9-7e9e-42ac-888a-59068d00968f', 'enforce_multipath': True} {{(pid=88613) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 10:28:11 devstack cinder-volume[88613]: INFO cinder.volume.manager [req-ecfaf0df-4449-46f1-bf23-aa9c28163627 req-dd9b8a89-d1a3-40cb-bb3c-6dd58a58b1e0 tempest-TestMinimumBasicScenario-1660464696 None] attachment_update completed successfully. Aug 05 10:28:21 devstack cinder-volume[88613]: DEBUG oslo_service.periodic_task [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88613) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:28:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:28:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:28:21 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:28:21 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:28:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:28:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:21 devstack sudo[104073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:28:21 devstack cinder-volume[88613]: DEBUG dbcounter [-] [88613] Writing DB stats cinder:SELECT=33,cinder:INSERT=2,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=88613) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:28:21 devstack sudo[104073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:21 devstack cinder-volume[88613]: DEBUG dbcounter [-] [88613] Writing DB stats cinder:SELECT=28,cinder:UPDATE=17,cinder:DELETE=2,cinder:INSERT=1 {{(pid=88613) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:28:22 devstack sudo[104073]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.422s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:22 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:28:22 devstack cinder-volume[88613]: DEBUG oslo_service.periodic_task [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Running periodic task VolumeManager._thread_info {{(pid=88613) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:28:22 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] thread count: 28 {{(pid=88613) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 10:28:22 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] thread info: [<_MainThread(MainThread, started 126173666128000)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88613) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 10:28:38 devstack cinder-volume[88613]: DEBUG dbcounter [-] [88613] Writing DB stats cinder:SELECT=1 {{(pid=88613) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:28:38 devstack cinder-volume[88613]: DEBUG dbcounter [-] [88613] Writing DB stats cinder:UPDATE=1 {{(pid=88613) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:28:42 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-f0803a42-bb0e-4bdc-aaf1-c0ce8182c197 req-aa3d2232-fb48-42e0-bee6-b95cdd1ba45e tempest-TestStampPattern-1347312802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:28:42 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-f0803a42-bb0e-4bdc-aaf1-c0ce8182c197 req-aa3d2232-fb48-42e0-bee6-b95cdd1ba45e tempest-TestStampPattern-1347312802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:28:42 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-f0803a42-bb0e-4bdc-aaf1-c0ce8182c197 req-aa3d2232-fb48-42e0-bee6-b95cdd1ba45e tempest-TestStampPattern-1347312802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:28:42 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [req-f0803a42-bb0e-4bdc-aaf1-c0ce8182c197 req-aa3d2232-fb48-42e0-bee6-b95cdd1ba45e tempest-TestStampPattern-1347312802 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1', 'name': 'volume-25f99c74-8969-493b-8711-65ccd62f0c80', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f0254c88-c07b-468f-a2fd-eef2e1afd90b', 'enforce_multipath': True} {{(pid=88613) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 10:28:42 devstack cinder-volume[88613]: INFO cinder.volume.manager [req-f0803a42-bb0e-4bdc-aaf1-c0ce8182c197 req-aa3d2232-fb48-42e0-bee6-b95cdd1ba45e tempest-TestStampPattern-1347312802 None] attachment_update completed successfully. Aug 05 10:28:45 devstack cinder-volume[88613]: INFO cinder.volume.manager [req-5ee6a4e7-0562-4df8-813e-540972578503 req-2efa60c1-049d-4654-a0eb-a7e92b3ee4ce tempest-TestStampPattern-1347312802 None] Terminate volume connection completed successfully. Aug 05 10:28:45 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [req-5ee6a4e7-0562-4df8-813e-540972578503 req-2efa60c1-049d-4654-a0eb-a7e92b3ee4ce tempest-TestStampPattern-1347312802 None] Deleting attachment f0254c88-c07b-468f-a2fd-eef2e1afd90b. {{(pid=88613) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 10:28:50 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-067fa8fd-32d5-42dd-86fd-91b589a49c22 tempest-TestStampPattern-1347312802 None] Acquiring lock "cinder-25f99c74-8969-493b-8711-65ccd62f0c80-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:28:50 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-067fa8fd-32d5-42dd-86fd-91b589a49c22 tempest-TestStampPattern-1347312802 None] Lock "cinder-25f99c74-8969-493b-8711-65ccd62f0c80-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:28:50 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-067fa8fd-32d5-42dd-86fd-91b589a49c22 tempest-TestStampPattern-1347312802 None] Acquiring lock "cinder-quobyte-25f99c74-8969-493b-8711-65ccd62f0c80" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:28:50 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-067fa8fd-32d5-42dd-86fd-91b589a49c22 tempest-TestStampPattern-1347312802 None] Lock "cinder-quobyte-25f99c74-8969-493b-8711-65ccd62f0c80" acquired by "delete_volume" :: waited 0.016s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:28:50 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[43fa9646-bcf4-49bf-b5c6-a8d5093efd42]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:28:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-067fa8fd-32d5-42dd-86fd-91b589a49c22 tempest-TestStampPattern-1347312802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-25f99c74-8969-493b-8711-65ccd62f0c80 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:50 devstack sudo[104270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-25f99c74-8969-493b-8711-65ccd62f0c80 Aug 05 10:28:50 devstack sudo[104270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:50 devstack sudo[104270]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-067fa8fd-32d5-42dd-86fd-91b589a49c22 tempest-TestStampPattern-1347312802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-25f99c74-8969-493b-8711-65ccd62f0c80" returned: 0 in 0.368s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-067fa8fd-32d5-42dd-86fd-91b589a49c22 tempest-TestStampPattern-1347312802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-25f99c74-8969-493b-8711-65ccd62f0c80 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:50 devstack sudo[104275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-25f99c74-8969-493b-8711-65ccd62f0c80 Aug 05 10:28:50 devstack sudo[104275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:50 devstack sudo[104275]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-067fa8fd-32d5-42dd-86fd-91b589a49c22 tempest-TestStampPattern-1347312802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-25f99c74-8969-493b-8711-65ccd62f0c80" returned: 0 in 0.241s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:50 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-067fa8fd-32d5-42dd-86fd-91b589a49c22 tempest-TestStampPattern-1347312802 None] Lock "cinder-quobyte-25f99c74-8969-493b-8711-65ccd62f0c80" released by "delete_volume" :: held 0.649s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:28:51 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-067fa8fd-32d5-42dd-86fd-91b589a49c22 tempest-TestStampPattern-1347312802 None] Created reservations ['07f2a887-5686-43d0-9187-5e89e3222e67', 'ec909acc-eee6-4a71-aef6-f649cd880de7', 'cad3f1a2-b930-4af3-a190-cc42d2cfa3ec', 'f17e45c0-09b2-4445-80d1-8f0d728b8d53'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:28:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-067fa8fd-32d5-42dd-86fd-91b589a49c22 tempest-TestStampPattern-1347312802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:28:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-067fa8fd-32d5-42dd-86fd-91b589a49c22 tempest-TestStampPattern-1347312802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:28:51 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-067fa8fd-32d5-42dd-86fd-91b589a49c22 tempest-TestStampPattern-1347312802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:28:51 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-067fa8fd-32d5-42dd-86fd-91b589a49c22 tempest-TestStampPattern-1347312802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:28:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-067fa8fd-32d5-42dd-86fd-91b589a49c22 tempest-TestStampPattern-1347312802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:28:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-067fa8fd-32d5-42dd-86fd-91b589a49c22 tempest-TestStampPattern-1347312802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:51 devstack sudo[104278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:28:51 devstack sudo[104278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:51 devstack sudo[104278]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-067fa8fd-32d5-42dd-86fd-91b589a49c22 tempest-TestStampPattern-1347312802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.248s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:51 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-067fa8fd-32d5-42dd-86fd-91b589a49c22 tempest-TestStampPattern-1347312802 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:28:51 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-067fa8fd-32d5-42dd-86fd-91b589a49c22 tempest-TestStampPattern-1347312802 None] Deleted volume successfully. Aug 05 10:28:51 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-067fa8fd-32d5-42dd-86fd-91b589a49c22 tempest-TestStampPattern-1347312802 None] Lock "cinder-25f99c74-8969-493b-8711-65ccd62f0c80-delete_volume" released by "delete_volume" :: held 1.086s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:28:51 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-87559c98-67ef-4c11-8c14-26e6bef5924f tempest-TestStampPattern-1347312802 None] Acquiring lock "cinder-e3210311-74ec-422e-9c30-8c96ef59a3b4-delete_snapshot" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:28:51 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-87559c98-67ef-4c11-8c14-26e6bef5924f tempest-TestStampPattern-1347312802 None] Lock "cinder-e3210311-74ec-422e-9c30-8c96ef59a3b4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:28:51 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-87559c98-67ef-4c11-8c14-26e6bef5924f tempest-TestStampPattern-1347312802 None] Acquiring lock "cinder-quobyte-6236f049-52b3-4312-ae8a-d9135aba9288" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:28:51 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-87559c98-67ef-4c11-8c14-26e6bef5924f tempest-TestStampPattern-1347312802 None] Lock "cinder-quobyte-6236f049-52b3-4312-ae8a-d9135aba9288" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:28:51 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-87559c98-67ef-4c11-8c14-26e6bef5924f tempest-TestStampPattern-1347312802 None] Acquiring lock "cinder-quobyte-e3210311-74ec-422e-9c30-8c96ef59a3b4" by "_delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:28:51 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-87559c98-67ef-4c11-8c14-26e6bef5924f tempest-TestStampPattern-1347312802 None] Lock "cinder-quobyte-e3210311-74ec-422e-9c30-8c96ef59a3b4" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:28:51 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-87559c98-67ef-4c11-8c14-26e6bef5924f tempest-TestStampPattern-1347312802 None] Deleting offline snapshot e3210311-74ec-422e-9c30-8c96ef59a3b4 of volume 6236f049-52b3-4312-ae8a-d9135aba9288 {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:28:51 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-87559c98-67ef-4c11-8c14-26e6bef5924f tempest-TestStampPattern-1347312802 None] snapshot_file for this snap is: volume-6236f049-52b3-4312-ae8a-d9135aba9288.e3210311-74ec-422e-9c30-8c96ef59a3b4 {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:28:51 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b39c1d-b8cc-48fe-aeed-ac9593bb1c15]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:28:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-87559c98-67ef-4c11-8c14-26e6bef5924f tempest-TestStampPattern-1347312802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6236f049-52b3-4312-ae8a-d9135aba9288.e3210311-74ec-422e-9c30-8c96ef59a3b4 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:51 devstack sudo[104281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6236f049-52b3-4312-ae8a-d9135aba9288.e3210311-74ec-422e-9c30-8c96ef59a3b4 Aug 05 10:28:51 devstack sudo[104281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:52 devstack sudo[104281]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-87559c98-67ef-4c11-8c14-26e6bef5924f tempest-TestStampPattern-1347312802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6236f049-52b3-4312-ae8a-d9135aba9288.e3210311-74ec-422e-9c30-8c96ef59a3b4" returned: 0 in 0.364s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:52 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-87559c98-67ef-4c11-8c14-26e6bef5924f tempest-TestStampPattern-1347312802 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6236f049-52b3-4312-ae8a-d9135aba9288(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88613) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:28:52 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[4832c1a1-641c-4af2-86d4-f8daa2e435cf]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:28:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-87559c98-67ef-4c11-8c14-26e6bef5924f tempest-TestStampPattern-1347312802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6236f049-52b3-4312-ae8a-d9135aba9288 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:52 devstack sudo[104286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6236f049-52b3-4312-ae8a-d9135aba9288 Aug 05 10:28:52 devstack sudo[104286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:52 devstack sudo[104286]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-87559c98-67ef-4c11-8c14-26e6bef5924f tempest-TestStampPattern-1347312802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6236f049-52b3-4312-ae8a-d9135aba9288" returned: 0 in 0.532s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-87559c98-67ef-4c11-8c14-26e6bef5924f tempest-TestStampPattern-1347312802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6236f049-52b3-4312-ae8a-d9135aba9288.e3210311-74ec-422e-9c30-8c96ef59a3b4 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:52 devstack sudo[104291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6236f049-52b3-4312-ae8a-d9135aba9288.e3210311-74ec-422e-9c30-8c96ef59a3b4 Aug 05 10:28:52 devstack sudo[104291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:53 devstack sudo[104291]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-87559c98-67ef-4c11-8c14-26e6bef5924f tempest-TestStampPattern-1347312802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6236f049-52b3-4312-ae8a-d9135aba9288.e3210311-74ec-422e-9c30-8c96ef59a3b4" returned: 0 in 0.344s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-87559c98-67ef-4c11-8c14-26e6bef5924f tempest-TestStampPattern-1347312802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6236f049-52b3-4312-ae8a-d9135aba9288.e3210311-74ec-422e-9c30-8c96ef59a3b4 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:53 devstack sudo[104296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6236f049-52b3-4312-ae8a-d9135aba9288.e3210311-74ec-422e-9c30-8c96ef59a3b4 Aug 05 10:28:53 devstack sudo[104296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:53 devstack sudo[104296]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-87559c98-67ef-4c11-8c14-26e6bef5924f tempest-TestStampPattern-1347312802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6236f049-52b3-4312-ae8a-d9135aba9288.e3210311-74ec-422e-9c30-8c96ef59a3b4" returned: 0 in 0.253s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:53 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-87559c98-67ef-4c11-8c14-26e6bef5924f tempest-TestStampPattern-1347312802 None] Lock "cinder-quobyte-e3210311-74ec-422e-9c30-8c96ef59a3b4" released by "_delete_snapshot" :: held 1.600s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:28:53 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-87559c98-67ef-4c11-8c14-26e6bef5924f tempest-TestStampPattern-1347312802 None] Lock "cinder-quobyte-6236f049-52b3-4312-ae8a-d9135aba9288" released by "delete_snapshot" :: held 1.623s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:28:53 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-87559c98-67ef-4c11-8c14-26e6bef5924f tempest-TestStampPattern-1347312802 None] Created reservations ['d86ca61c-f12a-4771-ba6d-2aa717fb4c14', '41e229f7-ce2f-40c9-9aa1-761ad87986ca', 'c11d634a-2742-4498-9eb1-64331ab89adb', '79fa186f-4d05-41be-b27b-78e7619eb4e2'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:28:53 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-87559c98-67ef-4c11-8c14-26e6bef5924f tempest-TestStampPattern-1347312802 None] Delete snapshot completed successfully. Aug 05 10:28:53 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-87559c98-67ef-4c11-8c14-26e6bef5924f tempest-TestStampPattern-1347312802 None] Lock "cinder-e3210311-74ec-422e-9c30-8c96ef59a3b4-delete_snapshot" released by "delete_snapshot" :: held 1.759s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:28:57 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-221ceb1e-2479-4fc2-b973-2b5acbdeb1dd tempest-TestStampPattern-1347312802 None] Acquiring lock "cinder-6236f049-52b3-4312-ae8a-d9135aba9288-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:28:57 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-221ceb1e-2479-4fc2-b973-2b5acbdeb1dd tempest-TestStampPattern-1347312802 None] Lock "cinder-6236f049-52b3-4312-ae8a-d9135aba9288-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:28:57 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-221ceb1e-2479-4fc2-b973-2b5acbdeb1dd tempest-TestStampPattern-1347312802 None] Acquiring lock "cinder-quobyte-6236f049-52b3-4312-ae8a-d9135aba9288" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:28:57 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-221ceb1e-2479-4fc2-b973-2b5acbdeb1dd tempest-TestStampPattern-1347312802 None] Lock "cinder-quobyte-6236f049-52b3-4312-ae8a-d9135aba9288" acquired by "delete_volume" :: waited 0.016s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:28:57 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6755218-549a-4a97-86ca-a1897ce6a600]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:28:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-221ceb1e-2479-4fc2-b973-2b5acbdeb1dd tempest-TestStampPattern-1347312802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6236f049-52b3-4312-ae8a-d9135aba9288 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:57 devstack sudo[104334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6236f049-52b3-4312-ae8a-d9135aba9288 Aug 05 10:28:57 devstack sudo[104334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:58 devstack sudo[104334]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-221ceb1e-2479-4fc2-b973-2b5acbdeb1dd tempest-TestStampPattern-1347312802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6236f049-52b3-4312-ae8a-d9135aba9288" returned: 0 in 0.423s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-221ceb1e-2479-4fc2-b973-2b5acbdeb1dd tempest-TestStampPattern-1347312802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6236f049-52b3-4312-ae8a-d9135aba9288 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:58 devstack sudo[104340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6236f049-52b3-4312-ae8a-d9135aba9288 Aug 05 10:28:58 devstack sudo[104340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:58 devstack sudo[104340]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-221ceb1e-2479-4fc2-b973-2b5acbdeb1dd tempest-TestStampPattern-1347312802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6236f049-52b3-4312-ae8a-d9135aba9288" returned: 0 in 0.306s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:58 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-221ceb1e-2479-4fc2-b973-2b5acbdeb1dd tempest-TestStampPattern-1347312802 None] Lock "cinder-quobyte-6236f049-52b3-4312-ae8a-d9135aba9288" released by "delete_volume" :: held 0.815s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:28:58 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-221ceb1e-2479-4fc2-b973-2b5acbdeb1dd tempest-TestStampPattern-1347312802 None] Created reservations ['79224c3c-796a-4c67-a610-c4e8b6173db9', '23a02f28-fb46-420f-9531-487ccc951fbe', '03009596-4c6a-46ba-b6af-c4ed7b34bce0', '096556a3-ac59-4e4b-b280-a344fa92a5da'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:28:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-221ceb1e-2479-4fc2-b973-2b5acbdeb1dd tempest-TestStampPattern-1347312802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:28:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-221ceb1e-2479-4fc2-b973-2b5acbdeb1dd tempest-TestStampPattern-1347312802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:28:58 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-221ceb1e-2479-4fc2-b973-2b5acbdeb1dd tempest-TestStampPattern-1347312802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:28:58 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-221ceb1e-2479-4fc2-b973-2b5acbdeb1dd tempest-TestStampPattern-1347312802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:28:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-221ceb1e-2479-4fc2-b973-2b5acbdeb1dd tempest-TestStampPattern-1347312802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:28:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-221ceb1e-2479-4fc2-b973-2b5acbdeb1dd tempest-TestStampPattern-1347312802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:58 devstack sudo[104358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:28:58 devstack sudo[104358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:59 devstack sudo[104358]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-221ceb1e-2479-4fc2-b973-2b5acbdeb1dd tempest-TestStampPattern-1347312802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.497s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:59 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-221ceb1e-2479-4fc2-b973-2b5acbdeb1dd tempest-TestStampPattern-1347312802 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:28:59 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-221ceb1e-2479-4fc2-b973-2b5acbdeb1dd tempest-TestStampPattern-1347312802 None] Deleted volume successfully. Aug 05 10:28:59 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-221ceb1e-2479-4fc2-b973-2b5acbdeb1dd tempest-TestStampPattern-1347312802 None] Lock "cinder-6236f049-52b3-4312-ae8a-d9135aba9288-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:29:00 devstack cinder-volume[88613]: INFO cinder.volume.manager [req-1d84f445-d1ae-4674-a50e-d3238b710862 req-4ac19bdb-c6e8-4e95-9ea1-c7786a03774d tempest-TestShelveInstance-935146468 None] Terminate volume connection completed successfully. Aug 05 10:29:00 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [req-1d84f445-d1ae-4674-a50e-d3238b710862 req-4ac19bdb-c6e8-4e95-9ea1-c7786a03774d tempest-TestShelveInstance-935146468 None] Deleting attachment 692cb34c-89f1-424e-b703-827562b14100. {{(pid=88613) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 10:29:00 devstack cinder-volume[88613]: DEBUG cinder.coordination [req-1d84f445-d1ae-4674-a50e-d3238b710862 req-b2a23517-55b1-40d6-90a7-b7c4d1563607 tempest-TestShelveInstance-935146468 None] Acquiring lock "cinder-6fe47a64-a0d9-4e29-92ca-7b581432d637-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:29:00 devstack cinder-volume[88613]: DEBUG cinder.coordination [req-1d84f445-d1ae-4674-a50e-d3238b710862 req-b2a23517-55b1-40d6-90a7-b7c4d1563607 tempest-TestShelveInstance-935146468 None] Lock "cinder-6fe47a64-a0d9-4e29-92ca-7b581432d637-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:29:00 devstack cinder-volume[88613]: DEBUG cinder.coordination [req-1d84f445-d1ae-4674-a50e-d3238b710862 req-b2a23517-55b1-40d6-90a7-b7c4d1563607 tempest-TestShelveInstance-935146468 None] Acquiring lock "cinder-quobyte-6fe47a64-a0d9-4e29-92ca-7b581432d637" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:29:00 devstack cinder-volume[88613]: DEBUG cinder.coordination [req-1d84f445-d1ae-4674-a50e-d3238b710862 req-b2a23517-55b1-40d6-90a7-b7c4d1563607 tempest-TestShelveInstance-935146468 None] Lock "cinder-quobyte-6fe47a64-a0d9-4e29-92ca-7b581432d637" acquired by "delete_volume" :: waited 0.018s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:29:00 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc413c73-b9d0-4b86-aa9e-447eaf3d30b7]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:29:00 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [req-1d84f445-d1ae-4674-a50e-d3238b710862 req-b2a23517-55b1-40d6-90a7-b7c4d1563607 tempest-TestShelveInstance-935146468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6fe47a64-a0d9-4e29-92ca-7b581432d637 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:00 devstack sudo[104410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6fe47a64-a0d9-4e29-92ca-7b581432d637 Aug 05 10:29:00 devstack sudo[104410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:01 devstack sudo[104410]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:01 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [req-1d84f445-d1ae-4674-a50e-d3238b710862 req-b2a23517-55b1-40d6-90a7-b7c4d1563607 tempest-TestShelveInstance-935146468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6fe47a64-a0d9-4e29-92ca-7b581432d637" returned: 0 in 0.377s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:01 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [req-1d84f445-d1ae-4674-a50e-d3238b710862 req-b2a23517-55b1-40d6-90a7-b7c4d1563607 tempest-TestShelveInstance-935146468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6fe47a64-a0d9-4e29-92ca-7b581432d637 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:01 devstack sudo[104415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6fe47a64-a0d9-4e29-92ca-7b581432d637 Aug 05 10:29:01 devstack sudo[104415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:01 devstack sudo[104415]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:01 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [req-1d84f445-d1ae-4674-a50e-d3238b710862 req-b2a23517-55b1-40d6-90a7-b7c4d1563607 tempest-TestShelveInstance-935146468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6fe47a64-a0d9-4e29-92ca-7b581432d637" returned: 0 in 0.298s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:01 devstack cinder-volume[88613]: DEBUG cinder.coordination [req-1d84f445-d1ae-4674-a50e-d3238b710862 req-b2a23517-55b1-40d6-90a7-b7c4d1563607 tempest-TestShelveInstance-935146468 None] Lock "cinder-quobyte-6fe47a64-a0d9-4e29-92ca-7b581432d637" released by "delete_volume" :: held 0.753s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:29:01 devstack cinder-volume[88613]: DEBUG cinder.quota [req-1d84f445-d1ae-4674-a50e-d3238b710862 req-b2a23517-55b1-40d6-90a7-b7c4d1563607 tempest-TestShelveInstance-935146468 None] Created reservations ['5986c411-d962-46cf-a271-223236a2d022', '051e7d21-0382-41b6-b334-ebd85acd45c4', 'e53af172-4de3-4c23-badd-5b4a5277d743', '24990abd-2817-4070-8cb3-e0340cbce28e'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:29:01 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-1d84f445-d1ae-4674-a50e-d3238b710862 req-b2a23517-55b1-40d6-90a7-b7c4d1563607 tempest-TestShelveInstance-935146468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:01 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-1d84f445-d1ae-4674-a50e-d3238b710862 req-b2a23517-55b1-40d6-90a7-b7c4d1563607 tempest-TestShelveInstance-935146468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:01 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [req-1d84f445-d1ae-4674-a50e-d3238b710862 req-b2a23517-55b1-40d6-90a7-b7c4d1563607 tempest-TestShelveInstance-935146468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:29:01 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [req-1d84f445-d1ae-4674-a50e-d3238b710862 req-b2a23517-55b1-40d6-90a7-b7c4d1563607 tempest-TestShelveInstance-935146468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:29:01 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-1d84f445-d1ae-4674-a50e-d3238b710862 req-b2a23517-55b1-40d6-90a7-b7c4d1563607 tempest-TestShelveInstance-935146468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:01 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [req-1d84f445-d1ae-4674-a50e-d3238b710862 req-b2a23517-55b1-40d6-90a7-b7c4d1563607 tempest-TestShelveInstance-935146468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:01 devstack sudo[104418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:29:01 devstack sudo[104418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:02 devstack sudo[104418]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:02 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [req-1d84f445-d1ae-4674-a50e-d3238b710862 req-b2a23517-55b1-40d6-90a7-b7c4d1563607 tempest-TestShelveInstance-935146468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.267s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:02 devstack cinder-volume[88613]: DEBUG cinder.manager [req-1d84f445-d1ae-4674-a50e-d3238b710862 req-b2a23517-55b1-40d6-90a7-b7c4d1563607 tempest-TestShelveInstance-935146468 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:29:02 devstack cinder-volume[88613]: INFO cinder.volume.manager [req-1d84f445-d1ae-4674-a50e-d3238b710862 req-b2a23517-55b1-40d6-90a7-b7c4d1563607 tempest-TestShelveInstance-935146468 None] Deleted volume successfully. Aug 05 10:29:02 devstack cinder-volume[88613]: DEBUG cinder.coordination [req-1d84f445-d1ae-4674-a50e-d3238b710862 req-b2a23517-55b1-40d6-90a7-b7c4d1563607 tempest-TestShelveInstance-935146468 None] Lock "cinder-6fe47a64-a0d9-4e29-92ca-7b581432d637-delete_volume" released by "delete_volume" :: held 1.315s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:29:11 devstack cinder-volume[88613]: DEBUG dbcounter [-] [88613] Writing DB stats cinder:SELECT=29,cinder:UPDATE=30,cinder:INSERT=6,cinder:DELETE=2 {{(pid=88613) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:29:12 devstack cinder-volume[88613]: DEBUG dbcounter [-] [88613] Writing DB stats cinder:SELECT=29,cinder:UPDATE=32,cinder:INSERT=10,cinder:DELETE=1 {{(pid=88613) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:29:14 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-02b88754-c68c-41e5-a3a5-9c2d175285e6 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:29:14 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-02b88754-c68c-41e5-a3a5-9c2d175285e6 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] Flow 'volume_create_manager' (f55be24e-215a-46a4-8f8a-39ad77f3230e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:29:14 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-02b88754-c68c-41e5-a3a5-9c2d175285e6 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72a42851-ce9c-49e4-a1ff-7386f32671fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:14 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-02b88754-c68c-41e5-a3a5-9c2d175285e6 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72a42851-ce9c-49e4-a1ff-7386f32671fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:29:14Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbf0e083-c7af-45a5-a7cc-883784d7fe05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5689b10b1a4849b48c56b708715eeec4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:29:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:29:14Z,use_quota=True,user_id='405532d5bc3f4d9aa0d3ab3f8f265fcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15244692-1900-42c9-8501-6981f2cc4d6a),volume_type_id=15244692-1900-42c9-8501-6981f2cc4d6a)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:14 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-02b88754-c68c-41e5-a3a5-9c2d175285e6 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b848b678-61ca-4cde-bfb4-608b51d94123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:14 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-02b88754-c68c-41e5-a3a5-9c2d175285e6 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b848b678-61ca-4cde-bfb4-608b51d94123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:14 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-02b88754-c68c-41e5-a3a5-9c2d175285e6 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7cc8f2f-ab35-4218-a5ce-e1cb297941e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:14 devstack cinder-volume[88613]: DEBUG cinder.image.glance [None req-02b88754-c68c-41e5-a3a5-9c2d175285e6 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] Creating Keystone auth plugin from conf {{(pid=88613) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 05 10:29:14 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-a87c86ed-76cb-4796-84e5-197eae88a235 tempest-CreateVolumesFromImageTest-1196585107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:29:14 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a87c86ed-76cb-4796-84e5-197eae88a235 tempest-CreateVolumesFromImageTest-1196585107 None] Flow 'volume_create_manager' (0d258749-03be-43a3-833a-3b737667445d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:29:14 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a87c86ed-76cb-4796-84e5-197eae88a235 tempest-CreateVolumesFromImageTest-1196585107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c341e3a9-4273-4404-8f27-0a9de661aef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:14 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a87c86ed-76cb-4796-84e5-197eae88a235 tempest-CreateVolumesFromImageTest-1196585107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c341e3a9-4273-4404-8f27-0a9de661aef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:29:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-157099987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11136acc-c797-403c-ad62-bfb2c4d33ef6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45cb2f0d26a84f5d94fb80a5d2432bb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:29:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:29:14Z,use_quota=True,user_id='6e5cfaf8257847f5bc9db4a0a1a3b267',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:14 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a87c86ed-76cb-4796-84e5-197eae88a235 tempest-CreateVolumesFromImageTest-1196585107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac81e9fe-f5e7-4861-b481-2c4a04b4425a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:14 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a87c86ed-76cb-4796-84e5-197eae88a235 tempest-CreateVolumesFromImageTest-1196585107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac81e9fe-f5e7-4861-b481-2c4a04b4425a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:14 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a87c86ed-76cb-4796-84e5-197eae88a235 tempest-CreateVolumesFromImageTest-1196585107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ebe6eb5-3fdc-42e8-b9da-6ffa60bc9698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:14 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a87c86ed-76cb-4796-84e5-197eae88a235 tempest-CreateVolumesFromImageTest-1196585107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ebe6eb5-3fdc-42e8-b9da-6ffa60bc9698) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11136acc-c797-403c-ad62-bfb2c4d33ef6', 'volume_name': 'volume-11136acc-c797-403c-ad62-bfb2c4d33ef6', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:14 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a87c86ed-76cb-4796-84e5-197eae88a235 tempest-CreateVolumesFromImageTest-1196585107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1296db84-40c3-470b-bce7-57d3199cd6cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:14 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a87c86ed-76cb-4796-84e5-197eae88a235 tempest-CreateVolumesFromImageTest-1196585107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1296db84-40c3-470b-bce7-57d3199cd6cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:14 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a87c86ed-76cb-4796-84e5-197eae88a235 tempest-CreateVolumesFromImageTest-1196585107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0fb13ca-0b9a-48a7-bc31-163633cf8d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:14 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-a87c86ed-76cb-4796-84e5-197eae88a235 tempest-CreateVolumesFromImageTest-1196585107 None] Volume 11136acc-c797-403c-ad62-bfb2c4d33ef6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11136acc-c797-403c-ad62-bfb2c4d33ef6', 'volume_size': 1} Aug 05 10:29:14 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a87c86ed-76cb-4796-84e5-197eae88a235 tempest-CreateVolumesFromImageTest-1196585107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:14 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a87c86ed-76cb-4796-84e5-197eae88a235 tempest-CreateVolumesFromImageTest-1196585107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:14 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-a87c86ed-76cb-4796-84e5-197eae88a235 tempest-CreateVolumesFromImageTest-1196585107 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:29:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-157099987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11136acc-c797-403c-ad62-bfb2c4d33ef6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45cb2f0d26a84f5d94fb80a5d2432bb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:29:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:29:14Z,use_quota=True,user_id='6e5cfaf8257847f5bc9db4a0a1a3b267',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:29:14 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-a87c86ed-76cb-4796-84e5-197eae88a235 tempest-CreateVolumesFromImageTest-1196585107 None] Creating volume 11136acc-c797-403c-ad62-bfb2c4d33ef6 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:29:14 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a87c86ed-76cb-4796-84e5-197eae88a235 tempest-CreateVolumesFromImageTest-1196585107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:14 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a87c86ed-76cb-4796-84e5-197eae88a235 tempest-CreateVolumesFromImageTest-1196585107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:14 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-a87c86ed-76cb-4796-84e5-197eae88a235 tempest-CreateVolumesFromImageTest-1196585107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:29:14 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-a87c86ed-76cb-4796-84e5-197eae88a235 tempest-CreateVolumesFromImageTest-1196585107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:29:14 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a87c86ed-76cb-4796-84e5-197eae88a235 tempest-CreateVolumesFromImageTest-1196585107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:14 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-a87c86ed-76cb-4796-84e5-197eae88a235 tempest-CreateVolumesFromImageTest-1196585107 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:29:14 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-a87c86ed-76cb-4796-84e5-197eae88a235 tempest-CreateVolumesFromImageTest-1196585107 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:29:14 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a87c86ed-76cb-4796-84e5-197eae88a235 tempest-CreateVolumesFromImageTest-1196585107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-11136acc-c797-403c-ad62-bfb2c4d33ef6 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:14 devstack sudo[104443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-11136acc-c797-403c-ad62-bfb2c4d33ef6 1073741824 Aug 05 10:29:14 devstack sudo[104443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:15 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff37c2a1-1017-4db5-9c82-02b4458bc416 tempest-CreateVolumesFromImageTest-1196585107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:29:15 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ff37c2a1-1017-4db5-9c82-02b4458bc416 tempest-CreateVolumesFromImageTest-1196585107 None] Flow 'volume_create_manager' (e823b92a-b7f5-4839-89be-18b710d25098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:29:15 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ff37c2a1-1017-4db5-9c82-02b4458bc416 tempest-CreateVolumesFromImageTest-1196585107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efab14f6-e7d8-4994-acb1-36262d3b0211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:15 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ff37c2a1-1017-4db5-9c82-02b4458bc416 tempest-CreateVolumesFromImageTest-1196585107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efab14f6-e7d8-4994-acb1-36262d3b0211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:29:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1596395212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d99b5d84-c8de-4306-ab8d-c856fcbe9d2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45cb2f0d26a84f5d94fb80a5d2432bb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:29:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:29:15Z,use_quota=True,user_id='6e5cfaf8257847f5bc9db4a0a1a3b267',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:15 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ff37c2a1-1017-4db5-9c82-02b4458bc416 tempest-CreateVolumesFromImageTest-1196585107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fa39c2a-f1f4-48e1-a144-d4c400a65db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:15 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ff37c2a1-1017-4db5-9c82-02b4458bc416 tempest-CreateVolumesFromImageTest-1196585107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fa39c2a-f1f4-48e1-a144-d4c400a65db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:15 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ff37c2a1-1017-4db5-9c82-02b4458bc416 tempest-CreateVolumesFromImageTest-1196585107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2ff263d-1944-4eef-b6bc-be127f48033f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:15 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ff37c2a1-1017-4db5-9c82-02b4458bc416 tempest-CreateVolumesFromImageTest-1196585107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2ff263d-1944-4eef-b6bc-be127f48033f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd99b5d84-c8de-4306-ab8d-c856fcbe9d2b', 'volume_name': 'volume-d99b5d84-c8de-4306-ab8d-c856fcbe9d2b', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:15 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ff37c2a1-1017-4db5-9c82-02b4458bc416 tempest-CreateVolumesFromImageTest-1196585107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e6a1a36-2c28-40c2-b0f7-5d7bd2ce7490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:15 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ff37c2a1-1017-4db5-9c82-02b4458bc416 tempest-CreateVolumesFromImageTest-1196585107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e6a1a36-2c28-40c2-b0f7-5d7bd2ce7490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:15 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ff37c2a1-1017-4db5-9c82-02b4458bc416 tempest-CreateVolumesFromImageTest-1196585107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74c3a578-f207-40de-bdc3-27c0883a0636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:15 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-ff37c2a1-1017-4db5-9c82-02b4458bc416 tempest-CreateVolumesFromImageTest-1196585107 None] Volume d99b5d84-c8de-4306-ab8d-c856fcbe9d2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d99b5d84-c8de-4306-ab8d-c856fcbe9d2b', 'volume_size': 1} Aug 05 10:29:15 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-ff37c2a1-1017-4db5-9c82-02b4458bc416 tempest-CreateVolumesFromImageTest-1196585107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:15 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-02b88754-c68c-41e5-a3a5-9c2d175285e6 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7cc8f2f-ab35-4218-a5ce-e1cb297941e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'dbf0e083-c7af-45a5-a7cc-883784d7fe05', 'volume_name': 'volume-dbf0e083-c7af-45a5-a7cc-883784d7fe05', 'volume_size': 1, 'image_id': '724ae0cc-6a76-49c5-8bd8-0d26e2caf505', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/724ae0cc-6a76-49c5-8bd8-0d26e2caf505', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '795bab1308e2cd3292ee3c7138393d12', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5689b10b1a4849b48c56b708715eeec4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '08079fe83f04fd9be5636a74c7606685fd3689f0b76f2020c1f08b21e692e07574b84e7c591bcb8fa6a972714e47647680d3454ba1b32126646b7d0c2a0fbfab', 'id': '724ae0cc-6a76-49c5-8bd8-0d26e2caf505', 'created_at': datetime.datetime(2026, 8, 5, 8, 29, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 8, 29, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/724ae0cc-6a76-49c5-8bd8-0d26e2caf505/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:15 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-02b88754-c68c-41e5-a3a5-9c2d175285e6 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a09a49de-996f-4357-8d92-64032d080e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:15 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-02b88754-c68c-41e5-a3a5-9c2d175285e6 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a09a49de-996f-4357-8d92-64032d080e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:15 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-02b88754-c68c-41e5-a3a5-9c2d175285e6 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9af3e38f-ff1d-4f47-9232-c4c4e64e6cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:15 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-02b88754-c68c-41e5-a3a5-9c2d175285e6 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] Volume dbf0e083-c7af-45a5-a7cc-883784d7fe05: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-dbf0e083-c7af-45a5-a7cc-883784d7fe05', 'volume_size': 1, 'image_id': '724ae0cc-6a76-49c5-8bd8-0d26e2caf505', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/724ae0cc-6a76-49c5-8bd8-0d26e2caf505', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '795bab1308e2cd3292ee3c7138393d12', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5689b10b1a4849b48c56b708715eeec4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '08079fe83f04fd9be5636a74c7606685fd3689f0b76f2020c1f08b21e692e07574b84e7c591bcb8fa6a972714e47647680d3454ba1b32126646b7d0c2a0fbfab', 'id': '724ae0cc-6a76-49c5-8bd8-0d26e2caf505', 'created_at': datetime.datetime(2026, 8, 5, 8, 29, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 8, 29, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/724ae0cc-6a76-49c5-8bd8-0d26e2caf505/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Aug 05 10:29:15 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-02b88754-c68c-41e5-a3a5-9c2d175285e6 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] Trying to clone dbf0e083-c7af-45a5-a7cc-883784d7fe05 from image 724ae0cc-6a76-49c5-8bd8-0d26e2caf505 at location (None, [{'url': 'file:///opt/stack/data/glance/images/724ae0cc-6a76-49c5-8bd8-0d26e2caf505', 'metadata': {}}]). {{(pid=88613) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 05 10:29:15 devstack sudo[104443]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:15 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a87c86ed-76cb-4796-84e5-197eae88a235 tempest-CreateVolumesFromImageTest-1196585107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-11136acc-c797-403c-ad62-bfb2c4d33ef6 1073741824" returned: 0 in 0.701s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:15 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce88f3d0-6d33-4bc8-8b41-f01128e8b8ce tempest-CreateVolumesFromImageTest-1196585107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:29:15 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ce88f3d0-6d33-4bc8-8b41-f01128e8b8ce tempest-CreateVolumesFromImageTest-1196585107 None] Flow 'volume_create_manager' (31545cf5-c8ee-4caf-a669-7dfee2c328c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:29:15 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ce88f3d0-6d33-4bc8-8b41-f01128e8b8ce tempest-CreateVolumesFromImageTest-1196585107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (795e4675-2a4c-43e5-a740-f7f5a86ff85f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:15 devstack cinder-volume[88613]: DEBUG cinder.image.image_utils [None req-02b88754-c68c-41e5-a3a5-9c2d175285e6 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_724ae0cc-6a76-49c5-8bd8-0d26e2caf505_mhrc4xsrdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88613) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 05 10:29:15 devstack cinder-volume[88613]: INFO cinder.image.image_utils [None req-02b88754-c68c-41e5-a3a5-9c2d175285e6 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] Image download 0.00 MB at 0.00 MB/s Aug 05 10:29:15 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a87c86ed-76cb-4796-84e5-197eae88a235 tempest-CreateVolumesFromImageTest-1196585107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-11136acc-c797-403c-ad62-bfb2c4d33ef6 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:15 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ce88f3d0-6d33-4bc8-8b41-f01128e8b8ce tempest-CreateVolumesFromImageTest-1196585107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (795e4675-2a4c-43e5-a740-f7f5a86ff85f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:29:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-205649224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a3efff5-edb6-40f0-be6c-6a3b2c697497,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45cb2f0d26a84f5d94fb80a5d2432bb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:29:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:29:16Z,use_quota=True,user_id='6e5cfaf8257847f5bc9db4a0a1a3b267',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:15 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ce88f3d0-6d33-4bc8-8b41-f01128e8b8ce tempest-CreateVolumesFromImageTest-1196585107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c744f29-6d84-49d4-b9d4-2f097015858d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:15 devstack sudo[104450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-11136acc-c797-403c-ad62-bfb2c4d33ef6 Aug 05 10:29:15 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ce88f3d0-6d33-4bc8-8b41-f01128e8b8ce tempest-CreateVolumesFromImageTest-1196585107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c744f29-6d84-49d4-b9d4-2f097015858d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:15 devstack sudo[104450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:15 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ce88f3d0-6d33-4bc8-8b41-f01128e8b8ce tempest-CreateVolumesFromImageTest-1196585107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de97fc77-b756-4de4-be65-c2c78913cfde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:15 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ce88f3d0-6d33-4bc8-8b41-f01128e8b8ce tempest-CreateVolumesFromImageTest-1196585107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de97fc77-b756-4de4-be65-c2c78913cfde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a3efff5-edb6-40f0-be6c-6a3b2c697497', 'volume_name': 'volume-1a3efff5-edb6-40f0-be6c-6a3b2c697497', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:15 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ce88f3d0-6d33-4bc8-8b41-f01128e8b8ce tempest-CreateVolumesFromImageTest-1196585107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf14e479-4b2e-463a-9592-e75806b65308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:15 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ce88f3d0-6d33-4bc8-8b41-f01128e8b8ce tempest-CreateVolumesFromImageTest-1196585107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf14e479-4b2e-463a-9592-e75806b65308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:15 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ce88f3d0-6d33-4bc8-8b41-f01128e8b8ce tempest-CreateVolumesFromImageTest-1196585107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c592f2e-6e42-4d34-8614-371395034eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:15 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-ce88f3d0-6d33-4bc8-8b41-f01128e8b8ce tempest-CreateVolumesFromImageTest-1196585107 None] Volume 1a3efff5-edb6-40f0-be6c-6a3b2c697497: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a3efff5-edb6-40f0-be6c-6a3b2c697497', 'volume_size': 1} Aug 05 10:29:15 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-ce88f3d0-6d33-4bc8-8b41-f01128e8b8ce tempest-CreateVolumesFromImageTest-1196585107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:15 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[55fdc158-abc8-419e-905b-12b566beb83e]: (4, 'raw') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:29:15 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-02b88754-c68c-41e5-a3a5-9c2d175285e6 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_724ae0cc-6a76-49c5-8bd8-0d26e2caf505_mhrc4xsrdevstack@QuobyteHD {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:16 devstack sudo[104452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_724ae0cc-6a76-49c5-8bd8-0d26e2caf505_mhrc4xsrdevstack@QuobyteHD Aug 05 10:29:16 devstack sudo[104450]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:16 devstack sudo[104452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:16 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a87c86ed-76cb-4796-84e5-197eae88a235 tempest-CreateVolumesFromImageTest-1196585107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-11136acc-c797-403c-ad62-bfb2c4d33ef6" returned: 0 in 0.371s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:16 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-a87c86ed-76cb-4796-84e5-197eae88a235 tempest-CreateVolumesFromImageTest-1196585107 None] <== create_volume: return (1227ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:29:16 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a87c86ed-76cb-4796-84e5-197eae88a235 tempest-CreateVolumesFromImageTest-1196585107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.235s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:16 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-ff37c2a1-1017-4db5-9c82-02b4458bc416 tempest-CreateVolumesFromImageTest-1196585107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.765s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:16 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-ff37c2a1-1017-4db5-9c82-02b4458bc416 tempest-CreateVolumesFromImageTest-1196585107 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:29:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1596395212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d99b5d84-c8de-4306-ab8d-c856fcbe9d2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45cb2f0d26a84f5d94fb80a5d2432bb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:29:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:29:15Z,use_quota=True,user_id='6e5cfaf8257847f5bc9db4a0a1a3b267',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:29:16 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-ff37c2a1-1017-4db5-9c82-02b4458bc416 tempest-CreateVolumesFromImageTest-1196585107 None] Creating volume d99b5d84-c8de-4306-ab8d-c856fcbe9d2b {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:29:16 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-ff37c2a1-1017-4db5-9c82-02b4458bc416 tempest-CreateVolumesFromImageTest-1196585107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:16 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-ff37c2a1-1017-4db5-9c82-02b4458bc416 tempest-CreateVolumesFromImageTest-1196585107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:16 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-ff37c2a1-1017-4db5-9c82-02b4458bc416 tempest-CreateVolumesFromImageTest-1196585107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:29:16 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-ff37c2a1-1017-4db5-9c82-02b4458bc416 tempest-CreateVolumesFromImageTest-1196585107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:29:16 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-ff37c2a1-1017-4db5-9c82-02b4458bc416 tempest-CreateVolumesFromImageTest-1196585107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:16 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-ff37c2a1-1017-4db5-9c82-02b4458bc416 tempest-CreateVolumesFromImageTest-1196585107 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:29:16 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-ff37c2a1-1017-4db5-9c82-02b4458bc416 tempest-CreateVolumesFromImageTest-1196585107 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:29:16 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ff37c2a1-1017-4db5-9c82-02b4458bc416 tempest-CreateVolumesFromImageTest-1196585107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d99b5d84-c8de-4306-ab8d-c856fcbe9d2b 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:16 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a87c86ed-76cb-4796-84e5-197eae88a235 tempest-CreateVolumesFromImageTest-1196585107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0fb13ca-0b9a-48a7-bc31-163633cf8d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11136acc-c797-403c-ad62-bfb2c4d33ef6', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:16 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a87c86ed-76cb-4796-84e5-197eae88a235 tempest-CreateVolumesFromImageTest-1196585107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0093b9ab-7dea-49a6-879f-8fa96a4655ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:16 devstack sudo[104459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d99b5d84-c8de-4306-ab8d-c856fcbe9d2b 1073741824 Aug 05 10:29:16 devstack sudo[104459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:16 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-a87c86ed-76cb-4796-84e5-197eae88a235 tempest-CreateVolumesFromImageTest-1196585107 None] Volume volume-11136acc-c797-403c-ad62-bfb2c4d33ef6 (11136acc-c797-403c-ad62-bfb2c4d33ef6): created successfully Aug 05 10:29:16 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a87c86ed-76cb-4796-84e5-197eae88a235 tempest-CreateVolumesFromImageTest-1196585107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0093b9ab-7dea-49a6-879f-8fa96a4655ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:16 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a87c86ed-76cb-4796-84e5-197eae88a235 tempest-CreateVolumesFromImageTest-1196585107 None] Flow 'volume_create_manager' (0d258749-03be-43a3-833a-3b737667445d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:29:16 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-a87c86ed-76cb-4796-84e5-197eae88a235 tempest-CreateVolumesFromImageTest-1196585107 None] Created volume successfully. Aug 05 10:29:16 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d521e7d-de9c-4393-9225-4a0e117d3e42 tempest-CreateVolumesFromImageTest-1196585107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:29:16 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0d521e7d-de9c-4393-9225-4a0e117d3e42 tempest-CreateVolumesFromImageTest-1196585107 None] Flow 'volume_create_manager' (24ae9904-a987-41d5-b2b5-a19a7e065611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:29:16 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0d521e7d-de9c-4393-9225-4a0e117d3e42 tempest-CreateVolumesFromImageTest-1196585107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e6c39d1-d1ac-4327-ac8a-b995bc4000ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:16 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0d521e7d-de9c-4393-9225-4a0e117d3e42 tempest-CreateVolumesFromImageTest-1196585107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e6c39d1-d1ac-4327-ac8a-b995bc4000ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:29:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-187938887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=846cbe14-0cf8-4b96-a529-ce78ac4ad525,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45cb2f0d26a84f5d94fb80a5d2432bb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:29:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:29:16Z,use_quota=True,user_id='6e5cfaf8257847f5bc9db4a0a1a3b267',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:16 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0d521e7d-de9c-4393-9225-4a0e117d3e42 tempest-CreateVolumesFromImageTest-1196585107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc25c704-8b90-4057-b025-1ddc1355d034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:16 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0d521e7d-de9c-4393-9225-4a0e117d3e42 tempest-CreateVolumesFromImageTest-1196585107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc25c704-8b90-4057-b025-1ddc1355d034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:16 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0d521e7d-de9c-4393-9225-4a0e117d3e42 tempest-CreateVolumesFromImageTest-1196585107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5668b662-1880-4797-bae9-d933f3659d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:16 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0d521e7d-de9c-4393-9225-4a0e117d3e42 tempest-CreateVolumesFromImageTest-1196585107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5668b662-1880-4797-bae9-d933f3659d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '846cbe14-0cf8-4b96-a529-ce78ac4ad525', 'volume_name': 'volume-846cbe14-0cf8-4b96-a529-ce78ac4ad525', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:16 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0d521e7d-de9c-4393-9225-4a0e117d3e42 tempest-CreateVolumesFromImageTest-1196585107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c40a2859-43f4-4fc6-bc1c-ab6baed2b6c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:16 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0d521e7d-de9c-4393-9225-4a0e117d3e42 tempest-CreateVolumesFromImageTest-1196585107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c40a2859-43f4-4fc6-bc1c-ab6baed2b6c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:16 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0d521e7d-de9c-4393-9225-4a0e117d3e42 tempest-CreateVolumesFromImageTest-1196585107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d14a662d-1722-4fc3-9010-f39da8edbda6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:16 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-0d521e7d-de9c-4393-9225-4a0e117d3e42 tempest-CreateVolumesFromImageTest-1196585107 None] Volume 846cbe14-0cf8-4b96-a529-ce78ac4ad525: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-846cbe14-0cf8-4b96-a529-ce78ac4ad525', 'volume_size': 1} Aug 05 10:29:16 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-0d521e7d-de9c-4393-9225-4a0e117d3e42 tempest-CreateVolumesFromImageTest-1196585107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:16 devstack sudo[104452]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:16 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-02b88754-c68c-41e5-a3a5-9c2d175285e6 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_724ae0cc-6a76-49c5-8bd8-0d26e2caf505_mhrc4xsrdevstack@QuobyteHD" returned: 0 in 0.707s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:16 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-02b88754-c68c-41e5-a3a5-9c2d175285e6 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_724ae0cc-6a76-49c5-8bd8-0d26e2caf505_mhrc4xsrdevstack@QuobyteHD {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:16 devstack sudo[104463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_724ae0cc-6a76-49c5-8bd8-0d26e2caf505_mhrc4xsrdevstack@QuobyteHD Aug 05 10:29:16 devstack sudo[104463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:16 devstack sudo[104459]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:16 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ff37c2a1-1017-4db5-9c82-02b4458bc416 tempest-CreateVolumesFromImageTest-1196585107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d99b5d84-c8de-4306-ab8d-c856fcbe9d2b 1073741824" returned: 0 in 0.918s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:16 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e8ee2f8-9258-4a8e-a879-6b41827fdffb tempest-CreateVolumesFromImageTest-1196585107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:29:17 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-4e8ee2f8-9258-4a8e-a879-6b41827fdffb tempest-CreateVolumesFromImageTest-1196585107 None] Flow 'volume_create_manager' (425f9f9f-9bf8-4c4a-aff8-b184dbf55ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:29:17 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-4e8ee2f8-9258-4a8e-a879-6b41827fdffb tempest-CreateVolumesFromImageTest-1196585107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (002f9b48-9ee4-467d-b09b-37c4b08b0275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:17 devstack sudo[104463]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:17 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-4e8ee2f8-9258-4a8e-a879-6b41827fdffb tempest-CreateVolumesFromImageTest-1196585107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (002f9b48-9ee4-467d-b09b-37c4b08b0275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:29:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-300825199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fee6e5fd-334b-4f78-92b9-cdf5bbc5e556,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45cb2f0d26a84f5d94fb80a5d2432bb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:29:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:29:17Z,use_quota=True,user_id='6e5cfaf8257847f5bc9db4a0a1a3b267',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:17 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-4e8ee2f8-9258-4a8e-a879-6b41827fdffb tempest-CreateVolumesFromImageTest-1196585107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfd3931b-2889-4c2a-93e0-b07001f1729f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:17 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-4e8ee2f8-9258-4a8e-a879-6b41827fdffb tempest-CreateVolumesFromImageTest-1196585107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfd3931b-2889-4c2a-93e0-b07001f1729f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:17 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-4e8ee2f8-9258-4a8e-a879-6b41827fdffb tempest-CreateVolumesFromImageTest-1196585107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c290ad41-d083-4767-957d-f88ad2decafd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:17 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-4e8ee2f8-9258-4a8e-a879-6b41827fdffb tempest-CreateVolumesFromImageTest-1196585107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c290ad41-d083-4767-957d-f88ad2decafd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fee6e5fd-334b-4f78-92b9-cdf5bbc5e556', 'volume_name': 'volume-fee6e5fd-334b-4f78-92b9-cdf5bbc5e556', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:17 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-4e8ee2f8-9258-4a8e-a879-6b41827fdffb tempest-CreateVolumesFromImageTest-1196585107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0888419f-4312-43d9-8c1f-f180918811a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:17 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-4e8ee2f8-9258-4a8e-a879-6b41827fdffb tempest-CreateVolumesFromImageTest-1196585107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0888419f-4312-43d9-8c1f-f180918811a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:17 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-4e8ee2f8-9258-4a8e-a879-6b41827fdffb tempest-CreateVolumesFromImageTest-1196585107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (575b6ac0-653f-41df-90af-896827120d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:17 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-4e8ee2f8-9258-4a8e-a879-6b41827fdffb tempest-CreateVolumesFromImageTest-1196585107 None] Volume fee6e5fd-334b-4f78-92b9-cdf5bbc5e556: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fee6e5fd-334b-4f78-92b9-cdf5bbc5e556', 'volume_size': 1} Aug 05 10:29:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-4e8ee2f8-9258-4a8e-a879-6b41827fdffb tempest-CreateVolumesFromImageTest-1196585107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-02b88754-c68c-41e5-a3a5-9c2d175285e6 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_724ae0cc-6a76-49c5-8bd8-0d26e2caf505_mhrc4xsrdevstack@QuobyteHD" returned: 1 in 0.595s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-02b88754-c68c-41e5-a3a5-9c2d175285e6 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_724ae0cc-6a76-49c5-8bd8-0d26e2caf505_mhrc4xsrdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 10:29:17 devstack cinder-volume[88613]: DEBUG cinder.image.image_utils [None req-02b88754-c68c-41e5-a3a5-9c2d175285e6 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] Temporary image 724ae0cc-6a76-49c5-8bd8-0d26e2caf505 is fetched for user 405532d5bc3f4d9aa0d3ab3f8f265fcb. {{(pid=88613) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 05 10:29:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ff37c2a1-1017-4db5-9c82-02b4458bc416 tempest-CreateVolumesFromImageTest-1196585107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d99b5d84-c8de-4306-ab8d-c856fcbe9d2b {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:17 devstack sudo[104476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d99b5d84-c8de-4306-ab8d-c856fcbe9d2b Aug 05 10:29:17 devstack sudo[104476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:17 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5b7126-ff59-45da-af9a-fbec72d6661d]: (4, 'raw') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:29:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-02b88754-c68c-41e5-a3a5-9c2d175285e6 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_724ae0cc-6a76-49c5-8bd8-0d26e2caf505_mhrc4xsrdevstack@QuobyteHD {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:17 devstack sudo[104478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_724ae0cc-6a76-49c5-8bd8-0d26e2caf505_mhrc4xsrdevstack@QuobyteHD Aug 05 10:29:17 devstack sudo[104478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:17 devstack cinder-volume[88613]: INFO cinder.volume.manager [req-3ef90bdb-f90a-4b26-8508-3d9bf4eddf04 req-51088245-1a5f-4214-abcc-d199db3394ff tempest-TestMinimumBasicScenario-1660464696 None] Terminate volume connection completed successfully. Aug 05 10:29:17 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [req-3ef90bdb-f90a-4b26-8508-3d9bf4eddf04 req-51088245-1a5f-4214-abcc-d199db3394ff tempest-TestMinimumBasicScenario-1660464696 None] Deleting attachment 253ecaa9-7e9e-42ac-888a-59068d00968f. {{(pid=88613) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 10:29:17 devstack sudo[104476]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ff37c2a1-1017-4db5-9c82-02b4458bc416 tempest-CreateVolumesFromImageTest-1196585107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d99b5d84-c8de-4306-ab8d-c856fcbe9d2b" returned: 0 in 0.310s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:17 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-ff37c2a1-1017-4db5-9c82-02b4458bc416 tempest-CreateVolumesFromImageTest-1196585107 None] <== create_volume: return (1379ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:29:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-ff37c2a1-1017-4db5-9c82-02b4458bc416 tempest-CreateVolumesFromImageTest-1196585107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.381s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-ce88f3d0-6d33-4bc8-8b41-f01128e8b8ce tempest-CreateVolumesFromImageTest-1196585107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.681s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:17 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-ce88f3d0-6d33-4bc8-8b41-f01128e8b8ce tempest-CreateVolumesFromImageTest-1196585107 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:29:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-205649224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a3efff5-edb6-40f0-be6c-6a3b2c697497,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45cb2f0d26a84f5d94fb80a5d2432bb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:29:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:29:16Z,use_quota=True,user_id='6e5cfaf8257847f5bc9db4a0a1a3b267',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:29:17 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-ce88f3d0-6d33-4bc8-8b41-f01128e8b8ce tempest-CreateVolumesFromImageTest-1196585107 None] Creating volume 1a3efff5-edb6-40f0-be6c-6a3b2c697497 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:29:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-ce88f3d0-6d33-4bc8-8b41-f01128e8b8ce tempest-CreateVolumesFromImageTest-1196585107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-ce88f3d0-6d33-4bc8-8b41-f01128e8b8ce tempest-CreateVolumesFromImageTest-1196585107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:17 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-ce88f3d0-6d33-4bc8-8b41-f01128e8b8ce tempest-CreateVolumesFromImageTest-1196585107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:29:17 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-ce88f3d0-6d33-4bc8-8b41-f01128e8b8ce tempest-CreateVolumesFromImageTest-1196585107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:29:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-ce88f3d0-6d33-4bc8-8b41-f01128e8b8ce tempest-CreateVolumesFromImageTest-1196585107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:17 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-ce88f3d0-6d33-4bc8-8b41-f01128e8b8ce tempest-CreateVolumesFromImageTest-1196585107 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:29:17 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-ce88f3d0-6d33-4bc8-8b41-f01128e8b8ce tempest-CreateVolumesFromImageTest-1196585107 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:29:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ce88f3d0-6d33-4bc8-8b41-f01128e8b8ce tempest-CreateVolumesFromImageTest-1196585107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1a3efff5-edb6-40f0-be6c-6a3b2c697497 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:17 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ff37c2a1-1017-4db5-9c82-02b4458bc416 tempest-CreateVolumesFromImageTest-1196585107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74c3a578-f207-40de-bdc3-27c0883a0636) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d99b5d84-c8de-4306-ab8d-c856fcbe9d2b', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:17 devstack sudo[104484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1a3efff5-edb6-40f0-be6c-6a3b2c697497 1073741824 Aug 05 10:29:17 devstack sudo[104484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:17 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ff37c2a1-1017-4db5-9c82-02b4458bc416 tempest-CreateVolumesFromImageTest-1196585107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57243e15-e47e-4d17-a7f0-12f6b96e6e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:17 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-ff37c2a1-1017-4db5-9c82-02b4458bc416 tempest-CreateVolumesFromImageTest-1196585107 None] Volume volume-d99b5d84-c8de-4306-ab8d-c856fcbe9d2b (d99b5d84-c8de-4306-ab8d-c856fcbe9d2b): created successfully Aug 05 10:29:17 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ff37c2a1-1017-4db5-9c82-02b4458bc416 tempest-CreateVolumesFromImageTest-1196585107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57243e15-e47e-4d17-a7f0-12f6b96e6e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:17 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ff37c2a1-1017-4db5-9c82-02b4458bc416 tempest-CreateVolumesFromImageTest-1196585107 None] Flow 'volume_create_manager' (e823b92a-b7f5-4839-89be-18b710d25098) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:29:17 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-ff37c2a1-1017-4db5-9c82-02b4458bc416 tempest-CreateVolumesFromImageTest-1196585107 None] Created volume successfully. Aug 05 10:29:17 devstack sudo[104478]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-02b88754-c68c-41e5-a3a5-9c2d175285e6 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_724ae0cc-6a76-49c5-8bd8-0d26e2caf505_mhrc4xsrdevstack@QuobyteHD" returned: 0 in 0.392s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-02b88754-c68c-41e5-a3a5-9c2d175285e6 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_724ae0cc-6a76-49c5-8bd8-0d26e2caf505_mhrc4xsrdevstack@QuobyteHD {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:17 devstack sudo[104488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_724ae0cc-6a76-49c5-8bd8-0d26e2caf505_mhrc4xsrdevstack@QuobyteHD Aug 05 10:29:17 devstack sudo[104488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:17 devstack sudo[104484]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:17 devstack sudo[104488]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ce88f3d0-6d33-4bc8-8b41-f01128e8b8ce tempest-CreateVolumesFromImageTest-1196585107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1a3efff5-edb6-40f0-be6c-6a3b2c697497 1073741824" returned: 0 in 0.477s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-02b88754-c68c-41e5-a3a5-9c2d175285e6 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_724ae0cc-6a76-49c5-8bd8-0d26e2caf505_mhrc4xsrdevstack@QuobyteHD" returned: 1 in 0.364s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-02b88754-c68c-41e5-a3a5-9c2d175285e6 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_724ae0cc-6a76-49c5-8bd8-0d26e2caf505_mhrc4xsrdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 10:29:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-02b88754-c68c-41e5-a3a5-9c2d175285e6 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ce88f3d0-6d33-4bc8-8b41-f01128e8b8ce tempest-CreateVolumesFromImageTest-1196585107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1a3efff5-edb6-40f0-be6c-6a3b2c697497 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:17 devstack sudo[104497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1a3efff5-edb6-40f0-be6c-6a3b2c697497 Aug 05 10:29:17 devstack sudo[104497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:18 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-92d20c3b-5564-49d0-94d2-13c5f0eadd53 tempest-TestMinimumBasicScenario-1660464696 None] Acquiring lock "cinder-88e6a16c-40e1-4a72-886e-61af510fc570-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:29:18 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-92d20c3b-5564-49d0-94d2-13c5f0eadd53 tempest-TestMinimumBasicScenario-1660464696 None] Lock "cinder-88e6a16c-40e1-4a72-886e-61af510fc570-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:29:18 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-92d20c3b-5564-49d0-94d2-13c5f0eadd53 tempest-TestMinimumBasicScenario-1660464696 None] Acquiring lock "cinder-quobyte-88e6a16c-40e1-4a72-886e-61af510fc570" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:29:18 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-92d20c3b-5564-49d0-94d2-13c5f0eadd53 tempest-TestMinimumBasicScenario-1660464696 None] Lock "cinder-quobyte-88e6a16c-40e1-4a72-886e-61af510fc570" acquired by "delete_volume" :: waited 0.015s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:29:18 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[0831d1f3-452b-480e-ad64-c38d1071a55b]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:29:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-92d20c3b-5564-49d0-94d2-13c5f0eadd53 tempest-TestMinimumBasicScenario-1660464696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-88e6a16c-40e1-4a72-886e-61af510fc570 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:18 devstack sudo[104497]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ce88f3d0-6d33-4bc8-8b41-f01128e8b8ce tempest-CreateVolumesFromImageTest-1196585107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1a3efff5-edb6-40f0-be6c-6a3b2c697497" returned: 0 in 0.273s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:18 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-ce88f3d0-6d33-4bc8-8b41-f01128e8b8ce tempest-CreateVolumesFromImageTest-1196585107 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:29:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-ce88f3d0-6d33-4bc8-8b41-f01128e8b8ce tempest-CreateVolumesFromImageTest-1196585107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-0d521e7d-de9c-4393-9225-4a0e117d3e42 tempest-CreateVolumesFromImageTest-1196585107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.790s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:18 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-0d521e7d-de9c-4393-9225-4a0e117d3e42 tempest-CreateVolumesFromImageTest-1196585107 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:29:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-187938887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=846cbe14-0cf8-4b96-a529-ce78ac4ad525,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45cb2f0d26a84f5d94fb80a5d2432bb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:29:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:29:16Z,use_quota=True,user_id='6e5cfaf8257847f5bc9db4a0a1a3b267',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:29:18 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-0d521e7d-de9c-4393-9225-4a0e117d3e42 tempest-CreateVolumesFromImageTest-1196585107 None] Creating volume 846cbe14-0cf8-4b96-a529-ce78ac4ad525 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:29:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-0d521e7d-de9c-4393-9225-4a0e117d3e42 tempest-CreateVolumesFromImageTest-1196585107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-0d521e7d-de9c-4393-9225-4a0e117d3e42 tempest-CreateVolumesFromImageTest-1196585107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:18 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-0d521e7d-de9c-4393-9225-4a0e117d3e42 tempest-CreateVolumesFromImageTest-1196585107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:29:18 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-0d521e7d-de9c-4393-9225-4a0e117d3e42 tempest-CreateVolumesFromImageTest-1196585107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:29:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-0d521e7d-de9c-4393-9225-4a0e117d3e42 tempest-CreateVolumesFromImageTest-1196585107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:18 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-0d521e7d-de9c-4393-9225-4a0e117d3e42 tempest-CreateVolumesFromImageTest-1196585107 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:29:18 devstack sudo[104499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-88e6a16c-40e1-4a72-886e-61af510fc570 Aug 05 10:29:18 devstack sudo[104499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:18 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-0d521e7d-de9c-4393-9225-4a0e117d3e42 tempest-CreateVolumesFromImageTest-1196585107 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:29:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-0d521e7d-de9c-4393-9225-4a0e117d3e42 tempest-CreateVolumesFromImageTest-1196585107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-846cbe14-0cf8-4b96-a529-ce78ac4ad525 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:18 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ce88f3d0-6d33-4bc8-8b41-f01128e8b8ce tempest-CreateVolumesFromImageTest-1196585107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c592f2e-6e42-4d34-8614-371395034eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a3efff5-edb6-40f0-be6c-6a3b2c697497', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:18 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ce88f3d0-6d33-4bc8-8b41-f01128e8b8ce tempest-CreateVolumesFromImageTest-1196585107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51bfc98c-ee05-45aa-8869-188afa5a0b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:18 devstack sudo[104502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-846cbe14-0cf8-4b96-a529-ce78ac4ad525 1073741824 Aug 05 10:29:18 devstack sudo[104502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:18 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-ce88f3d0-6d33-4bc8-8b41-f01128e8b8ce tempest-CreateVolumesFromImageTest-1196585107 None] Volume volume-1a3efff5-edb6-40f0-be6c-6a3b2c697497 (1a3efff5-edb6-40f0-be6c-6a3b2c697497): created successfully Aug 05 10:29:18 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ce88f3d0-6d33-4bc8-8b41-f01128e8b8ce tempest-CreateVolumesFromImageTest-1196585107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51bfc98c-ee05-45aa-8869-188afa5a0b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:18 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ce88f3d0-6d33-4bc8-8b41-f01128e8b8ce tempest-CreateVolumesFromImageTest-1196585107 None] Flow 'volume_create_manager' (31545cf5-c8ee-4caf-a669-7dfee2c328c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:29:18 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-ce88f3d0-6d33-4bc8-8b41-f01128e8b8ce tempest-CreateVolumesFromImageTest-1196585107 None] Created volume successfully. Aug 05 10:29:18 devstack sudo[104499]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-92d20c3b-5564-49d0-94d2-13c5f0eadd53 tempest-TestMinimumBasicScenario-1660464696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-88e6a16c-40e1-4a72-886e-61af510fc570" returned: 0 in 0.382s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-92d20c3b-5564-49d0-94d2-13c5f0eadd53 tempest-TestMinimumBasicScenario-1660464696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-88e6a16c-40e1-4a72-886e-61af510fc570 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:18 devstack sudo[104510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-88e6a16c-40e1-4a72-886e-61af510fc570 Aug 05 10:29:18 devstack sudo[104510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:18 devstack sudo[104502]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-0d521e7d-de9c-4393-9225-4a0e117d3e42 tempest-CreateVolumesFromImageTest-1196585107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-846cbe14-0cf8-4b96-a529-ce78ac4ad525 1073741824" returned: 0 in 0.431s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-0d521e7d-de9c-4393-9225-4a0e117d3e42 tempest-CreateVolumesFromImageTest-1196585107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-846cbe14-0cf8-4b96-a529-ce78ac4ad525 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:18 devstack sudo[104513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-846cbe14-0cf8-4b96-a529-ce78ac4ad525 Aug 05 10:29:18 devstack sudo[104513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:18 devstack sudo[104510]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-92d20c3b-5564-49d0-94d2-13c5f0eadd53 tempest-TestMinimumBasicScenario-1660464696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-88e6a16c-40e1-4a72-886e-61af510fc570" returned: 0 in 0.258s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:18 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-92d20c3b-5564-49d0-94d2-13c5f0eadd53 tempest-TestMinimumBasicScenario-1660464696 None] Lock "cinder-quobyte-88e6a16c-40e1-4a72-886e-61af510fc570" released by "delete_volume" :: held 0.685s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:29:18 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-92d20c3b-5564-49d0-94d2-13c5f0eadd53 tempest-TestMinimumBasicScenario-1660464696 None] Created reservations ['c6ef1857-0bfa-45ed-bbad-8d739a3ca9ac', '04c0d0df-ca53-4a1d-8f51-bae1571111df', '9a84ebcd-fca0-4ed8-ad27-5c13eb740e34', 'b43af860-1cd2-434c-912f-9c151f025f6c'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:29:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-92d20c3b-5564-49d0-94d2-13c5f0eadd53 tempest-TestMinimumBasicScenario-1660464696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-92d20c3b-5564-49d0-94d2-13c5f0eadd53 tempest-TestMinimumBasicScenario-1660464696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:18 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-92d20c3b-5564-49d0-94d2-13c5f0eadd53 tempest-TestMinimumBasicScenario-1660464696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:29:18 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-92d20c3b-5564-49d0-94d2-13c5f0eadd53 tempest-TestMinimumBasicScenario-1660464696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:29:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-92d20c3b-5564-49d0-94d2-13c5f0eadd53 tempest-TestMinimumBasicScenario-1660464696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-92d20c3b-5564-49d0-94d2-13c5f0eadd53 tempest-TestMinimumBasicScenario-1660464696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:18 devstack sudo[104516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:29:18 devstack sudo[104516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:18 devstack sudo[104513]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-0d521e7d-de9c-4393-9225-4a0e117d3e42 tempest-CreateVolumesFromImageTest-1196585107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-846cbe14-0cf8-4b96-a529-ce78ac4ad525" returned: 0 in 0.268s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:18 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-0d521e7d-de9c-4393-9225-4a0e117d3e42 tempest-CreateVolumesFromImageTest-1196585107 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:29:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-0d521e7d-de9c-4393-9225-4a0e117d3e42 tempest-CreateVolumesFromImageTest-1196585107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-4e8ee2f8-9258-4a8e-a879-6b41827fdffb tempest-CreateVolumesFromImageTest-1196585107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.903s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:18 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-4e8ee2f8-9258-4a8e-a879-6b41827fdffb tempest-CreateVolumesFromImageTest-1196585107 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:29:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-300825199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fee6e5fd-334b-4f78-92b9-cdf5bbc5e556,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45cb2f0d26a84f5d94fb80a5d2432bb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:29:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:29:17Z,use_quota=True,user_id='6e5cfaf8257847f5bc9db4a0a1a3b267',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:29:18 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-4e8ee2f8-9258-4a8e-a879-6b41827fdffb tempest-CreateVolumesFromImageTest-1196585107 None] Creating volume fee6e5fd-334b-4f78-92b9-cdf5bbc5e556 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:29:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-4e8ee2f8-9258-4a8e-a879-6b41827fdffb tempest-CreateVolumesFromImageTest-1196585107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-4e8ee2f8-9258-4a8e-a879-6b41827fdffb tempest-CreateVolumesFromImageTest-1196585107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:18 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-4e8ee2f8-9258-4a8e-a879-6b41827fdffb tempest-CreateVolumesFromImageTest-1196585107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:29:18 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-4e8ee2f8-9258-4a8e-a879-6b41827fdffb tempest-CreateVolumesFromImageTest-1196585107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:29:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-4e8ee2f8-9258-4a8e-a879-6b41827fdffb tempest-CreateVolumesFromImageTest-1196585107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:18 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-4e8ee2f8-9258-4a8e-a879-6b41827fdffb tempest-CreateVolumesFromImageTest-1196585107 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:29:18 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-4e8ee2f8-9258-4a8e-a879-6b41827fdffb tempest-CreateVolumesFromImageTest-1196585107 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:29:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4e8ee2f8-9258-4a8e-a879-6b41827fdffb tempest-CreateVolumesFromImageTest-1196585107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-fee6e5fd-334b-4f78-92b9-cdf5bbc5e556 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:19 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0d521e7d-de9c-4393-9225-4a0e117d3e42 tempest-CreateVolumesFromImageTest-1196585107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d14a662d-1722-4fc3-9010-f39da8edbda6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-846cbe14-0cf8-4b96-a529-ce78ac4ad525', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:19 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0d521e7d-de9c-4393-9225-4a0e117d3e42 tempest-CreateVolumesFromImageTest-1196585107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d4ab3e6-eb38-468f-8645-491c2f030a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:19 devstack sudo[104519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-fee6e5fd-334b-4f78-92b9-cdf5bbc5e556 1073741824 Aug 05 10:29:19 devstack sudo[104519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:19 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-0d521e7d-de9c-4393-9225-4a0e117d3e42 tempest-CreateVolumesFromImageTest-1196585107 None] Volume volume-846cbe14-0cf8-4b96-a529-ce78ac4ad525 (846cbe14-0cf8-4b96-a529-ce78ac4ad525): created successfully Aug 05 10:29:19 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0d521e7d-de9c-4393-9225-4a0e117d3e42 tempest-CreateVolumesFromImageTest-1196585107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d4ab3e6-eb38-468f-8645-491c2f030a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:19 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0d521e7d-de9c-4393-9225-4a0e117d3e42 tempest-CreateVolumesFromImageTest-1196585107 None] Flow 'volume_create_manager' (24ae9904-a987-41d5-b2b5-a19a7e065611) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:29:19 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-0d521e7d-de9c-4393-9225-4a0e117d3e42 tempest-CreateVolumesFromImageTest-1196585107 None] Created volume successfully. Aug 05 10:29:19 devstack sudo[104516]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-92d20c3b-5564-49d0-94d2-13c5f0eadd53 tempest-TestMinimumBasicScenario-1660464696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.290s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:19 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-92d20c3b-5564-49d0-94d2-13c5f0eadd53 tempest-TestMinimumBasicScenario-1660464696 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:29:19 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-92d20c3b-5564-49d0-94d2-13c5f0eadd53 tempest-TestMinimumBasicScenario-1660464696 None] Deleted volume successfully. Aug 05 10:29:19 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-92d20c3b-5564-49d0-94d2-13c5f0eadd53 tempest-TestMinimumBasicScenario-1660464696 None] Lock "cinder-88e6a16c-40e1-4a72-886e-61af510fc570-delete_volume" released by "delete_volume" :: held 1.170s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:29:19 devstack sudo[104519]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4e8ee2f8-9258-4a8e-a879-6b41827fdffb tempest-CreateVolumesFromImageTest-1196585107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-fee6e5fd-334b-4f78-92b9-cdf5bbc5e556 1073741824" returned: 0 in 0.446s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4e8ee2f8-9258-4a8e-a879-6b41827fdffb tempest-CreateVolumesFromImageTest-1196585107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-fee6e5fd-334b-4f78-92b9-cdf5bbc5e556 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:19 devstack sudo[104526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-fee6e5fd-334b-4f78-92b9-cdf5bbc5e556 Aug 05 10:29:19 devstack sudo[104526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:19 devstack sudo[104526]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4e8ee2f8-9258-4a8e-a879-6b41827fdffb tempest-CreateVolumesFromImageTest-1196585107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-fee6e5fd-334b-4f78-92b9-cdf5bbc5e556" returned: 0 in 0.279s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:19 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-4e8ee2f8-9258-4a8e-a879-6b41827fdffb tempest-CreateVolumesFromImageTest-1196585107 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:29:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-4e8ee2f8-9258-4a8e-a879-6b41827fdffb tempest-CreateVolumesFromImageTest-1196585107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-02b88754-c68c-41e5-a3a5-9c2d175285e6 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.834s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:19 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-02b88754-c68c-41e5-a3a5-9c2d175285e6 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:29:14Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbf0e083-c7af-45a5-a7cc-883784d7fe05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5689b10b1a4849b48c56b708715eeec4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:29:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:29:14Z,use_quota=True,user_id='405532d5bc3f4d9aa0d3ab3f8f265fcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15244692-1900-42c9-8501-6981f2cc4d6a),volume_type_id=15244692-1900-42c9-8501-6981f2cc4d6a)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:29:19 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-02b88754-c68c-41e5-a3a5-9c2d175285e6 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] Creating volume dbf0e083-c7af-45a5-a7cc-883784d7fe05 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:29:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-02b88754-c68c-41e5-a3a5-9c2d175285e6 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-02b88754-c68c-41e5-a3a5-9c2d175285e6 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:19 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-02b88754-c68c-41e5-a3a5-9c2d175285e6 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:29:19 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-02b88754-c68c-41e5-a3a5-9c2d175285e6 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:29:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-02b88754-c68c-41e5-a3a5-9c2d175285e6 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:19 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-02b88754-c68c-41e5-a3a5-9c2d175285e6 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:29:19 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-02b88754-c68c-41e5-a3a5-9c2d175285e6 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:29:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-02b88754-c68c-41e5-a3a5-9c2d175285e6 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-dbf0e083-c7af-45a5-a7cc-883784d7fe05 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:19 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-4e8ee2f8-9258-4a8e-a879-6b41827fdffb tempest-CreateVolumesFromImageTest-1196585107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (575b6ac0-653f-41df-90af-896827120d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fee6e5fd-334b-4f78-92b9-cdf5bbc5e556', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:19 devstack sudo[104529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-dbf0e083-c7af-45a5-a7cc-883784d7fe05 1073741824 Aug 05 10:29:19 devstack sudo[104529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:19 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-4e8ee2f8-9258-4a8e-a879-6b41827fdffb tempest-CreateVolumesFromImageTest-1196585107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0876271c-938f-474f-8805-6928056657d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:19 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-4e8ee2f8-9258-4a8e-a879-6b41827fdffb tempest-CreateVolumesFromImageTest-1196585107 None] Volume volume-fee6e5fd-334b-4f78-92b9-cdf5bbc5e556 (fee6e5fd-334b-4f78-92b9-cdf5bbc5e556): created successfully Aug 05 10:29:19 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-4e8ee2f8-9258-4a8e-a879-6b41827fdffb tempest-CreateVolumesFromImageTest-1196585107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0876271c-938f-474f-8805-6928056657d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:19 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-4e8ee2f8-9258-4a8e-a879-6b41827fdffb tempest-CreateVolumesFromImageTest-1196585107 None] Flow 'volume_create_manager' (425f9f9f-9bf8-4c4a-aff8-b184dbf55ec0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:29:19 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-4e8ee2f8-9258-4a8e-a879-6b41827fdffb tempest-CreateVolumesFromImageTest-1196585107 None] Created volume successfully. Aug 05 10:29:20 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-a3892308-1d86-470a-948f-0b689e19efd6 tempest-CreateVolumesFromImageTest-1196585107 None] Acquiring lock "cinder-fee6e5fd-334b-4f78-92b9-cdf5bbc5e556-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:29:20 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-a3892308-1d86-470a-948f-0b689e19efd6 tempest-CreateVolumesFromImageTest-1196585107 None] Lock "cinder-fee6e5fd-334b-4f78-92b9-cdf5bbc5e556-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:29:20 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-a3892308-1d86-470a-948f-0b689e19efd6 tempest-CreateVolumesFromImageTest-1196585107 None] Acquiring lock "cinder-quobyte-fee6e5fd-334b-4f78-92b9-cdf5bbc5e556" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:29:20 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-a3892308-1d86-470a-948f-0b689e19efd6 tempest-CreateVolumesFromImageTest-1196585107 None] Lock "cinder-quobyte-fee6e5fd-334b-4f78-92b9-cdf5bbc5e556" acquired by "delete_volume" :: waited 0.024s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:29:20 devstack sudo[104529]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-02b88754-c68c-41e5-a3a5-9c2d175285e6 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-dbf0e083-c7af-45a5-a7cc-883784d7fe05 1073741824" returned: 0 in 0.712s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:20 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e58cb58-37db-4678-a2f4-2b6a9cb827d9]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:29:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a3892308-1d86-470a-948f-0b689e19efd6 tempest-CreateVolumesFromImageTest-1196585107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-fee6e5fd-334b-4f78-92b9-cdf5bbc5e556 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-02b88754-c68c-41e5-a3a5-9c2d175285e6 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-dbf0e083-c7af-45a5-a7cc-883784d7fe05 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:20 devstack sudo[104559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-dbf0e083-c7af-45a5-a7cc-883784d7fe05 Aug 05 10:29:20 devstack sudo[104559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:20 devstack sudo[104558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-fee6e5fd-334b-4f78-92b9-cdf5bbc5e556 Aug 05 10:29:20 devstack sudo[104558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:20 devstack sudo[104559]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-02b88754-c68c-41e5-a3a5-9c2d175285e6 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-dbf0e083-c7af-45a5-a7cc-883784d7fe05" returned: 0 in 0.307s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:20 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-02b88754-c68c-41e5-a3a5-9c2d175285e6 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:29:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-02b88754-c68c-41e5-a3a5-9c2d175285e6 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:20 devstack cinder-volume[88613]: DEBUG cinder.volume.volume_utils [None req-02b88754-c68c-41e5-a3a5-9c2d175285e6 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] Attempting download of 724ae0cc-6a76-49c5-8bd8-0d26e2caf505 ((None, [{'url': 'file:///opt/stack/data/glance/images/724ae0cc-6a76-49c5-8bd8-0d26e2caf505', 'metadata': {}}])) to volume dbf0e083-c7af-45a5-a7cc-883784d7fe05. {{(pid=88613) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 05 10:29:20 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[390e1442-06ae-4847-b935-e250fa1024b7]: (4, 'raw') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:29:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-02b88754-c68c-41e5-a3a5-9c2d175285e6 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_724ae0cc-6a76-49c5-8bd8-0d26e2caf505_vu98nlz3 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:21 devstack sudo[104558]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a3892308-1d86-470a-948f-0b689e19efd6 tempest-CreateVolumesFromImageTest-1196585107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-fee6e5fd-334b-4f78-92b9-cdf5bbc5e556" returned: 0 in 0.508s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a3892308-1d86-470a-948f-0b689e19efd6 tempest-CreateVolumesFromImageTest-1196585107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-fee6e5fd-334b-4f78-92b9-cdf5bbc5e556 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:21 devstack sudo[104568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-fee6e5fd-334b-4f78-92b9-cdf5bbc5e556 Aug 05 10:29:21 devstack sudo[104568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:21 devstack sudo[104567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_724ae0cc-6a76-49c5-8bd8-0d26e2caf505_vu98nlz3 Aug 05 10:29:21 devstack sudo[104567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:21 devstack sudo[104568]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a3892308-1d86-470a-948f-0b689e19efd6 tempest-CreateVolumesFromImageTest-1196585107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-fee6e5fd-334b-4f78-92b9-cdf5bbc5e556" returned: 0 in 0.309s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:21 devstack sudo[104567]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:21 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-a3892308-1d86-470a-948f-0b689e19efd6 tempest-CreateVolumesFromImageTest-1196585107 None] Lock "cinder-quobyte-fee6e5fd-334b-4f78-92b9-cdf5bbc5e556" released by "delete_volume" :: held 0.894s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:29:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-02b88754-c68c-41e5-a3a5-9c2d175285e6 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_724ae0cc-6a76-49c5-8bd8-0d26e2caf505_vu98nlz3" returned: 0 in 0.395s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-02b88754-c68c-41e5-a3a5-9c2d175285e6 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_724ae0cc-6a76-49c5-8bd8-0d26e2caf505_vu98nlz3 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:21 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-a3892308-1d86-470a-948f-0b689e19efd6 tempest-CreateVolumesFromImageTest-1196585107 None] Created reservations ['1940df68-fe32-41ea-b862-1321ffd1479d', 'eaaff140-e222-481a-878d-7ac490c1360c', 'a6109cce-157d-4877-b622-0eb52ef61722', 'b8ef5acb-49fe-4b8d-b2d3-c5318194044d'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:29:21 devstack sudo[104575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_724ae0cc-6a76-49c5-8bd8-0d26e2caf505_vu98nlz3 Aug 05 10:29:21 devstack sudo[104575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a3892308-1d86-470a-948f-0b689e19efd6 tempest-CreateVolumesFromImageTest-1196585107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a3892308-1d86-470a-948f-0b689e19efd6 tempest-CreateVolumesFromImageTest-1196585107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:21 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-a3892308-1d86-470a-948f-0b689e19efd6 tempest-CreateVolumesFromImageTest-1196585107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:29:21 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-a3892308-1d86-470a-948f-0b689e19efd6 tempest-CreateVolumesFromImageTest-1196585107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:29:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a3892308-1d86-470a-948f-0b689e19efd6 tempest-CreateVolumesFromImageTest-1196585107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a3892308-1d86-470a-948f-0b689e19efd6 tempest-CreateVolumesFromImageTest-1196585107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:21 devstack sudo[104577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:29:21 devstack sudo[104577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:21 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-147c989e-bf94-49ca-938c-e36af90a9d3c tempest-CreateVolumesFromImageTest-1196585107 None] Acquiring lock "cinder-846cbe14-0cf8-4b96-a529-ce78ac4ad525-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:29:21 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-147c989e-bf94-49ca-938c-e36af90a9d3c tempest-CreateVolumesFromImageTest-1196585107 None] Lock "cinder-846cbe14-0cf8-4b96-a529-ce78ac4ad525-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:29:21 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-147c989e-bf94-49ca-938c-e36af90a9d3c tempest-CreateVolumesFromImageTest-1196585107 None] Acquiring lock "cinder-quobyte-846cbe14-0cf8-4b96-a529-ce78ac4ad525" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:29:21 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-147c989e-bf94-49ca-938c-e36af90a9d3c tempest-CreateVolumesFromImageTest-1196585107 None] Lock "cinder-quobyte-846cbe14-0cf8-4b96-a529-ce78ac4ad525" acquired by "delete_volume" :: waited 0.022s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:29:21 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[94acc520-a870-4225-a50e-e2705c859a24]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:29:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-147c989e-bf94-49ca-938c-e36af90a9d3c tempest-CreateVolumesFromImageTest-1196585107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-846cbe14-0cf8-4b96-a529-ce78ac4ad525 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:21 devstack cinder-volume[88613]: DEBUG oslo_service.periodic_task [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88613) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:29:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:21 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:29:21 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:29:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:21 devstack sudo[104577]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a3892308-1d86-470a-948f-0b689e19efd6 tempest-CreateVolumesFromImageTest-1196585107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.315s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:21 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-a3892308-1d86-470a-948f-0b689e19efd6 tempest-CreateVolumesFromImageTest-1196585107 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:29:21 devstack sudo[104575]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:21 devstack sudo[104583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:29:21 devstack sudo[104583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-02b88754-c68c-41e5-a3a5-9c2d175285e6 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_724ae0cc-6a76-49c5-8bd8-0d26e2caf505_vu98nlz3" returned: 1 in 0.470s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-02b88754-c68c-41e5-a3a5-9c2d175285e6 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_724ae0cc-6a76-49c5-8bd8-0d26e2caf505_vu98nlz3' failed. Not Retrying. {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 10:29:21 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-a3892308-1d86-470a-948f-0b689e19efd6 tempest-CreateVolumesFromImageTest-1196585107 None] Deleted volume successfully. Aug 05 10:29:21 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[d24a1b8d-7366-4928-8def-aa1969c6b23c]: (4, 'raw') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:29:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-02b88754-c68c-41e5-a3a5-9c2d175285e6 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_724ae0cc-6a76-49c5-8bd8-0d26e2caf505_mhrc4xsrdevstack@QuobyteHD {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:21 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-a3892308-1d86-470a-948f-0b689e19efd6 tempest-CreateVolumesFromImageTest-1196585107 None] Lock "cinder-fee6e5fd-334b-4f78-92b9-cdf5bbc5e556-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:29:21 devstack sudo[104579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-846cbe14-0cf8-4b96-a529-ce78ac4ad525 Aug 05 10:29:21 devstack sudo[104579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:21 devstack sudo[104585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_724ae0cc-6a76-49c5-8bd8-0d26e2caf505_mhrc4xsrdevstack@QuobyteHD Aug 05 10:29:21 devstack sudo[104585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:22 devstack sudo[104583]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.296s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:22 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:29:22 devstack cinder-volume[88613]: DEBUG oslo_service.periodic_task [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Running periodic task VolumeManager._thread_info {{(pid=88613) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:29:22 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] thread count: 28 {{(pid=88613) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 10:29:22 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] thread info: [<_MainThread(MainThread, started 126173666128000)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88613) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 10:29:22 devstack sudo[104579]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-147c989e-bf94-49ca-938c-e36af90a9d3c tempest-CreateVolumesFromImageTest-1196585107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-846cbe14-0cf8-4b96-a529-ce78ac4ad525" returned: 0 in 0.458s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-147c989e-bf94-49ca-938c-e36af90a9d3c tempest-CreateVolumesFromImageTest-1196585107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-846cbe14-0cf8-4b96-a529-ce78ac4ad525 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:22 devstack sudo[104593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-846cbe14-0cf8-4b96-a529-ce78ac4ad525 Aug 05 10:29:22 devstack sudo[104593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:22 devstack sudo[104585]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-02b88754-c68c-41e5-a3a5-9c2d175285e6 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_724ae0cc-6a76-49c5-8bd8-0d26e2caf505_mhrc4xsrdevstack@QuobyteHD" returned: 0 in 0.388s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-02b88754-c68c-41e5-a3a5-9c2d175285e6 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_724ae0cc-6a76-49c5-8bd8-0d26e2caf505_mhrc4xsrdevstack@QuobyteHD {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:22 devstack sudo[104596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_724ae0cc-6a76-49c5-8bd8-0d26e2caf505_mhrc4xsrdevstack@QuobyteHD Aug 05 10:29:22 devstack sudo[104596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:22 devstack sudo[104593]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-147c989e-bf94-49ca-938c-e36af90a9d3c tempest-CreateVolumesFromImageTest-1196585107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-846cbe14-0cf8-4b96-a529-ce78ac4ad525" returned: 0 in 0.296s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:22 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-147c989e-bf94-49ca-938c-e36af90a9d3c tempest-CreateVolumesFromImageTest-1196585107 None] Lock "cinder-quobyte-846cbe14-0cf8-4b96-a529-ce78ac4ad525" released by "delete_volume" :: held 0.816s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:29:22 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-147c989e-bf94-49ca-938c-e36af90a9d3c tempest-CreateVolumesFromImageTest-1196585107 None] Created reservations ['ce177180-c525-4483-b9ea-e55b5afaa225', 'bdb7c6af-d564-4ee0-858e-206a36899aee', 'd93107f6-9baf-4dc1-ab66-73a516f7dfd1', '5018fe2c-f511-4a05-bc20-a1e5149b2260'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:29:22 devstack sudo[104596]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-02b88754-c68c-41e5-a3a5-9c2d175285e6 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_724ae0cc-6a76-49c5-8bd8-0d26e2caf505_mhrc4xsrdevstack@QuobyteHD" returned: 1 in 0.396s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-02b88754-c68c-41e5-a3a5-9c2d175285e6 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_724ae0cc-6a76-49c5-8bd8-0d26e2caf505_mhrc4xsrdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 10:29:22 devstack cinder-volume[88613]: DEBUG cinder.image.image_utils [None req-02b88754-c68c-41e5-a3a5-9c2d175285e6 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] 724ae0cc-6a76-49c5-8bd8-0d26e2caf505 was raw, converting to qcow2 {{(pid=88613) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 05 10:29:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-02b88754-c68c-41e5-a3a5-9c2d175285e6 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_724ae0cc-6a76-49c5-8bd8-0d26e2caf505_mhrc4xsrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-dbf0e083-c7af-45a5-a7cc-883784d7fe05 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:22 devstack sudo[104602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_724ae0cc-6a76-49c5-8bd8-0d26e2caf505_mhrc4xsrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-dbf0e083-c7af-45a5-a7cc-883784d7fe05 Aug 05 10:29:22 devstack sudo[104602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-147c989e-bf94-49ca-938c-e36af90a9d3c tempest-CreateVolumesFromImageTest-1196585107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-147c989e-bf94-49ca-938c-e36af90a9d3c tempest-CreateVolumesFromImageTest-1196585107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:22 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-147c989e-bf94-49ca-938c-e36af90a9d3c tempest-CreateVolumesFromImageTest-1196585107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:29:22 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-147c989e-bf94-49ca-938c-e36af90a9d3c tempest-CreateVolumesFromImageTest-1196585107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:29:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-147c989e-bf94-49ca-938c-e36af90a9d3c tempest-CreateVolumesFromImageTest-1196585107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-147c989e-bf94-49ca-938c-e36af90a9d3c tempest-CreateVolumesFromImageTest-1196585107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:22 devstack sudo[104604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:29:22 devstack sudo[104604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:22 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-3d6a49f4-9a71-47e9-a1eb-fedbbff4e95c tempest-CreateVolumesFromImageTest-1196585107 None] Acquiring lock "cinder-1a3efff5-edb6-40f0-be6c-6a3b2c697497-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:29:22 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-3d6a49f4-9a71-47e9-a1eb-fedbbff4e95c tempest-CreateVolumesFromImageTest-1196585107 None] Lock "cinder-1a3efff5-edb6-40f0-be6c-6a3b2c697497-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:29:22 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-3d6a49f4-9a71-47e9-a1eb-fedbbff4e95c tempest-CreateVolumesFromImageTest-1196585107 None] Acquiring lock "cinder-quobyte-1a3efff5-edb6-40f0-be6c-6a3b2c697497" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:29:22 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-3d6a49f4-9a71-47e9-a1eb-fedbbff4e95c tempest-CreateVolumesFromImageTest-1196585107 None] Lock "cinder-quobyte-1a3efff5-edb6-40f0-be6c-6a3b2c697497" acquired by "delete_volume" :: waited 0.017s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:29:22 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[8735a222-9c4b-4689-8f40-092fa46163a6]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:29:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3d6a49f4-9a71-47e9-a1eb-fedbbff4e95c tempest-CreateVolumesFromImageTest-1196585107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1a3efff5-edb6-40f0-be6c-6a3b2c697497 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:23 devstack sudo[104604]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-147c989e-bf94-49ca-938c-e36af90a9d3c tempest-CreateVolumesFromImageTest-1196585107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.314s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:23 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-147c989e-bf94-49ca-938c-e36af90a9d3c tempest-CreateVolumesFromImageTest-1196585107 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:29:23 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-147c989e-bf94-49ca-938c-e36af90a9d3c tempest-CreateVolumesFromImageTest-1196585107 None] Deleted volume successfully. Aug 05 10:29:23 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-147c989e-bf94-49ca-938c-e36af90a9d3c tempest-CreateVolumesFromImageTest-1196585107 None] Lock "cinder-846cbe14-0cf8-4b96-a529-ce78ac4ad525-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:29:23 devstack sudo[104606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1a3efff5-edb6-40f0-be6c-6a3b2c697497 Aug 05 10:29:23 devstack sudo[104606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:23 devstack sudo[104602]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-02b88754-c68c-41e5-a3a5-9c2d175285e6 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_724ae0cc-6a76-49c5-8bd8-0d26e2caf505_mhrc4xsrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-dbf0e083-c7af-45a5-a7cc-883784d7fe05" returned: 0 in 0.663s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:23 devstack cinder-volume[88613]: DEBUG cinder.image.image_utils [None req-02b88754-c68c-41e5-a3a5-9c2d175285e6 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_724ae0cc-6a76-49c5-8bd8-0d26e2caf505_mhrc4xsrdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-dbf0e083-c7af-45a5-a7cc-883784d7fe05 {{(pid=88613) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 10:29:23 devstack cinder-volume[88613]: INFO cinder.image.image_utils [None req-02b88754-c68c-41e5-a3a5-9c2d175285e6 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] Converted 0.00 MB image at 0.00 MB/s Aug 05 10:29:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-02b88754-c68c-41e5-a3a5-9c2d175285e6 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-dbf0e083-c7af-45a5-a7cc-883784d7fe05 1G {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:23 devstack sudo[104613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-dbf0e083-c7af-45a5-a7cc-883784d7fe05 1G Aug 05 10:29:23 devstack sudo[104613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:23 devstack sudo[104606]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3d6a49f4-9a71-47e9-a1eb-fedbbff4e95c tempest-CreateVolumesFromImageTest-1196585107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1a3efff5-edb6-40f0-be6c-6a3b2c697497" returned: 0 in 0.472s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3d6a49f4-9a71-47e9-a1eb-fedbbff4e95c tempest-CreateVolumesFromImageTest-1196585107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1a3efff5-edb6-40f0-be6c-6a3b2c697497 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:23 devstack sudo[104617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1a3efff5-edb6-40f0-be6c-6a3b2c697497 Aug 05 10:29:23 devstack sudo[104617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:23 devstack sudo[104613]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-02b88754-c68c-41e5-a3a5-9c2d175285e6 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-dbf0e083-c7af-45a5-a7cc-883784d7fe05 1G" returned: 0 in 0.358s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:23 devstack cinder-volume[88613]: DEBUG cinder.volume.volume_utils [None req-02b88754-c68c-41e5-a3a5-9c2d175285e6 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] Downloaded image 724ae0cc-6a76-49c5-8bd8-0d26e2caf505 ((None, [{'url': 'file:///opt/stack/data/glance/images/724ae0cc-6a76-49c5-8bd8-0d26e2caf505', 'metadata': {}}])) to volume dbf0e083-c7af-45a5-a7cc-883784d7fe05 successfully. {{(pid=88613) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 05 10:29:23 devstack cinder-volume[88613]: DEBUG cinder.image.image_utils [None req-02b88754-c68c-41e5-a3a5-9c2d175285e6 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] Temporary image 724ae0cc-6a76-49c5-8bd8-0d26e2caf505 for user 405532d5bc3f4d9aa0d3ab3f8f265fcb is deleted. {{(pid=88613) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 05 10:29:23 devstack cinder-volume[88613]: DEBUG cinder.volume.volume_utils [None req-02b88754-c68c-41e5-a3a5-9c2d175285e6 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] Marking volume dbf0e083-c7af-45a5-a7cc-883784d7fe05 as bootable. {{(pid=88613) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 05 10:29:23 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-02b88754-c68c-41e5-a3a5-9c2d175285e6 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] Copying metadata from image 724ae0cc-6a76-49c5-8bd8-0d26e2caf505 to dbf0e083-c7af-45a5-a7cc-883784d7fe05. {{(pid=88613) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 05 10:29:23 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-02b88754-c68c-41e5-a3a5-9c2d175285e6 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] Creating volume glance metadata for volume dbf0e083-c7af-45a5-a7cc-883784d7fe05 backed by image 724ae0cc-6a76-49c5-8bd8-0d26e2caf505 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '724ae0cc-6a76-49c5-8bd8-0d26e2caf505', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '795bab1308e2cd3292ee3c7138393d12', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88613) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 05 10:29:23 devstack sudo[104617]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3d6a49f4-9a71-47e9-a1eb-fedbbff4e95c tempest-CreateVolumesFromImageTest-1196585107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-1a3efff5-edb6-40f0-be6c-6a3b2c697497" returned: 0 in 0.301s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:23 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-3d6a49f4-9a71-47e9-a1eb-fedbbff4e95c tempest-CreateVolumesFromImageTest-1196585107 None] Lock "cinder-quobyte-1a3efff5-edb6-40f0-be6c-6a3b2c697497" released by "delete_volume" :: held 0.822s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:29:23 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-02b88754-c68c-41e5-a3a5-9c2d175285e6 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9af3e38f-ff1d-4f47-9232-c4c4e64e6cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbf0e083-c7af-45a5-a7cc-883784d7fe05', 'volume_size': 1, 'image_id': '724ae0cc-6a76-49c5-8bd8-0d26e2caf505', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/724ae0cc-6a76-49c5-8bd8-0d26e2caf505', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '795bab1308e2cd3292ee3c7138393d12', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5689b10b1a4849b48c56b708715eeec4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '08079fe83f04fd9be5636a74c7606685fd3689f0b76f2020c1f08b21e692e07574b84e7c591bcb8fa6a972714e47647680d3454ba1b32126646b7d0c2a0fbfab', 'id': '724ae0cc-6a76-49c5-8bd8-0d26e2caf505', 'created_at': datetime.datetime(2026, 8, 5, 8, 29, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 8, 29, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/724ae0cc-6a76-49c5-8bd8-0d26e2caf505/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:23 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-02b88754-c68c-41e5-a3a5-9c2d175285e6 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bd97997-177e-4086-9aed-36ad3c5d89a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:23 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-02b88754-c68c-41e5-a3a5-9c2d175285e6 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] Volume volume-dbf0e083-c7af-45a5-a7cc-883784d7fe05 (dbf0e083-c7af-45a5-a7cc-883784d7fe05): created successfully Aug 05 10:29:23 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-02b88754-c68c-41e5-a3a5-9c2d175285e6 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bd97997-177e-4086-9aed-36ad3c5d89a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:23 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-02b88754-c68c-41e5-a3a5-9c2d175285e6 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] Flow 'volume_create_manager' (f55be24e-215a-46a4-8f8a-39ad77f3230e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:29:23 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-3d6a49f4-9a71-47e9-a1eb-fedbbff4e95c tempest-CreateVolumesFromImageTest-1196585107 None] Created reservations ['5d6671a9-3036-4518-bcbb-86e011595c46', 'db4d2d1d-9244-42f4-9cdc-a8b19b57cf99', '6ef6c19a-0d3b-4eb0-8513-04ff7424ff23', '6e6c3bb3-ae0c-4364-aa5b-78b1f7c5728b'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:29:23 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-02b88754-c68c-41e5-a3a5-9c2d175285e6 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] Created volume successfully. Aug 05 10:29:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-3d6a49f4-9a71-47e9-a1eb-fedbbff4e95c tempest-CreateVolumesFromImageTest-1196585107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-3d6a49f4-9a71-47e9-a1eb-fedbbff4e95c tempest-CreateVolumesFromImageTest-1196585107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:23 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-3d6a49f4-9a71-47e9-a1eb-fedbbff4e95c tempest-CreateVolumesFromImageTest-1196585107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:29:23 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-3d6a49f4-9a71-47e9-a1eb-fedbbff4e95c tempest-CreateVolumesFromImageTest-1196585107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:29:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-3d6a49f4-9a71-47e9-a1eb-fedbbff4e95c tempest-CreateVolumesFromImageTest-1196585107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3d6a49f4-9a71-47e9-a1eb-fedbbff4e95c tempest-CreateVolumesFromImageTest-1196585107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:23 devstack sudo[104624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:29:23 devstack sudo[104624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:24 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-6dde8fdd-7013-4bb8-aeea-144b09acf0ac tempest-CreateVolumesFromImageTest-1196585107 None] Acquiring lock "cinder-d99b5d84-c8de-4306-ab8d-c856fcbe9d2b-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:29:24 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-6dde8fdd-7013-4bb8-aeea-144b09acf0ac tempest-CreateVolumesFromImageTest-1196585107 None] Lock "cinder-d99b5d84-c8de-4306-ab8d-c856fcbe9d2b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:29:24 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-6dde8fdd-7013-4bb8-aeea-144b09acf0ac tempest-CreateVolumesFromImageTest-1196585107 None] Acquiring lock "cinder-quobyte-d99b5d84-c8de-4306-ab8d-c856fcbe9d2b" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:29:24 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-6dde8fdd-7013-4bb8-aeea-144b09acf0ac tempest-CreateVolumesFromImageTest-1196585107 None] Lock "cinder-quobyte-d99b5d84-c8de-4306-ab8d-c856fcbe9d2b" acquired by "delete_volume" :: waited 0.021s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:29:24 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[758842d3-757e-44a6-a89f-0d54401d1cc9]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:29:24 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6dde8fdd-7013-4bb8-aeea-144b09acf0ac tempest-CreateVolumesFromImageTest-1196585107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d99b5d84-c8de-4306-ab8d-c856fcbe9d2b {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:24 devstack sudo[104624]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:24 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3d6a49f4-9a71-47e9-a1eb-fedbbff4e95c tempest-CreateVolumesFromImageTest-1196585107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.314s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:24 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-3d6a49f4-9a71-47e9-a1eb-fedbbff4e95c tempest-CreateVolumesFromImageTest-1196585107 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:29:24 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-3d6a49f4-9a71-47e9-a1eb-fedbbff4e95c tempest-CreateVolumesFromImageTest-1196585107 None] Deleted volume successfully. Aug 05 10:29:24 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-3d6a49f4-9a71-47e9-a1eb-fedbbff4e95c tempest-CreateVolumesFromImageTest-1196585107 None] Lock "cinder-1a3efff5-edb6-40f0-be6c-6a3b2c697497-delete_volume" released by "delete_volume" :: held 1.420s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:29:24 devstack sudo[104627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d99b5d84-c8de-4306-ab8d-c856fcbe9d2b Aug 05 10:29:24 devstack sudo[104627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:24 devstack sudo[104627]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:24 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6dde8fdd-7013-4bb8-aeea-144b09acf0ac tempest-CreateVolumesFromImageTest-1196585107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d99b5d84-c8de-4306-ab8d-c856fcbe9d2b" returned: 0 in 0.425s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:24 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6dde8fdd-7013-4bb8-aeea-144b09acf0ac tempest-CreateVolumesFromImageTest-1196585107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d99b5d84-c8de-4306-ab8d-c856fcbe9d2b {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:24 devstack sudo[104633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d99b5d84-c8de-4306-ab8d-c856fcbe9d2b Aug 05 10:29:24 devstack sudo[104633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:24 devstack sudo[104633]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:24 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6dde8fdd-7013-4bb8-aeea-144b09acf0ac tempest-CreateVolumesFromImageTest-1196585107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d99b5d84-c8de-4306-ab8d-c856fcbe9d2b" returned: 0 in 0.266s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:24 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-6dde8fdd-7013-4bb8-aeea-144b09acf0ac tempest-CreateVolumesFromImageTest-1196585107 None] Lock "cinder-quobyte-d99b5d84-c8de-4306-ab8d-c856fcbe9d2b" released by "delete_volume" :: held 0.731s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:29:24 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-6dde8fdd-7013-4bb8-aeea-144b09acf0ac tempest-CreateVolumesFromImageTest-1196585107 None] Created reservations ['5bb8fdbb-fcab-4737-a015-df2fc971f66f', '51c84683-7d11-4940-8ba9-beddc7d520ae', 'c99a03fb-1dbe-4ed5-8cde-6e7affe52612', 'a87cdaf6-0880-4b5c-8eb6-65175bf90f2c'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:29:24 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-6dde8fdd-7013-4bb8-aeea-144b09acf0ac tempest-CreateVolumesFromImageTest-1196585107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:24 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-6dde8fdd-7013-4bb8-aeea-144b09acf0ac tempest-CreateVolumesFromImageTest-1196585107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:24 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-6dde8fdd-7013-4bb8-aeea-144b09acf0ac tempest-CreateVolumesFromImageTest-1196585107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:29:24 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-6dde8fdd-7013-4bb8-aeea-144b09acf0ac tempest-CreateVolumesFromImageTest-1196585107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:29:24 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-6dde8fdd-7013-4bb8-aeea-144b09acf0ac tempest-CreateVolumesFromImageTest-1196585107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:24 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6dde8fdd-7013-4bb8-aeea-144b09acf0ac tempest-CreateVolumesFromImageTest-1196585107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:24 devstack sudo[104637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:29:25 devstack sudo[104637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:25 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-4062418a-4ee4-4cf9-b5c4-359d0fc3b5b0 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] Acquiring lock "cinder-dbf0e083-c7af-45a5-a7cc-883784d7fe05-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:29:25 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-4062418a-4ee4-4cf9-b5c4-359d0fc3b5b0 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] Lock "cinder-dbf0e083-c7af-45a5-a7cc-883784d7fe05-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:29:25 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-4062418a-4ee4-4cf9-b5c4-359d0fc3b5b0 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] Acquiring lock "cinder-quobyte-dbf0e083-c7af-45a5-a7cc-883784d7fe05" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:29:25 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-4062418a-4ee4-4cf9-b5c4-359d0fc3b5b0 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] Lock "cinder-quobyte-dbf0e083-c7af-45a5-a7cc-883784d7fe05" acquired by "delete_volume" :: waited 0.027s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:29:25 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[e08d13dd-049e-4955-9ef6-64372efdc4e3]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:29:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4062418a-4ee4-4cf9-b5c4-359d0fc3b5b0 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-dbf0e083-c7af-45a5-a7cc-883784d7fe05 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:25 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-dcfb37c5-301e-455d-9d1f-af26aee9b56c tempest-CreateVolumesFromImageTest-1196585107 None] Acquiring lock "cinder-11136acc-c797-403c-ad62-bfb2c4d33ef6-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:29:25 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-dcfb37c5-301e-455d-9d1f-af26aee9b56c tempest-CreateVolumesFromImageTest-1196585107 None] Lock "cinder-11136acc-c797-403c-ad62-bfb2c4d33ef6-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:29:25 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-dcfb37c5-301e-455d-9d1f-af26aee9b56c tempest-CreateVolumesFromImageTest-1196585107 None] Acquiring lock "cinder-quobyte-11136acc-c797-403c-ad62-bfb2c4d33ef6" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:29:25 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-dcfb37c5-301e-455d-9d1f-af26aee9b56c tempest-CreateVolumesFromImageTest-1196585107 None] Lock "cinder-quobyte-11136acc-c797-403c-ad62-bfb2c4d33ef6" acquired by "delete_volume" :: waited 0.022s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:29:25 devstack sudo[104639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-dbf0e083-c7af-45a5-a7cc-883784d7fe05 Aug 05 10:29:25 devstack sudo[104639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:25 devstack sudo[104637]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6dde8fdd-7013-4bb8-aeea-144b09acf0ac tempest-CreateVolumesFromImageTest-1196585107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.414s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:25 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-6dde8fdd-7013-4bb8-aeea-144b09acf0ac tempest-CreateVolumesFromImageTest-1196585107 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:29:25 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[756f7923-1bd9-46e5-9bcc-412813e5841e]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:29:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-dcfb37c5-301e-455d-9d1f-af26aee9b56c tempest-CreateVolumesFromImageTest-1196585107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-11136acc-c797-403c-ad62-bfb2c4d33ef6 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:25 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-6dde8fdd-7013-4bb8-aeea-144b09acf0ac tempest-CreateVolumesFromImageTest-1196585107 None] Deleted volume successfully. Aug 05 10:29:25 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-6dde8fdd-7013-4bb8-aeea-144b09acf0ac tempest-CreateVolumesFromImageTest-1196585107 None] Lock "cinder-d99b5d84-c8de-4306-ab8d-c856fcbe9d2b-delete_volume" released by "delete_volume" :: held 1.409s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:29:25 devstack sudo[104642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-11136acc-c797-403c-ad62-bfb2c4d33ef6 Aug 05 10:29:25 devstack sudo[104642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:25 devstack sudo[104639]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4062418a-4ee4-4cf9-b5c4-359d0fc3b5b0 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-dbf0e083-c7af-45a5-a7cc-883784d7fe05" returned: 0 in 0.532s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4062418a-4ee4-4cf9-b5c4-359d0fc3b5b0 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-dbf0e083-c7af-45a5-a7cc-883784d7fe05 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:25 devstack sudo[104647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-dbf0e083-c7af-45a5-a7cc-883784d7fe05 Aug 05 10:29:25 devstack sudo[104647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:25 devstack sudo[104642]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-dcfb37c5-301e-455d-9d1f-af26aee9b56c tempest-CreateVolumesFromImageTest-1196585107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-11136acc-c797-403c-ad62-bfb2c4d33ef6" returned: 0 in 0.498s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-dcfb37c5-301e-455d-9d1f-af26aee9b56c tempest-CreateVolumesFromImageTest-1196585107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-11136acc-c797-403c-ad62-bfb2c4d33ef6 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:25 devstack sudo[104652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-11136acc-c797-403c-ad62-bfb2c4d33ef6 Aug 05 10:29:25 devstack sudo[104652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:26 devstack sudo[104647]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:26 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4062418a-4ee4-4cf9-b5c4-359d0fc3b5b0 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-dbf0e083-c7af-45a5-a7cc-883784d7fe05" returned: 0 in 0.291s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:26 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-4062418a-4ee4-4cf9-b5c4-359d0fc3b5b0 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] Lock "cinder-quobyte-dbf0e083-c7af-45a5-a7cc-883784d7fe05" released by "delete_volume" :: held 0.879s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:29:26 devstack cinder-volume[88613]: WARNING cinder.quota [None req-4062418a-4ee4-4cf9-b5c4-359d0fc3b5b0 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Aug 05 10:29:26 devstack cinder-volume[88613]: WARNING cinder.quota [None req-4062418a-4ee4-4cf9-b5c4-359d0fc3b5b0 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Aug 05 10:29:26 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-4062418a-4ee4-4cf9-b5c4-359d0fc3b5b0 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] Created reservations ['f5f50308-284f-4971-9a02-43569357e99e', '87d59a23-d8e5-40c3-94be-66dd5a1cf000', 'ab45810b-7698-4b42-8ca9-7d764081a16e', '4cadf716-aa15-42cc-8688-931014f74cdc'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:29:26 devstack sudo[104652]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:26 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-dcfb37c5-301e-455d-9d1f-af26aee9b56c tempest-CreateVolumesFromImageTest-1196585107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-11136acc-c797-403c-ad62-bfb2c4d33ef6" returned: 0 in 0.291s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:26 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-4062418a-4ee4-4cf9-b5c4-359d0fc3b5b0 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:26 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-4062418a-4ee4-4cf9-b5c4-359d0fc3b5b0 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:26 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-4062418a-4ee4-4cf9-b5c4-359d0fc3b5b0 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:29:26 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-4062418a-4ee4-4cf9-b5c4-359d0fc3b5b0 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:29:26 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-4062418a-4ee4-4cf9-b5c4-359d0fc3b5b0 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:26 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4062418a-4ee4-4cf9-b5c4-359d0fc3b5b0 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:26 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-dcfb37c5-301e-455d-9d1f-af26aee9b56c tempest-CreateVolumesFromImageTest-1196585107 None] Lock "cinder-quobyte-11136acc-c797-403c-ad62-bfb2c4d33ef6" released by "delete_volume" :: held 0.866s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:29:26 devstack sudo[104656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:29:26 devstack sudo[104656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:26 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-dcfb37c5-301e-455d-9d1f-af26aee9b56c tempest-CreateVolumesFromImageTest-1196585107 None] Created reservations ['f88f68f4-a3c7-4e84-918d-edd0c8860beb', 'c3029e95-f952-42cd-90f6-ab12bd47d986', 'da1f899f-5458-441a-8b58-97d519ce9d94', 'b7b202e8-4d75-4fb6-b34f-1433a458c9a7'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:29:26 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-dcfb37c5-301e-455d-9d1f-af26aee9b56c tempest-CreateVolumesFromImageTest-1196585107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:26 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-dcfb37c5-301e-455d-9d1f-af26aee9b56c tempest-CreateVolumesFromImageTest-1196585107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:26 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-dcfb37c5-301e-455d-9d1f-af26aee9b56c tempest-CreateVolumesFromImageTest-1196585107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:29:26 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-dcfb37c5-301e-455d-9d1f-af26aee9b56c tempest-CreateVolumesFromImageTest-1196585107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:29:26 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-dcfb37c5-301e-455d-9d1f-af26aee9b56c tempest-CreateVolumesFromImageTest-1196585107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:26 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-dcfb37c5-301e-455d-9d1f-af26aee9b56c tempest-CreateVolumesFromImageTest-1196585107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:26 devstack sudo[104658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:29:26 devstack sudo[104658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:26 devstack sudo[104656]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:26 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4062418a-4ee4-4cf9-b5c4-359d0fc3b5b0 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.336s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:26 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-4062418a-4ee4-4cf9-b5c4-359d0fc3b5b0 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:29:26 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-4062418a-4ee4-4cf9-b5c4-359d0fc3b5b0 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] Deleted volume successfully. Aug 05 10:29:26 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-4062418a-4ee4-4cf9-b5c4-359d0fc3b5b0 tempest-VolumeAndVolumeTypeFromImageTest-777373759 None] Lock "cinder-dbf0e083-c7af-45a5-a7cc-883784d7fe05-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:29:26 devstack sudo[104658]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:26 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-dcfb37c5-301e-455d-9d1f-af26aee9b56c tempest-CreateVolumesFromImageTest-1196585107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.330s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:26 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-dcfb37c5-301e-455d-9d1f-af26aee9b56c tempest-CreateVolumesFromImageTest-1196585107 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:29:26 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-dcfb37c5-301e-455d-9d1f-af26aee9b56c tempest-CreateVolumesFromImageTest-1196585107 None] Deleted volume successfully. Aug 05 10:29:26 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-dcfb37c5-301e-455d-9d1f-af26aee9b56c tempest-CreateVolumesFromImageTest-1196585107 None] Lock "cinder-11136acc-c797-403c-ad62-bfb2c4d33ef6-delete_volume" released by "delete_volume" :: held 1.470s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:29:33 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-5207b8a9-a1b3-4159-a1ca-e41f90f72e46 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:29:33 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5207b8a9-a1b3-4159-a1ca-e41f90f72e46 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Flow 'volume_create_manager' (7be5622c-53a0-4406-9420-36952adff066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:29:33 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5207b8a9-a1b3-4159-a1ca-e41f90f72e46 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca50ec43-77ec-4e97-b601-9fd3d968abb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:33 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5207b8a9-a1b3-4159-a1ca-e41f90f72e46 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca50ec43-77ec-4e97-b601-9fd3d968abb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:29:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1227053506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cc8d083-72c0-405d-ad6f-51466bf8e86f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc3f21d3e50147f1a5e42a4ca0bf3104',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:29:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:29:33Z,use_quota=True,user_id='724c9a4d12c043198f6e0aed7a2ac707',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:33 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5207b8a9-a1b3-4159-a1ca-e41f90f72e46 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d7e8b05-1f35-4d37-8b01-dea9ae87c357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:33 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5207b8a9-a1b3-4159-a1ca-e41f90f72e46 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d7e8b05-1f35-4d37-8b01-dea9ae87c357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:33 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5207b8a9-a1b3-4159-a1ca-e41f90f72e46 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaea51b3-3377-4d9f-b418-0da08e814a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:33 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5207b8a9-a1b3-4159-a1ca-e41f90f72e46 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaea51b3-3377-4d9f-b418-0da08e814a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cc8d083-72c0-405d-ad6f-51466bf8e86f', 'volume_name': 'volume-4cc8d083-72c0-405d-ad6f-51466bf8e86f', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:33 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5207b8a9-a1b3-4159-a1ca-e41f90f72e46 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21414c55-186d-42d0-93fb-33a414a167f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:33 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5207b8a9-a1b3-4159-a1ca-e41f90f72e46 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21414c55-186d-42d0-93fb-33a414a167f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:33 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5207b8a9-a1b3-4159-a1ca-e41f90f72e46 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8927b6d1-281d-4492-894f-6cb6741955f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:33 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-5207b8a9-a1b3-4159-a1ca-e41f90f72e46 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Volume 4cc8d083-72c0-405d-ad6f-51466bf8e86f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cc8d083-72c0-405d-ad6f-51466bf8e86f', 'volume_size': 1} Aug 05 10:29:33 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5207b8a9-a1b3-4159-a1ca-e41f90f72e46 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:33 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5207b8a9-a1b3-4159-a1ca-e41f90f72e46 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:33 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-5207b8a9-a1b3-4159-a1ca-e41f90f72e46 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:29:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1227053506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cc8d083-72c0-405d-ad6f-51466bf8e86f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc3f21d3e50147f1a5e42a4ca0bf3104',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:29:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:29:33Z,use_quota=True,user_id='724c9a4d12c043198f6e0aed7a2ac707',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:29:33 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-5207b8a9-a1b3-4159-a1ca-e41f90f72e46 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Creating volume 4cc8d083-72c0-405d-ad6f-51466bf8e86f {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:29:33 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5207b8a9-a1b3-4159-a1ca-e41f90f72e46 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:33 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5207b8a9-a1b3-4159-a1ca-e41f90f72e46 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:33 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-5207b8a9-a1b3-4159-a1ca-e41f90f72e46 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:29:33 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-5207b8a9-a1b3-4159-a1ca-e41f90f72e46 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:29:33 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5207b8a9-a1b3-4159-a1ca-e41f90f72e46 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:33 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-5207b8a9-a1b3-4159-a1ca-e41f90f72e46 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:29:33 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-5207b8a9-a1b3-4159-a1ca-e41f90f72e46 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:29:33 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5207b8a9-a1b3-4159-a1ca-e41f90f72e46 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-4cc8d083-72c0-405d-ad6f-51466bf8e86f 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:33 devstack sudo[104665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-4cc8d083-72c0-405d-ad6f-51466bf8e86f 1073741824 Aug 05 10:29:33 devstack sudo[104665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:33 devstack sudo[104665]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:33 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5207b8a9-a1b3-4159-a1ca-e41f90f72e46 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-4cc8d083-72c0-405d-ad6f-51466bf8e86f 1073741824" returned: 0 in 0.496s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:33 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5207b8a9-a1b3-4159-a1ca-e41f90f72e46 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-4cc8d083-72c0-405d-ad6f-51466bf8e86f {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:33 devstack sudo[104672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-4cc8d083-72c0-405d-ad6f-51466bf8e86f Aug 05 10:29:33 devstack sudo[104672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:34 devstack sudo[104672]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:34 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5207b8a9-a1b3-4159-a1ca-e41f90f72e46 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-4cc8d083-72c0-405d-ad6f-51466bf8e86f" returned: 0 in 0.259s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:34 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-5207b8a9-a1b3-4159-a1ca-e41f90f72e46 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:29:34 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5207b8a9-a1b3-4159-a1ca-e41f90f72e46 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:34 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5207b8a9-a1b3-4159-a1ca-e41f90f72e46 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8927b6d1-281d-4492-894f-6cb6741955f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cc8d083-72c0-405d-ad6f-51466bf8e86f', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:34 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5207b8a9-a1b3-4159-a1ca-e41f90f72e46 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3b8a3e3-b3eb-4340-aa11-c347cc15ddc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:34 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-5207b8a9-a1b3-4159-a1ca-e41f90f72e46 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Volume volume-4cc8d083-72c0-405d-ad6f-51466bf8e86f (4cc8d083-72c0-405d-ad6f-51466bf8e86f): created successfully Aug 05 10:29:34 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5207b8a9-a1b3-4159-a1ca-e41f90f72e46 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3b8a3e3-b3eb-4340-aa11-c347cc15ddc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:34 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5207b8a9-a1b3-4159-a1ca-e41f90f72e46 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Flow 'volume_create_manager' (7be5622c-53a0-4406-9420-36952adff066) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:29:34 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-5207b8a9-a1b3-4159-a1ca-e41f90f72e46 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Created volume successfully. Aug 05 10:29:36 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc47fba7-7a27-40b3-a5b8-e0642932ca71 tempest-ProjectReaderTests-505950547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:29:36 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-bc47fba7-7a27-40b3-a5b8-e0642932ca71 tempest-ProjectReaderTests-505950547 None] Flow 'volume_create_manager' (df8e82e7-a569-47be-929d-8efa96edc973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:29:36 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-bc47fba7-7a27-40b3-a5b8-e0642932ca71 tempest-ProjectReaderTests-505950547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2925b97e-0384-4882-89b9-dc7976e658e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:36 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-bc47fba7-7a27-40b3-a5b8-e0642932ca71 tempest-ProjectReaderTests-505950547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2925b97e-0384-4882-89b9-dc7976e658e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:29:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1323611792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52551205-2272-4816-bd8d-88e82ac050b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d41f00ff7f849a0bc4dbcd6f0e2f409',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:29:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:29:36Z,use_quota=True,user_id='bc0567b7a9304b05a5d239c26e171f57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:36 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-bc47fba7-7a27-40b3-a5b8-e0642932ca71 tempest-ProjectReaderTests-505950547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1c0dc8b-8ded-478e-8394-9676cc8ee0c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:36 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-bc47fba7-7a27-40b3-a5b8-e0642932ca71 tempest-ProjectReaderTests-505950547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1c0dc8b-8ded-478e-8394-9676cc8ee0c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:36 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-bc47fba7-7a27-40b3-a5b8-e0642932ca71 tempest-ProjectReaderTests-505950547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ed3e593-b081-4c90-ad7a-b6f14240da47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:36 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-bc47fba7-7a27-40b3-a5b8-e0642932ca71 tempest-ProjectReaderTests-505950547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ed3e593-b081-4c90-ad7a-b6f14240da47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52551205-2272-4816-bd8d-88e82ac050b0', 'volume_name': 'volume-52551205-2272-4816-bd8d-88e82ac050b0', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:36 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-bc47fba7-7a27-40b3-a5b8-e0642932ca71 tempest-ProjectReaderTests-505950547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be9c307a-d6f3-4a98-8cb9-cffe2836d5f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:36 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-bc47fba7-7a27-40b3-a5b8-e0642932ca71 tempest-ProjectReaderTests-505950547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be9c307a-d6f3-4a98-8cb9-cffe2836d5f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:36 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-bc47fba7-7a27-40b3-a5b8-e0642932ca71 tempest-ProjectReaderTests-505950547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d064d654-4f7c-4210-83e4-f337345c255a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:36 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-bc47fba7-7a27-40b3-a5b8-e0642932ca71 tempest-ProjectReaderTests-505950547 None] Volume 52551205-2272-4816-bd8d-88e82ac050b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52551205-2272-4816-bd8d-88e82ac050b0', 'volume_size': 1} Aug 05 10:29:36 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-bc47fba7-7a27-40b3-a5b8-e0642932ca71 tempest-ProjectReaderTests-505950547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:36 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-bc47fba7-7a27-40b3-a5b8-e0642932ca71 tempest-ProjectReaderTests-505950547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:36 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-bc47fba7-7a27-40b3-a5b8-e0642932ca71 tempest-ProjectReaderTests-505950547 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:29:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1323611792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52551205-2272-4816-bd8d-88e82ac050b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d41f00ff7f849a0bc4dbcd6f0e2f409',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:29:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:29:36Z,use_quota=True,user_id='bc0567b7a9304b05a5d239c26e171f57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:29:36 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-bc47fba7-7a27-40b3-a5b8-e0642932ca71 tempest-ProjectReaderTests-505950547 None] Creating volume 52551205-2272-4816-bd8d-88e82ac050b0 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:29:36 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-bc47fba7-7a27-40b3-a5b8-e0642932ca71 tempest-ProjectReaderTests-505950547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:36 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-bc47fba7-7a27-40b3-a5b8-e0642932ca71 tempest-ProjectReaderTests-505950547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:36 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-bc47fba7-7a27-40b3-a5b8-e0642932ca71 tempest-ProjectReaderTests-505950547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:29:36 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-bc47fba7-7a27-40b3-a5b8-e0642932ca71 tempest-ProjectReaderTests-505950547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:29:36 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-bc47fba7-7a27-40b3-a5b8-e0642932ca71 tempest-ProjectReaderTests-505950547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:36 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-bc47fba7-7a27-40b3-a5b8-e0642932ca71 tempest-ProjectReaderTests-505950547 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:29:36 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-bc47fba7-7a27-40b3-a5b8-e0642932ca71 tempest-ProjectReaderTests-505950547 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:29:36 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-bc47fba7-7a27-40b3-a5b8-e0642932ca71 tempest-ProjectReaderTests-505950547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-52551205-2272-4816-bd8d-88e82ac050b0 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:36 devstack sudo[104676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-52551205-2272-4816-bd8d-88e82ac050b0 1073741824 Aug 05 10:29:36 devstack sudo[104676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:36 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-65cc7afc-4a62-4780-b94c-94757da0e80d tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:29:36 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-65cc7afc-4a62-4780-b94c-94757da0e80d tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Flow 'volume_create_manager' (e7a99b24-b574-4dd2-a0d5-66defb2c0129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:29:36 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-65cc7afc-4a62-4780-b94c-94757da0e80d tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01fa877e-5fae-4f05-b6df-62d17d13a41f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:36 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-65cc7afc-4a62-4780-b94c-94757da0e80d tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01fa877e-5fae-4f05-b6df-62d17d13a41f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:29:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-809110400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70d67898-31a6-4e4a-8e57-11de053e89c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc3f21d3e50147f1a5e42a4ca0bf3104',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:29:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:29:36Z,use_quota=True,user_id='724c9a4d12c043198f6e0aed7a2ac707',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:36 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-65cc7afc-4a62-4780-b94c-94757da0e80d tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c971a92-a8b6-4ce3-ad46-272e5a340921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:36 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-65cc7afc-4a62-4780-b94c-94757da0e80d tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c971a92-a8b6-4ce3-ad46-272e5a340921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:36 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-65cc7afc-4a62-4780-b94c-94757da0e80d tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1bbd9f1-c74c-4c15-bbff-6150c9346a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:36 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-65cc7afc-4a62-4780-b94c-94757da0e80d tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1bbd9f1-c74c-4c15-bbff-6150c9346a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70d67898-31a6-4e4a-8e57-11de053e89c0', 'volume_name': 'volume-70d67898-31a6-4e4a-8e57-11de053e89c0', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:36 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-65cc7afc-4a62-4780-b94c-94757da0e80d tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67adf1f9-7727-41b2-9e27-eec807972dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:36 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-65cc7afc-4a62-4780-b94c-94757da0e80d tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67adf1f9-7727-41b2-9e27-eec807972dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:36 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-65cc7afc-4a62-4780-b94c-94757da0e80d tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bed17bf-3a40-4bb6-87ac-142f9913f5db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:36 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-65cc7afc-4a62-4780-b94c-94757da0e80d tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Volume 70d67898-31a6-4e4a-8e57-11de053e89c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70d67898-31a6-4e4a-8e57-11de053e89c0', 'volume_size': 1} Aug 05 10:29:36 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-65cc7afc-4a62-4780-b94c-94757da0e80d tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:36 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-185aff76-1cfd-4fa0-878e-0315f7df4d91 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:29:36 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-185aff76-1cfd-4fa0-878e-0315f7df4d91 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Flow 'volume_create_manager' (8529d7f0-b39a-4270-8245-28ab3249bf70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:29:36 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-185aff76-1cfd-4fa0-878e-0315f7df4d91 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98889ef8-3751-4536-963b-08f0ee60d78d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:36 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-185aff76-1cfd-4fa0-878e-0315f7df4d91 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98889ef8-3751-4536-963b-08f0ee60d78d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:29:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1306466908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b6a55b5-d3ef-4e31-a9f9-cdd6613aa65a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc3f21d3e50147f1a5e42a4ca0bf3104',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:29:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:29:36Z,use_quota=True,user_id='724c9a4d12c043198f6e0aed7a2ac707',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:36 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-185aff76-1cfd-4fa0-878e-0315f7df4d91 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0420e42a-bca4-4e64-b183-f2daa577c57b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:36 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-185aff76-1cfd-4fa0-878e-0315f7df4d91 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0420e42a-bca4-4e64-b183-f2daa577c57b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:36 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-185aff76-1cfd-4fa0-878e-0315f7df4d91 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50702351-1db6-4dc6-91c4-435681c8bf5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:36 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-185aff76-1cfd-4fa0-878e-0315f7df4d91 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50702351-1db6-4dc6-91c4-435681c8bf5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b6a55b5-d3ef-4e31-a9f9-cdd6613aa65a', 'volume_name': 'volume-0b6a55b5-d3ef-4e31-a9f9-cdd6613aa65a', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:36 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-185aff76-1cfd-4fa0-878e-0315f7df4d91 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41695d9c-3b10-47e1-833c-276ecee75002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:36 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-185aff76-1cfd-4fa0-878e-0315f7df4d91 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41695d9c-3b10-47e1-833c-276ecee75002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:36 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-185aff76-1cfd-4fa0-878e-0315f7df4d91 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfec865f-7e4b-4c06-8894-884d49ced82c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:36 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-185aff76-1cfd-4fa0-878e-0315f7df4d91 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Volume 0b6a55b5-d3ef-4e31-a9f9-cdd6613aa65a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b6a55b5-d3ef-4e31-a9f9-cdd6613aa65a', 'volume_size': 1} Aug 05 10:29:36 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-185aff76-1cfd-4fa0-878e-0315f7df4d91 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:36 devstack sudo[104676]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:36 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-bc47fba7-7a27-40b3-a5b8-e0642932ca71 tempest-ProjectReaderTests-505950547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-52551205-2272-4816-bd8d-88e82ac050b0 1073741824" returned: 0 in 0.607s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:36 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-bc47fba7-7a27-40b3-a5b8-e0642932ca71 tempest-ProjectReaderTests-505950547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-52551205-2272-4816-bd8d-88e82ac050b0 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:36 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-90ccd868-753a-4675-a593-b7eaa7d57213 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:29:36 devstack sudo[104682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-52551205-2272-4816-bd8d-88e82ac050b0 Aug 05 10:29:36 devstack sudo[104682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:36 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-90ccd868-753a-4675-a593-b7eaa7d57213 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Flow 'volume_create_manager' (211b300c-5eae-4ad3-b8c8-c99cf07e2c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:29:37 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-90ccd868-753a-4675-a593-b7eaa7d57213 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66edcc9d-2b44-4f21-a8f9-4cd4f6806e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:37 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-90ccd868-753a-4675-a593-b7eaa7d57213 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66edcc9d-2b44-4f21-a8f9-4cd4f6806e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:29:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-392998587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=250c6efe-15dd-4d09-bc7e-ab994c1cc061,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc3f21d3e50147f1a5e42a4ca0bf3104',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:29:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:29:37Z,use_quota=True,user_id='724c9a4d12c043198f6e0aed7a2ac707',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:37 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-90ccd868-753a-4675-a593-b7eaa7d57213 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db2306a2-da6e-4a3e-8b08-c6f1d4a70ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:37 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-90ccd868-753a-4675-a593-b7eaa7d57213 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db2306a2-da6e-4a3e-8b08-c6f1d4a70ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:37 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-90ccd868-753a-4675-a593-b7eaa7d57213 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f516606-7c54-4482-af71-15a303bbcc5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:37 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-90ccd868-753a-4675-a593-b7eaa7d57213 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f516606-7c54-4482-af71-15a303bbcc5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '250c6efe-15dd-4d09-bc7e-ab994c1cc061', 'volume_name': 'volume-250c6efe-15dd-4d09-bc7e-ab994c1cc061', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:37 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-90ccd868-753a-4675-a593-b7eaa7d57213 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9aa4dd21-acb8-433f-a34d-fea7e6fa5750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:37 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-90ccd868-753a-4675-a593-b7eaa7d57213 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9aa4dd21-acb8-433f-a34d-fea7e6fa5750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:37 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-90ccd868-753a-4675-a593-b7eaa7d57213 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfcb1fc3-5571-458d-aec8-80fad027ae4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:37 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-90ccd868-753a-4675-a593-b7eaa7d57213 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Volume 250c6efe-15dd-4d09-bc7e-ab994c1cc061: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-250c6efe-15dd-4d09-bc7e-ab994c1cc061', 'volume_size': 1} Aug 05 10:29:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-90ccd868-753a-4675-a593-b7eaa7d57213 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:37 devstack sudo[104682]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-bc47fba7-7a27-40b3-a5b8-e0642932ca71 tempest-ProjectReaderTests-505950547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-52551205-2272-4816-bd8d-88e82ac050b0" returned: 0 in 0.275s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:37 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-bc47fba7-7a27-40b3-a5b8-e0642932ca71 tempest-ProjectReaderTests-505950547 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:29:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-bc47fba7-7a27-40b3-a5b8-e0642932ca71 tempest-ProjectReaderTests-505950547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-65cc7afc-4a62-4780-b94c-94757da0e80d tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.781s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:37 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-65cc7afc-4a62-4780-b94c-94757da0e80d tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:29:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-809110400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70d67898-31a6-4e4a-8e57-11de053e89c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc3f21d3e50147f1a5e42a4ca0bf3104',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:29:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:29:36Z,use_quota=True,user_id='724c9a4d12c043198f6e0aed7a2ac707',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:29:37 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-65cc7afc-4a62-4780-b94c-94757da0e80d tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Creating volume 70d67898-31a6-4e4a-8e57-11de053e89c0 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:29:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-65cc7afc-4a62-4780-b94c-94757da0e80d tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-65cc7afc-4a62-4780-b94c-94757da0e80d tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:37 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-65cc7afc-4a62-4780-b94c-94757da0e80d tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:29:37 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-65cc7afc-4a62-4780-b94c-94757da0e80d tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:29:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-65cc7afc-4a62-4780-b94c-94757da0e80d tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:37 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-65cc7afc-4a62-4780-b94c-94757da0e80d tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:29:37 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-65cc7afc-4a62-4780-b94c-94757da0e80d tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:29:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-65cc7afc-4a62-4780-b94c-94757da0e80d tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-70d67898-31a6-4e4a-8e57-11de053e89c0 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:37 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-bc47fba7-7a27-40b3-a5b8-e0642932ca71 tempest-ProjectReaderTests-505950547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d064d654-4f7c-4210-83e4-f337345c255a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52551205-2272-4816-bd8d-88e82ac050b0', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:37 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-bc47fba7-7a27-40b3-a5b8-e0642932ca71 tempest-ProjectReaderTests-505950547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc55e228-f194-4c2d-83d9-51b1e7a0d8cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:37 devstack sudo[104685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-70d67898-31a6-4e4a-8e57-11de053e89c0 1073741824 Aug 05 10:29:37 devstack sudo[104685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:37 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-bc47fba7-7a27-40b3-a5b8-e0642932ca71 tempest-ProjectReaderTests-505950547 None] Volume volume-52551205-2272-4816-bd8d-88e82ac050b0 (52551205-2272-4816-bd8d-88e82ac050b0): created successfully Aug 05 10:29:37 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-bc47fba7-7a27-40b3-a5b8-e0642932ca71 tempest-ProjectReaderTests-505950547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc55e228-f194-4c2d-83d9-51b1e7a0d8cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:37 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-bc47fba7-7a27-40b3-a5b8-e0642932ca71 tempest-ProjectReaderTests-505950547 None] Flow 'volume_create_manager' (df8e82e7-a569-47be-929d-8efa96edc973) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:29:37 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-e045ceea-f5e8-4fd2-839b-fabf92694a0f tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:29:37 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-e045ceea-f5e8-4fd2-839b-fabf92694a0f tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Flow 'volume_create_manager' (e70122eb-541c-49c0-bcad-e9d9746e94bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:29:37 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-e045ceea-f5e8-4fd2-839b-fabf92694a0f tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3bc93e2-5594-4dd6-ae7c-cc2b5edc2c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:37 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-bc47fba7-7a27-40b3-a5b8-e0642932ca71 tempest-ProjectReaderTests-505950547 None] Created volume successfully. Aug 05 10:29:37 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-e045ceea-f5e8-4fd2-839b-fabf92694a0f tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3bc93e2-5594-4dd6-ae7c-cc2b5edc2c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:29:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-982253337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f34ebcd7-1f12-4094-b719-2884ed62123b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc3f21d3e50147f1a5e42a4ca0bf3104',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:29:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:29:37Z,use_quota=True,user_id='724c9a4d12c043198f6e0aed7a2ac707',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:37 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-e045ceea-f5e8-4fd2-839b-fabf92694a0f tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d5dafa4-dd9d-4534-b27f-3318b2c1df98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:37 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-e045ceea-f5e8-4fd2-839b-fabf92694a0f tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d5dafa4-dd9d-4534-b27f-3318b2c1df98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:37 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-e045ceea-f5e8-4fd2-839b-fabf92694a0f tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faffeaef-111a-43e1-be24-574e4da04f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:37 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-e045ceea-f5e8-4fd2-839b-fabf92694a0f tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faffeaef-111a-43e1-be24-574e4da04f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f34ebcd7-1f12-4094-b719-2884ed62123b', 'volume_name': 'volume-f34ebcd7-1f12-4094-b719-2884ed62123b', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:37 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-e045ceea-f5e8-4fd2-839b-fabf92694a0f tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9120d63-41cc-4dda-a790-90309caef46b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:37 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-e045ceea-f5e8-4fd2-839b-fabf92694a0f tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9120d63-41cc-4dda-a790-90309caef46b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:37 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-e045ceea-f5e8-4fd2-839b-fabf92694a0f tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e83e644-1148-4cf4-b139-d7ec3c1ab2ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:37 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-e045ceea-f5e8-4fd2-839b-fabf92694a0f tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Volume f34ebcd7-1f12-4094-b719-2884ed62123b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f34ebcd7-1f12-4094-b719-2884ed62123b', 'volume_size': 1} Aug 05 10:29:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-e045ceea-f5e8-4fd2-839b-fabf92694a0f tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:37 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-087c69c3-74f2-42b2-a8c2-3aaa4b9a0922 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:29:37 devstack sudo[104685]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:37 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-087c69c3-74f2-42b2-a8c2-3aaa4b9a0922 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Flow 'volume_create_manager' (9274a835-f190-4a9f-b08a-754b9ff22a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:29:37 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-087c69c3-74f2-42b2-a8c2-3aaa4b9a0922 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38e28a0b-8786-4abe-81ef-6d65a0ef9bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-65cc7afc-4a62-4780-b94c-94757da0e80d tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-70d67898-31a6-4e4a-8e57-11de053e89c0 1073741824" returned: 0 in 0.560s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:37 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-087c69c3-74f2-42b2-a8c2-3aaa4b9a0922 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38e28a0b-8786-4abe-81ef-6d65a0ef9bea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:29:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-513695747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ec98498-523f-417c-b0b0-06cd4b25f398,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc3f21d3e50147f1a5e42a4ca0bf3104',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:29:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:29:38Z,use_quota=True,user_id='724c9a4d12c043198f6e0aed7a2ac707',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:37 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-087c69c3-74f2-42b2-a8c2-3aaa4b9a0922 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b479406-d913-4ca1-a202-5d421fcea756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:37 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-087c69c3-74f2-42b2-a8c2-3aaa4b9a0922 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b479406-d913-4ca1-a202-5d421fcea756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:37 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-087c69c3-74f2-42b2-a8c2-3aaa4b9a0922 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6090dc5c-57aa-4be6-9296-89908bb4863d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:37 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-087c69c3-74f2-42b2-a8c2-3aaa4b9a0922 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6090dc5c-57aa-4be6-9296-89908bb4863d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ec98498-523f-417c-b0b0-06cd4b25f398', 'volume_name': 'volume-4ec98498-523f-417c-b0b0-06cd4b25f398', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:37 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-087c69c3-74f2-42b2-a8c2-3aaa4b9a0922 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dad7a0d0-acee-4d93-a2fb-be271888d8ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:37 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-087c69c3-74f2-42b2-a8c2-3aaa4b9a0922 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dad7a0d0-acee-4d93-a2fb-be271888d8ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:37 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-087c69c3-74f2-42b2-a8c2-3aaa4b9a0922 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c66adbbc-5eb5-4ef8-995b-de97a617b154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:37 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-087c69c3-74f2-42b2-a8c2-3aaa4b9a0922 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Volume 4ec98498-523f-417c-b0b0-06cd4b25f398: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ec98498-523f-417c-b0b0-06cd4b25f398', 'volume_size': 1} Aug 05 10:29:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-087c69c3-74f2-42b2-a8c2-3aaa4b9a0922 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-65cc7afc-4a62-4780-b94c-94757da0e80d tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-70d67898-31a6-4e4a-8e57-11de053e89c0 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:37 devstack sudo[104691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-70d67898-31a6-4e4a-8e57-11de053e89c0 Aug 05 10:29:37 devstack sudo[104691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:38 devstack sudo[104691]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:38 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-65cc7afc-4a62-4780-b94c-94757da0e80d tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-70d67898-31a6-4e4a-8e57-11de053e89c0" returned: 0 in 0.274s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:38 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-65cc7afc-4a62-4780-b94c-94757da0e80d tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:29:38 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-65cc7afc-4a62-4780-b94c-94757da0e80d tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:38 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-185aff76-1cfd-4fa0-878e-0315f7df4d91 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.547s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:38 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-185aff76-1cfd-4fa0-878e-0315f7df4d91 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:29:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1306466908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b6a55b5-d3ef-4e31-a9f9-cdd6613aa65a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc3f21d3e50147f1a5e42a4ca0bf3104',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:29:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:29:36Z,use_quota=True,user_id='724c9a4d12c043198f6e0aed7a2ac707',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:29:38 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-185aff76-1cfd-4fa0-878e-0315f7df4d91 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Creating volume 0b6a55b5-d3ef-4e31-a9f9-cdd6613aa65a {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:29:38 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-185aff76-1cfd-4fa0-878e-0315f7df4d91 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:38 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-185aff76-1cfd-4fa0-878e-0315f7df4d91 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:38 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-185aff76-1cfd-4fa0-878e-0315f7df4d91 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:29:38 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-185aff76-1cfd-4fa0-878e-0315f7df4d91 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:29:38 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-185aff76-1cfd-4fa0-878e-0315f7df4d91 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:38 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-185aff76-1cfd-4fa0-878e-0315f7df4d91 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:29:38 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-185aff76-1cfd-4fa0-878e-0315f7df4d91 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:29:38 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-185aff76-1cfd-4fa0-878e-0315f7df4d91 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0b6a55b5-d3ef-4e31-a9f9-cdd6613aa65a 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:38 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-65cc7afc-4a62-4780-b94c-94757da0e80d tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bed17bf-3a40-4bb6-87ac-142f9913f5db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70d67898-31a6-4e4a-8e57-11de053e89c0', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:38 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-65cc7afc-4a62-4780-b94c-94757da0e80d tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e232b5e7-4eae-49f2-88e9-c81c54f6d4fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:38 devstack sudo[104694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0b6a55b5-d3ef-4e31-a9f9-cdd6613aa65a 1073741824 Aug 05 10:29:38 devstack sudo[104694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:38 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-65cc7afc-4a62-4780-b94c-94757da0e80d tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Volume volume-70d67898-31a6-4e4a-8e57-11de053e89c0 (70d67898-31a6-4e4a-8e57-11de053e89c0): created successfully Aug 05 10:29:38 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-65cc7afc-4a62-4780-b94c-94757da0e80d tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e232b5e7-4eae-49f2-88e9-c81c54f6d4fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:38 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-65cc7afc-4a62-4780-b94c-94757da0e80d tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Flow 'volume_create_manager' (e7a99b24-b574-4dd2-a0d5-66defb2c0129) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:29:38 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-65cc7afc-4a62-4780-b94c-94757da0e80d tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Created volume successfully. Aug 05 10:29:38 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-9091ca96-6d7b-497b-a528-ece2591ab48a tempest-ProjectReaderTests-505950547 None] Acquiring lock "cinder-52551205-2272-4816-bd8d-88e82ac050b0-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:29:38 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-9091ca96-6d7b-497b-a528-ece2591ab48a tempest-ProjectReaderTests-505950547 None] Lock "cinder-52551205-2272-4816-bd8d-88e82ac050b0-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:29:38 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-9091ca96-6d7b-497b-a528-ece2591ab48a tempest-ProjectReaderTests-505950547 None] Acquiring lock "cinder-quobyte-52551205-2272-4816-bd8d-88e82ac050b0" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:29:38 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-9091ca96-6d7b-497b-a528-ece2591ab48a tempest-ProjectReaderTests-505950547 None] Lock "cinder-quobyte-52551205-2272-4816-bd8d-88e82ac050b0" acquired by "delete_volume" :: waited 0.019s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:29:38 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[be49bdbe-4c8d-44e5-852a-e646c3cd8711]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:29:38 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9091ca96-6d7b-497b-a528-ece2591ab48a tempest-ProjectReaderTests-505950547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-52551205-2272-4816-bd8d-88e82ac050b0 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:38 devstack sudo[104696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-52551205-2272-4816-bd8d-88e82ac050b0 Aug 05 10:29:38 devstack sudo[104696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:38 devstack sudo[104694]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:38 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-185aff76-1cfd-4fa0-878e-0315f7df4d91 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0b6a55b5-d3ef-4e31-a9f9-cdd6613aa65a 1073741824" returned: 0 in 0.594s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:38 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-185aff76-1cfd-4fa0-878e-0315f7df4d91 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0b6a55b5-d3ef-4e31-a9f9-cdd6613aa65a {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:38 devstack sudo[104702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0b6a55b5-d3ef-4e31-a9f9-cdd6613aa65a Aug 05 10:29:38 devstack sudo[104702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:38 devstack sudo[104696]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:38 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9091ca96-6d7b-497b-a528-ece2591ab48a tempest-ProjectReaderTests-505950547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-52551205-2272-4816-bd8d-88e82ac050b0" returned: 0 in 0.443s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:38 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9091ca96-6d7b-497b-a528-ece2591ab48a tempest-ProjectReaderTests-505950547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-52551205-2272-4816-bd8d-88e82ac050b0 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:38 devstack sudo[104708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-52551205-2272-4816-bd8d-88e82ac050b0 Aug 05 10:29:38 devstack sudo[104708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:39 devstack sudo[104702]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:39 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-185aff76-1cfd-4fa0-878e-0315f7df4d91 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0b6a55b5-d3ef-4e31-a9f9-cdd6613aa65a" returned: 0 in 0.262s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:39 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-185aff76-1cfd-4fa0-878e-0315f7df4d91 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:29:39 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-185aff76-1cfd-4fa0-878e-0315f7df4d91 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:39 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-90ccd868-753a-4675-a593-b7eaa7d57213 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.994s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:39 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-90ccd868-753a-4675-a593-b7eaa7d57213 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:29:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-392998587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=250c6efe-15dd-4d09-bc7e-ab994c1cc061,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc3f21d3e50147f1a5e42a4ca0bf3104',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:29:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:29:37Z,use_quota=True,user_id='724c9a4d12c043198f6e0aed7a2ac707',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:29:39 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-90ccd868-753a-4675-a593-b7eaa7d57213 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Creating volume 250c6efe-15dd-4d09-bc7e-ab994c1cc061 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:29:39 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-90ccd868-753a-4675-a593-b7eaa7d57213 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:39 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-90ccd868-753a-4675-a593-b7eaa7d57213 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:39 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-90ccd868-753a-4675-a593-b7eaa7d57213 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:29:39 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-90ccd868-753a-4675-a593-b7eaa7d57213 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:29:39 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-90ccd868-753a-4675-a593-b7eaa7d57213 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:39 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-90ccd868-753a-4675-a593-b7eaa7d57213 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:29:39 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-90ccd868-753a-4675-a593-b7eaa7d57213 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:29:39 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-90ccd868-753a-4675-a593-b7eaa7d57213 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-250c6efe-15dd-4d09-bc7e-ab994c1cc061 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:39 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-185aff76-1cfd-4fa0-878e-0315f7df4d91 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfec865f-7e4b-4c06-8894-884d49ced82c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b6a55b5-d3ef-4e31-a9f9-cdd6613aa65a', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:39 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-185aff76-1cfd-4fa0-878e-0315f7df4d91 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ab12b46-454b-4e63-b489-9c7dfc4543d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:39 devstack sudo[104711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-250c6efe-15dd-4d09-bc7e-ab994c1cc061 1073741824 Aug 05 10:29:39 devstack sudo[104711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:39 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-185aff76-1cfd-4fa0-878e-0315f7df4d91 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Volume volume-0b6a55b5-d3ef-4e31-a9f9-cdd6613aa65a (0b6a55b5-d3ef-4e31-a9f9-cdd6613aa65a): created successfully Aug 05 10:29:39 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-185aff76-1cfd-4fa0-878e-0315f7df4d91 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ab12b46-454b-4e63-b489-9c7dfc4543d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:39 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-185aff76-1cfd-4fa0-878e-0315f7df4d91 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Flow 'volume_create_manager' (8529d7f0-b39a-4270-8245-28ab3249bf70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:29:39 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-185aff76-1cfd-4fa0-878e-0315f7df4d91 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Created volume successfully. Aug 05 10:29:39 devstack sudo[104708]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:39 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9091ca96-6d7b-497b-a528-ece2591ab48a tempest-ProjectReaderTests-505950547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-52551205-2272-4816-bd8d-88e82ac050b0" returned: 0 in 0.270s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:39 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-9091ca96-6d7b-497b-a528-ece2591ab48a tempest-ProjectReaderTests-505950547 None] Lock "cinder-quobyte-52551205-2272-4816-bd8d-88e82ac050b0" released by "delete_volume" :: held 0.771s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:29:39 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-9091ca96-6d7b-497b-a528-ece2591ab48a tempest-ProjectReaderTests-505950547 None] Created reservations ['33b3422b-38d4-4d7f-9db2-53807753d024', '49f28a28-f00a-4784-8967-3393e858a5e5', '6cad7baf-f5ac-41f9-83ab-4d1baa857bb3', 'ea5a1b39-c9d2-4849-a9b7-77d460a8bec5'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:29:39 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-9091ca96-6d7b-497b-a528-ece2591ab48a tempest-ProjectReaderTests-505950547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:39 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-9091ca96-6d7b-497b-a528-ece2591ab48a tempest-ProjectReaderTests-505950547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:39 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-9091ca96-6d7b-497b-a528-ece2591ab48a tempest-ProjectReaderTests-505950547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:29:39 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-9091ca96-6d7b-497b-a528-ece2591ab48a tempest-ProjectReaderTests-505950547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:29:39 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-9091ca96-6d7b-497b-a528-ece2591ab48a tempest-ProjectReaderTests-505950547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:39 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9091ca96-6d7b-497b-a528-ece2591ab48a tempest-ProjectReaderTests-505950547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:39 devstack sudo[104718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:29:39 devstack sudo[104718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:39 devstack sudo[104711]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:39 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-90ccd868-753a-4675-a593-b7eaa7d57213 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-250c6efe-15dd-4d09-bc7e-ab994c1cc061 1073741824" returned: 0 in 0.746s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:39 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-90ccd868-753a-4675-a593-b7eaa7d57213 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-250c6efe-15dd-4d09-bc7e-ab994c1cc061 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:39 devstack sudo[104718]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:39 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9091ca96-6d7b-497b-a528-ece2591ab48a tempest-ProjectReaderTests-505950547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.598s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:39 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-9091ca96-6d7b-497b-a528-ece2591ab48a tempest-ProjectReaderTests-505950547 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:29:39 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-9091ca96-6d7b-497b-a528-ece2591ab48a tempest-ProjectReaderTests-505950547 None] Deleted volume successfully. Aug 05 10:29:39 devstack sudo[104723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-250c6efe-15dd-4d09-bc7e-ab994c1cc061 Aug 05 10:29:39 devstack sudo[104723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:40 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-9091ca96-6d7b-497b-a528-ece2591ab48a tempest-ProjectReaderTests-505950547 None] Lock "cinder-52551205-2272-4816-bd8d-88e82ac050b0-delete_volume" released by "delete_volume" :: held 1.655s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:29:40 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-29cff640-af65-4132-a316-799af12b45c1 tempest-ProjectReaderTests-505950547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:29:40 devstack sudo[104723]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:40 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-29cff640-af65-4132-a316-799af12b45c1 tempest-ProjectReaderTests-505950547 None] Flow 'volume_create_manager' (928466ed-3fcd-4b4b-87fe-0703d2fe5ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:29:40 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-29cff640-af65-4132-a316-799af12b45c1 tempest-ProjectReaderTests-505950547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9d07093-6ea8-4c7b-8a68-e55fe1b02ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:40 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-90ccd868-753a-4675-a593-b7eaa7d57213 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-250c6efe-15dd-4d09-bc7e-ab994c1cc061" returned: 0 in 0.410s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:40 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-90ccd868-753a-4675-a593-b7eaa7d57213 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] <== create_volume: return (1268ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:29:40 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-90ccd868-753a-4675-a593-b7eaa7d57213 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.271s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:40 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-e045ceea-f5e8-4fd2-839b-fabf92694a0f tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.901s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:40 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-e045ceea-f5e8-4fd2-839b-fabf92694a0f tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:29:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-982253337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f34ebcd7-1f12-4094-b719-2884ed62123b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc3f21d3e50147f1a5e42a4ca0bf3104',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:29:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:29:37Z,use_quota=True,user_id='724c9a4d12c043198f6e0aed7a2ac707',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:29:40 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-e045ceea-f5e8-4fd2-839b-fabf92694a0f tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Creating volume f34ebcd7-1f12-4094-b719-2884ed62123b {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:29:40 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-e045ceea-f5e8-4fd2-839b-fabf92694a0f tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:40 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-e045ceea-f5e8-4fd2-839b-fabf92694a0f tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:40 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-e045ceea-f5e8-4fd2-839b-fabf92694a0f tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:29:40 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-e045ceea-f5e8-4fd2-839b-fabf92694a0f tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:29:40 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-e045ceea-f5e8-4fd2-839b-fabf92694a0f tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:40 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-e045ceea-f5e8-4fd2-839b-fabf92694a0f tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:29:40 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-e045ceea-f5e8-4fd2-839b-fabf92694a0f tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:29:40 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e045ceea-f5e8-4fd2-839b-fabf92694a0f tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f34ebcd7-1f12-4094-b719-2884ed62123b 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:40 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-29cff640-af65-4132-a316-799af12b45c1 tempest-ProjectReaderTests-505950547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9d07093-6ea8-4c7b-8a68-e55fe1b02ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:29:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-210979865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7edd95c-165a-4c41-9984-69f9f435c183,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d41f00ff7f849a0bc4dbcd6f0e2f409',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:29:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:29:40Z,use_quota=True,user_id='bc0567b7a9304b05a5d239c26e171f57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:40 devstack sudo[104726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f34ebcd7-1f12-4094-b719-2884ed62123b 1073741824 Aug 05 10:29:40 devstack sudo[104726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:40 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-29cff640-af65-4132-a316-799af12b45c1 tempest-ProjectReaderTests-505950547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a2c3d5b-7ed2-4d4b-84ba-e6271da436ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:40 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-29cff640-af65-4132-a316-799af12b45c1 tempest-ProjectReaderTests-505950547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a2c3d5b-7ed2-4d4b-84ba-e6271da436ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:40 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-29cff640-af65-4132-a316-799af12b45c1 tempest-ProjectReaderTests-505950547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86703fda-18ce-4a9d-be33-34677174b97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:40 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-29cff640-af65-4132-a316-799af12b45c1 tempest-ProjectReaderTests-505950547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86703fda-18ce-4a9d-be33-34677174b97f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7edd95c-165a-4c41-9984-69f9f435c183', 'volume_name': 'volume-d7edd95c-165a-4c41-9984-69f9f435c183', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:40 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-29cff640-af65-4132-a316-799af12b45c1 tempest-ProjectReaderTests-505950547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89f6d045-441c-4386-8b52-b7c7ba5b6094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:40 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-29cff640-af65-4132-a316-799af12b45c1 tempest-ProjectReaderTests-505950547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89f6d045-441c-4386-8b52-b7c7ba5b6094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:40 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-29cff640-af65-4132-a316-799af12b45c1 tempest-ProjectReaderTests-505950547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a8c8267-1fbd-4c5a-a3e3-51d5a32404aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:40 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-29cff640-af65-4132-a316-799af12b45c1 tempest-ProjectReaderTests-505950547 None] Volume d7edd95c-165a-4c41-9984-69f9f435c183: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7edd95c-165a-4c41-9984-69f9f435c183', 'volume_size': 1} Aug 05 10:29:40 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-29cff640-af65-4132-a316-799af12b45c1 tempest-ProjectReaderTests-505950547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:40 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-90ccd868-753a-4675-a593-b7eaa7d57213 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfcb1fc3-5571-458d-aec8-80fad027ae4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-250c6efe-15dd-4d09-bc7e-ab994c1cc061', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:40 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-90ccd868-753a-4675-a593-b7eaa7d57213 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e48d4e6e-aab4-4bb2-a64d-234847d14dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:40 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-90ccd868-753a-4675-a593-b7eaa7d57213 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Volume volume-250c6efe-15dd-4d09-bc7e-ab994c1cc061 (250c6efe-15dd-4d09-bc7e-ab994c1cc061): created successfully Aug 05 10:29:40 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-90ccd868-753a-4675-a593-b7eaa7d57213 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e48d4e6e-aab4-4bb2-a64d-234847d14dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:40 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-90ccd868-753a-4675-a593-b7eaa7d57213 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Flow 'volume_create_manager' (211b300c-5eae-4ad3-b8c8-c99cf07e2c1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:29:40 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-90ccd868-753a-4675-a593-b7eaa7d57213 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Created volume successfully. Aug 05 10:29:40 devstack sudo[104726]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:40 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e045ceea-f5e8-4fd2-839b-fabf92694a0f tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f34ebcd7-1f12-4094-b719-2884ed62123b 1073741824" returned: 0 in 0.466s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:40 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e045ceea-f5e8-4fd2-839b-fabf92694a0f tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f34ebcd7-1f12-4094-b719-2884ed62123b {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:40 devstack sudo[104733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f34ebcd7-1f12-4094-b719-2884ed62123b Aug 05 10:29:40 devstack sudo[104733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:41 devstack sudo[104733]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:41 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e045ceea-f5e8-4fd2-839b-fabf92694a0f tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f34ebcd7-1f12-4094-b719-2884ed62123b" returned: 0 in 0.256s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:41 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-e045ceea-f5e8-4fd2-839b-fabf92694a0f tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:29:41 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-e045ceea-f5e8-4fd2-839b-fabf92694a0f tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:41 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-087c69c3-74f2-42b2-a8c2-3aaa4b9a0922 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.286s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:41 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-087c69c3-74f2-42b2-a8c2-3aaa4b9a0922 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:29:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-513695747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ec98498-523f-417c-b0b0-06cd4b25f398,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc3f21d3e50147f1a5e42a4ca0bf3104',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:29:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:29:38Z,use_quota=True,user_id='724c9a4d12c043198f6e0aed7a2ac707',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:29:41 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-087c69c3-74f2-42b2-a8c2-3aaa4b9a0922 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Creating volume 4ec98498-523f-417c-b0b0-06cd4b25f398 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:29:41 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-087c69c3-74f2-42b2-a8c2-3aaa4b9a0922 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:41 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-087c69c3-74f2-42b2-a8c2-3aaa4b9a0922 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:41 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-087c69c3-74f2-42b2-a8c2-3aaa4b9a0922 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:29:41 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-087c69c3-74f2-42b2-a8c2-3aaa4b9a0922 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:29:41 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-087c69c3-74f2-42b2-a8c2-3aaa4b9a0922 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:41 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-087c69c3-74f2-42b2-a8c2-3aaa4b9a0922 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:29:41 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-087c69c3-74f2-42b2-a8c2-3aaa4b9a0922 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:29:41 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-087c69c3-74f2-42b2-a8c2-3aaa4b9a0922 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-4ec98498-523f-417c-b0b0-06cd4b25f398 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:41 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-e045ceea-f5e8-4fd2-839b-fabf92694a0f tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e83e644-1148-4cf4-b139-d7ec3c1ab2ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f34ebcd7-1f12-4094-b719-2884ed62123b', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:41 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-e045ceea-f5e8-4fd2-839b-fabf92694a0f tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eedd807f-82d3-43c3-b423-b2a1f31f8863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:41 devstack sudo[104736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-4ec98498-523f-417c-b0b0-06cd4b25f398 1073741824 Aug 05 10:29:41 devstack sudo[104736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:41 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-e045ceea-f5e8-4fd2-839b-fabf92694a0f tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Volume volume-f34ebcd7-1f12-4094-b719-2884ed62123b (f34ebcd7-1f12-4094-b719-2884ed62123b): created successfully Aug 05 10:29:41 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-e045ceea-f5e8-4fd2-839b-fabf92694a0f tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eedd807f-82d3-43c3-b423-b2a1f31f8863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:41 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-e045ceea-f5e8-4fd2-839b-fabf92694a0f tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Flow 'volume_create_manager' (e70122eb-541c-49c0-bcad-e9d9746e94bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:29:41 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-e045ceea-f5e8-4fd2-839b-fabf92694a0f tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Created volume successfully. Aug 05 10:29:41 devstack sudo[104736]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:41 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-087c69c3-74f2-42b2-a8c2-3aaa4b9a0922 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-4ec98498-523f-417c-b0b0-06cd4b25f398 1073741824" returned: 0 in 0.440s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:41 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-087c69c3-74f2-42b2-a8c2-3aaa4b9a0922 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-4ec98498-523f-417c-b0b0-06cd4b25f398 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:41 devstack sudo[104741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-4ec98498-523f-417c-b0b0-06cd4b25f398 Aug 05 10:29:41 devstack sudo[104741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:41 devstack sudo[104741]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:41 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-087c69c3-74f2-42b2-a8c2-3aaa4b9a0922 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-4ec98498-523f-417c-b0b0-06cd4b25f398" returned: 0 in 0.260s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:41 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-087c69c3-74f2-42b2-a8c2-3aaa4b9a0922 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:29:41 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-087c69c3-74f2-42b2-a8c2-3aaa4b9a0922 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:41 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-29cff640-af65-4132-a316-799af12b45c1 tempest-ProjectReaderTests-505950547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.453s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:41 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-29cff640-af65-4132-a316-799af12b45c1 tempest-ProjectReaderTests-505950547 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:29:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-210979865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7edd95c-165a-4c41-9984-69f9f435c183,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d41f00ff7f849a0bc4dbcd6f0e2f409',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:29:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:29:40Z,use_quota=True,user_id='bc0567b7a9304b05a5d239c26e171f57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:29:41 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-29cff640-af65-4132-a316-799af12b45c1 tempest-ProjectReaderTests-505950547 None] Creating volume d7edd95c-165a-4c41-9984-69f9f435c183 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:29:41 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-29cff640-af65-4132-a316-799af12b45c1 tempest-ProjectReaderTests-505950547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:41 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-29cff640-af65-4132-a316-799af12b45c1 tempest-ProjectReaderTests-505950547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:41 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-29cff640-af65-4132-a316-799af12b45c1 tempest-ProjectReaderTests-505950547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:29:41 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-29cff640-af65-4132-a316-799af12b45c1 tempest-ProjectReaderTests-505950547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:29:41 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-29cff640-af65-4132-a316-799af12b45c1 tempest-ProjectReaderTests-505950547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:41 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-29cff640-af65-4132-a316-799af12b45c1 tempest-ProjectReaderTests-505950547 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:29:41 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-29cff640-af65-4132-a316-799af12b45c1 tempest-ProjectReaderTests-505950547 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:29:41 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-29cff640-af65-4132-a316-799af12b45c1 tempest-ProjectReaderTests-505950547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d7edd95c-165a-4c41-9984-69f9f435c183 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:41 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-087c69c3-74f2-42b2-a8c2-3aaa4b9a0922 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c66adbbc-5eb5-4ef8-995b-de97a617b154) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ec98498-523f-417c-b0b0-06cd4b25f398', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:41 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-087c69c3-74f2-42b2-a8c2-3aaa4b9a0922 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75a55035-eca1-443a-b117-a273d92579d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:41 devstack sudo[104744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d7edd95c-165a-4c41-9984-69f9f435c183 1073741824 Aug 05 10:29:41 devstack sudo[104744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:41 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-087c69c3-74f2-42b2-a8c2-3aaa4b9a0922 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Volume volume-4ec98498-523f-417c-b0b0-06cd4b25f398 (4ec98498-523f-417c-b0b0-06cd4b25f398): created successfully Aug 05 10:29:41 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-087c69c3-74f2-42b2-a8c2-3aaa4b9a0922 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75a55035-eca1-443a-b117-a273d92579d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:41 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-087c69c3-74f2-42b2-a8c2-3aaa4b9a0922 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Flow 'volume_create_manager' (9274a835-f190-4a9f-b08a-754b9ff22a9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:29:41 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-087c69c3-74f2-42b2-a8c2-3aaa4b9a0922 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Created volume successfully. Aug 05 10:29:42 devstack sudo[104744]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:42 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-29cff640-af65-4132-a316-799af12b45c1 tempest-ProjectReaderTests-505950547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d7edd95c-165a-4c41-9984-69f9f435c183 1073741824" returned: 0 in 0.528s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:42 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-29cff640-af65-4132-a316-799af12b45c1 tempest-ProjectReaderTests-505950547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d7edd95c-165a-4c41-9984-69f9f435c183 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:42 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-2b452df1-e429-44d2-af56-5e575fdbb066 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Acquiring lock "cinder-4ec98498-523f-417c-b0b0-06cd4b25f398-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:29:42 devstack sudo[104750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d7edd95c-165a-4c41-9984-69f9f435c183 Aug 05 10:29:42 devstack sudo[104750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:42 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-2b452df1-e429-44d2-af56-5e575fdbb066 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Lock "cinder-4ec98498-523f-417c-b0b0-06cd4b25f398-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:29:42 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-2b452df1-e429-44d2-af56-5e575fdbb066 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Acquiring lock "cinder-quobyte-4ec98498-523f-417c-b0b0-06cd4b25f398" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:29:42 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-2b452df1-e429-44d2-af56-5e575fdbb066 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Lock "cinder-quobyte-4ec98498-523f-417c-b0b0-06cd4b25f398" acquired by "delete_volume" :: waited 0.024s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:29:42 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[61168116-986c-429f-977f-bac5b2444a7f]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:29:42 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2b452df1-e429-44d2-af56-5e575fdbb066 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-4ec98498-523f-417c-b0b0-06cd4b25f398 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:42 devstack sudo[104752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-4ec98498-523f-417c-b0b0-06cd4b25f398 Aug 05 10:29:42 devstack sudo[104752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:42 devstack sudo[104750]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:42 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-29cff640-af65-4132-a316-799af12b45c1 tempest-ProjectReaderTests-505950547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d7edd95c-165a-4c41-9984-69f9f435c183" returned: 0 in 0.350s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:42 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-29cff640-af65-4132-a316-799af12b45c1 tempest-ProjectReaderTests-505950547 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:29:42 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-29cff640-af65-4132-a316-799af12b45c1 tempest-ProjectReaderTests-505950547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:42 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-29cff640-af65-4132-a316-799af12b45c1 tempest-ProjectReaderTests-505950547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a8c8267-1fbd-4c5a-a3e3-51d5a32404aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7edd95c-165a-4c41-9984-69f9f435c183', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:42 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-29cff640-af65-4132-a316-799af12b45c1 tempest-ProjectReaderTests-505950547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1feae78-b350-41c1-9613-70fcafa935eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:42 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-29cff640-af65-4132-a316-799af12b45c1 tempest-ProjectReaderTests-505950547 None] Volume volume-d7edd95c-165a-4c41-9984-69f9f435c183 (d7edd95c-165a-4c41-9984-69f9f435c183): created successfully Aug 05 10:29:42 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-29cff640-af65-4132-a316-799af12b45c1 tempest-ProjectReaderTests-505950547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1feae78-b350-41c1-9613-70fcafa935eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:42 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-29cff640-af65-4132-a316-799af12b45c1 tempest-ProjectReaderTests-505950547 None] Flow 'volume_create_manager' (928466ed-3fcd-4b4b-87fe-0703d2fe5ef8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:29:42 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-29cff640-af65-4132-a316-799af12b45c1 tempest-ProjectReaderTests-505950547 None] Created volume successfully. Aug 05 10:29:43 devstack sudo[104752]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:43 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2b452df1-e429-44d2-af56-5e575fdbb066 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-4ec98498-523f-417c-b0b0-06cd4b25f398" returned: 0 in 0.426s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:43 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2b452df1-e429-44d2-af56-5e575fdbb066 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-4ec98498-523f-417c-b0b0-06cd4b25f398 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:43 devstack sudo[104758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-4ec98498-523f-417c-b0b0-06cd4b25f398 Aug 05 10:29:43 devstack sudo[104758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:43 devstack sudo[104758]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:43 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2b452df1-e429-44d2-af56-5e575fdbb066 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-4ec98498-523f-417c-b0b0-06cd4b25f398" returned: 0 in 0.260s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:43 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-2b452df1-e429-44d2-af56-5e575fdbb066 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Lock "cinder-quobyte-4ec98498-523f-417c-b0b0-06cd4b25f398" released by "delete_volume" :: held 0.735s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:29:43 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-2b452df1-e429-44d2-af56-5e575fdbb066 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Created reservations ['2f61632a-241c-4235-9cee-4ae00088cce8', 'e6d9b83e-97cd-4ded-81d9-7c738df2a759', '90dc441a-0de3-457c-891f-23e5eb9e4a96', 'd02d50f8-b880-414a-9447-3ceec3a146c8'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:29:43 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2b452df1-e429-44d2-af56-5e575fdbb066 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:43 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2b452df1-e429-44d2-af56-5e575fdbb066 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:43 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-2b452df1-e429-44d2-af56-5e575fdbb066 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:29:43 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-2b452df1-e429-44d2-af56-5e575fdbb066 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:29:43 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2b452df1-e429-44d2-af56-5e575fdbb066 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:43 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2b452df1-e429-44d2-af56-5e575fdbb066 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:43 devstack sudo[104761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:29:43 devstack sudo[104761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:43 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-7353a132-6954-4514-ad58-a1247180c443 tempest-ProjectReaderTests-505950547 None] Acquiring lock "cinder-d7edd95c-165a-4c41-9984-69f9f435c183-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:29:43 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-ec4c67a6-65e3-4889-acd6-262ca0d1360e tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Acquiring lock "cinder-f34ebcd7-1f12-4094-b719-2884ed62123b-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:29:43 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-7353a132-6954-4514-ad58-a1247180c443 tempest-ProjectReaderTests-505950547 None] Lock "cinder-d7edd95c-165a-4c41-9984-69f9f435c183-delete_volume" acquired by "delete_volume" :: waited 0.156s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:29:43 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-ec4c67a6-65e3-4889-acd6-262ca0d1360e tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Lock "cinder-f34ebcd7-1f12-4094-b719-2884ed62123b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:29:43 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-7353a132-6954-4514-ad58-a1247180c443 tempest-ProjectReaderTests-505950547 None] Acquiring lock "cinder-quobyte-d7edd95c-165a-4c41-9984-69f9f435c183" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:29:43 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-ec4c67a6-65e3-4889-acd6-262ca0d1360e tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Acquiring lock "cinder-quobyte-f34ebcd7-1f12-4094-b719-2884ed62123b" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:29:43 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-7353a132-6954-4514-ad58-a1247180c443 tempest-ProjectReaderTests-505950547 None] Lock "cinder-quobyte-d7edd95c-165a-4c41-9984-69f9f435c183" acquired by "delete_volume" :: waited 0.031s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:29:43 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-ec4c67a6-65e3-4889-acd6-262ca0d1360e tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Lock "cinder-quobyte-f34ebcd7-1f12-4094-b719-2884ed62123b" acquired by "delete_volume" :: waited 0.041s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:29:43 devstack sudo[104761]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:43 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62b4c87-1dbc-4a00-98e4-a7b404e8d630]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:29:43 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7353a132-6954-4514-ad58-a1247180c443 tempest-ProjectReaderTests-505950547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d7edd95c-165a-4c41-9984-69f9f435c183 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:43 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2b452df1-e429-44d2-af56-5e575fdbb066 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.416s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:43 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-2b452df1-e429-44d2-af56-5e575fdbb066 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:29:43 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-2b452df1-e429-44d2-af56-5e575fdbb066 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Deleted volume successfully. Aug 05 10:29:43 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[97632f5b-84f0-4360-80b6-12a286240c91]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:29:43 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ec4c67a6-65e3-4889-acd6-262ca0d1360e tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f34ebcd7-1f12-4094-b719-2884ed62123b {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:43 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-2b452df1-e429-44d2-af56-5e575fdbb066 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Lock "cinder-4ec98498-523f-417c-b0b0-06cd4b25f398-delete_volume" released by "delete_volume" :: held 1.440s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:29:44 devstack sudo[104764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d7edd95c-165a-4c41-9984-69f9f435c183 Aug 05 10:29:44 devstack sudo[104764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:44 devstack sudo[104765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f34ebcd7-1f12-4094-b719-2884ed62123b Aug 05 10:29:44 devstack sudo[104765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:44 devstack sudo[104764]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:44 devstack sudo[104765]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7353a132-6954-4514-ad58-a1247180c443 tempest-ProjectReaderTests-505950547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d7edd95c-165a-4c41-9984-69f9f435c183" returned: 0 in 0.420s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7353a132-6954-4514-ad58-a1247180c443 tempest-ProjectReaderTests-505950547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d7edd95c-165a-4c41-9984-69f9f435c183 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ec4c67a6-65e3-4889-acd6-262ca0d1360e tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f34ebcd7-1f12-4094-b719-2884ed62123b" returned: 0 in 0.406s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ec4c67a6-65e3-4889-acd6-262ca0d1360e tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f34ebcd7-1f12-4094-b719-2884ed62123b {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:44 devstack sudo[104774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d7edd95c-165a-4c41-9984-69f9f435c183 Aug 05 10:29:44 devstack sudo[104774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:44 devstack sudo[104775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f34ebcd7-1f12-4094-b719-2884ed62123b Aug 05 10:29:44 devstack sudo[104775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:44 devstack sudo[104775]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ec4c67a6-65e3-4889-acd6-262ca0d1360e tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f34ebcd7-1f12-4094-b719-2884ed62123b" returned: 0 in 0.279s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:44 devstack sudo[104774]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7353a132-6954-4514-ad58-a1247180c443 tempest-ProjectReaderTests-505950547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d7edd95c-165a-4c41-9984-69f9f435c183" returned: 0 in 0.312s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:44 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-ec4c67a6-65e3-4889-acd6-262ca0d1360e tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Lock "cinder-quobyte-f34ebcd7-1f12-4094-b719-2884ed62123b" released by "delete_volume" :: held 0.769s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:29:44 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-7353a132-6954-4514-ad58-a1247180c443 tempest-ProjectReaderTests-505950547 None] Lock "cinder-quobyte-d7edd95c-165a-4c41-9984-69f9f435c183" released by "delete_volume" :: held 0.806s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:29:44 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-ec4c67a6-65e3-4889-acd6-262ca0d1360e tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Created reservations ['0b919839-d90d-483e-981c-2a233ccd76b9', '8c72ec4d-1298-4c7b-9c30-08ad23fd6297', '7ba855b6-8fe7-47aa-be24-2a621b6a0315', 'd42e0bcb-9d19-4a49-aa3d-3af0b69f50e3'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:29:44 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-7353a132-6954-4514-ad58-a1247180c443 tempest-ProjectReaderTests-505950547 None] Created reservations ['3bd7795b-8970-4b64-847a-0920bc076deb', '9967dee0-87a3-45be-b89b-6e3eb2a373a9', '6e62347c-d675-40c9-8b61-c290263ca521', '698b35c4-30a1-458b-8eb5-b3a388facfcc'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:29:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-7353a132-6954-4514-ad58-a1247180c443 tempest-ProjectReaderTests-505950547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-7353a132-6954-4514-ad58-a1247180c443 tempest-ProjectReaderTests-505950547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:44 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-7353a132-6954-4514-ad58-a1247180c443 tempest-ProjectReaderTests-505950547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:29:44 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-7353a132-6954-4514-ad58-a1247180c443 tempest-ProjectReaderTests-505950547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:29:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-7353a132-6954-4514-ad58-a1247180c443 tempest-ProjectReaderTests-505950547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7353a132-6954-4514-ad58-a1247180c443 tempest-ProjectReaderTests-505950547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-ec4c67a6-65e3-4889-acd6-262ca0d1360e tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-ec4c67a6-65e3-4889-acd6-262ca0d1360e tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:44 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-ec4c67a6-65e3-4889-acd6-262ca0d1360e tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:29:44 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-ec4c67a6-65e3-4889-acd6-262ca0d1360e tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:29:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-ec4c67a6-65e3-4889-acd6-262ca0d1360e tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:44 devstack sudo[104781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:29:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ec4c67a6-65e3-4889-acd6-262ca0d1360e tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:44 devstack sudo[104781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:44 devstack sudo[104783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:29:44 devstack sudo[104783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:44 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-a996b037-5fa3-43e1-b6fa-54390e1319b7 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Acquiring lock "cinder-250c6efe-15dd-4d09-bc7e-ab994c1cc061-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:29:44 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-a996b037-5fa3-43e1-b6fa-54390e1319b7 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Lock "cinder-250c6efe-15dd-4d09-bc7e-ab994c1cc061-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:29:45 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-a996b037-5fa3-43e1-b6fa-54390e1319b7 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Acquiring lock "cinder-quobyte-250c6efe-15dd-4d09-bc7e-ab994c1cc061" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:29:45 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-a996b037-5fa3-43e1-b6fa-54390e1319b7 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Lock "cinder-quobyte-250c6efe-15dd-4d09-bc7e-ab994c1cc061" acquired by "delete_volume" :: waited 0.025s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:29:45 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d645419-f8f9-4ea0-93a3-ebd66265e381]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:29:45 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a996b037-5fa3-43e1-b6fa-54390e1319b7 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-250c6efe-15dd-4d09-bc7e-ab994c1cc061 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:45 devstack sudo[104781]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:45 devstack sudo[104783]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:45 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7353a132-6954-4514-ad58-a1247180c443 tempest-ProjectReaderTests-505950547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.354s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:45 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-7353a132-6954-4514-ad58-a1247180c443 tempest-ProjectReaderTests-505950547 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:29:45 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ec4c67a6-65e3-4889-acd6-262ca0d1360e tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.309s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:45 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-ec4c67a6-65e3-4889-acd6-262ca0d1360e tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:29:45 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-7353a132-6954-4514-ad58-a1247180c443 tempest-ProjectReaderTests-505950547 None] Deleted volume successfully. Aug 05 10:29:45 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-7353a132-6954-4514-ad58-a1247180c443 tempest-ProjectReaderTests-505950547 None] Lock "cinder-d7edd95c-165a-4c41-9984-69f9f435c183-delete_volume" released by "delete_volume" :: held 1.483s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:29:45 devstack sudo[104785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-250c6efe-15dd-4d09-bc7e-ab994c1cc061 Aug 05 10:29:45 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-ec4c67a6-65e3-4889-acd6-262ca0d1360e tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Deleted volume successfully. Aug 05 10:29:45 devstack sudo[104785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:45 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-ec4c67a6-65e3-4889-acd6-262ca0d1360e tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Lock "cinder-f34ebcd7-1f12-4094-b719-2884ed62123b-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:29:45 devstack sudo[104785]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:45 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a996b037-5fa3-43e1-b6fa-54390e1319b7 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-250c6efe-15dd-4d09-bc7e-ab994c1cc061" returned: 0 in 0.432s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:45 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a996b037-5fa3-43e1-b6fa-54390e1319b7 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-250c6efe-15dd-4d09-bc7e-ab994c1cc061 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:45 devstack sudo[104792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-250c6efe-15dd-4d09-bc7e-ab994c1cc061 Aug 05 10:29:45 devstack sudo[104792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:45 devstack sudo[104792]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:45 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a996b037-5fa3-43e1-b6fa-54390e1319b7 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-250c6efe-15dd-4d09-bc7e-ab994c1cc061" returned: 0 in 0.278s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:45 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-a996b037-5fa3-43e1-b6fa-54390e1319b7 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Lock "cinder-quobyte-250c6efe-15dd-4d09-bc7e-ab994c1cc061" released by "delete_volume" :: held 0.786s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:29:45 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-a996b037-5fa3-43e1-b6fa-54390e1319b7 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Created reservations ['017aea49-5d31-4960-bb8c-bd4a1df1224b', '8c245391-5b9d-406c-b277-782027ab8651', '413d495b-d3e3-4c89-8a72-26a418c1d82b', '823a8782-13cc-4cf4-a350-232019d0691b'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:29:45 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a996b037-5fa3-43e1-b6fa-54390e1319b7 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:45 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a996b037-5fa3-43e1-b6fa-54390e1319b7 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:45 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-a996b037-5fa3-43e1-b6fa-54390e1319b7 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:29:45 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-a996b037-5fa3-43e1-b6fa-54390e1319b7 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:29:45 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a996b037-5fa3-43e1-b6fa-54390e1319b7 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:45 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a996b037-5fa3-43e1-b6fa-54390e1319b7 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:46 devstack sudo[104795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:29:46 devstack sudo[104795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:46 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-c89cd74d-c175-448d-abb0-8f8741c7130b tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Acquiring lock "cinder-0b6a55b5-d3ef-4e31-a9f9-cdd6613aa65a-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:29:46 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-c89cd74d-c175-448d-abb0-8f8741c7130b tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Lock "cinder-0b6a55b5-d3ef-4e31-a9f9-cdd6613aa65a-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:29:46 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-c89cd74d-c175-448d-abb0-8f8741c7130b tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Acquiring lock "cinder-quobyte-0b6a55b5-d3ef-4e31-a9f9-cdd6613aa65a" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:29:46 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-c89cd74d-c175-448d-abb0-8f8741c7130b tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Lock "cinder-quobyte-0b6a55b5-d3ef-4e31-a9f9-cdd6613aa65a" acquired by "delete_volume" :: waited 0.023s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:29:46 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca371e5f-6d03-40c2-b296-56140cad193a]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:29:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c89cd74d-c175-448d-abb0-8f8741c7130b tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0b6a55b5-d3ef-4e31-a9f9-cdd6613aa65a {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:46 devstack sudo[104797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0b6a55b5-d3ef-4e31-a9f9-cdd6613aa65a Aug 05 10:29:46 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8b7e1a2-dcd7-4aa4-9df3-a23654fd85d6 tempest-ProjectReaderTests-505950547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:29:46 devstack sudo[104797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:46 devstack sudo[104795]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:46 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-f8b7e1a2-dcd7-4aa4-9df3-a23654fd85d6 tempest-ProjectReaderTests-505950547 None] Flow 'volume_create_manager' (79e719b4-aea0-415d-99e9-173a6a3c27e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:29:46 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-f8b7e1a2-dcd7-4aa4-9df3-a23654fd85d6 tempest-ProjectReaderTests-505950547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80f3bc76-ad46-4233-8bcd-c3c879f784a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a996b037-5fa3-43e1-b6fa-54390e1319b7 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.466s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:46 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-a996b037-5fa3-43e1-b6fa-54390e1319b7 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:29:46 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-a996b037-5fa3-43e1-b6fa-54390e1319b7 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Deleted volume successfully. Aug 05 10:29:46 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-f8b7e1a2-dcd7-4aa4-9df3-a23654fd85d6 tempest-ProjectReaderTests-505950547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80f3bc76-ad46-4233-8bcd-c3c879f784a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:29:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2111391573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47271804-7b85-4542-b341-0ac613f013b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d41f00ff7f849a0bc4dbcd6f0e2f409',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:29:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:29:46Z,use_quota=True,user_id='bc0567b7a9304b05a5d239c26e171f57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:46 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-f8b7e1a2-dcd7-4aa4-9df3-a23654fd85d6 tempest-ProjectReaderTests-505950547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (491b16bb-d79a-4947-bc8d-a42a5c2cf1da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:46 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-f8b7e1a2-dcd7-4aa4-9df3-a23654fd85d6 tempest-ProjectReaderTests-505950547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (491b16bb-d79a-4947-bc8d-a42a5c2cf1da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:46 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-f8b7e1a2-dcd7-4aa4-9df3-a23654fd85d6 tempest-ProjectReaderTests-505950547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b36e929b-717b-49db-a2da-7429928e0ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:46 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-f8b7e1a2-dcd7-4aa4-9df3-a23654fd85d6 tempest-ProjectReaderTests-505950547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b36e929b-717b-49db-a2da-7429928e0ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47271804-7b85-4542-b341-0ac613f013b4', 'volume_name': 'volume-47271804-7b85-4542-b341-0ac613f013b4', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:46 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-f8b7e1a2-dcd7-4aa4-9df3-a23654fd85d6 tempest-ProjectReaderTests-505950547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f7a7275-2548-4396-b314-907b6dae6d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:46 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-f8b7e1a2-dcd7-4aa4-9df3-a23654fd85d6 tempest-ProjectReaderTests-505950547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f7a7275-2548-4396-b314-907b6dae6d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:46 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-f8b7e1a2-dcd7-4aa4-9df3-a23654fd85d6 tempest-ProjectReaderTests-505950547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac8364d5-e7d9-4843-9f71-f090fef798a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:46 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-f8b7e1a2-dcd7-4aa4-9df3-a23654fd85d6 tempest-ProjectReaderTests-505950547 None] Volume 47271804-7b85-4542-b341-0ac613f013b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47271804-7b85-4542-b341-0ac613f013b4', 'volume_size': 1} Aug 05 10:29:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-f8b7e1a2-dcd7-4aa4-9df3-a23654fd85d6 tempest-ProjectReaderTests-505950547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-f8b7e1a2-dcd7-4aa4-9df3-a23654fd85d6 tempest-ProjectReaderTests-505950547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:46 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-f8b7e1a2-dcd7-4aa4-9df3-a23654fd85d6 tempest-ProjectReaderTests-505950547 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:29:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2111391573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47271804-7b85-4542-b341-0ac613f013b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d41f00ff7f849a0bc4dbcd6f0e2f409',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:29:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:29:46Z,use_quota=True,user_id='bc0567b7a9304b05a5d239c26e171f57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:29:46 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-f8b7e1a2-dcd7-4aa4-9df3-a23654fd85d6 tempest-ProjectReaderTests-505950547 None] Creating volume 47271804-7b85-4542-b341-0ac613f013b4 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:29:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-f8b7e1a2-dcd7-4aa4-9df3-a23654fd85d6 tempest-ProjectReaderTests-505950547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-f8b7e1a2-dcd7-4aa4-9df3-a23654fd85d6 tempest-ProjectReaderTests-505950547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:46 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-f8b7e1a2-dcd7-4aa4-9df3-a23654fd85d6 tempest-ProjectReaderTests-505950547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:29:46 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-f8b7e1a2-dcd7-4aa4-9df3-a23654fd85d6 tempest-ProjectReaderTests-505950547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:29:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-f8b7e1a2-dcd7-4aa4-9df3-a23654fd85d6 tempest-ProjectReaderTests-505950547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:46 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-f8b7e1a2-dcd7-4aa4-9df3-a23654fd85d6 tempest-ProjectReaderTests-505950547 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:29:46 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-f8b7e1a2-dcd7-4aa4-9df3-a23654fd85d6 tempest-ProjectReaderTests-505950547 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:29:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f8b7e1a2-dcd7-4aa4-9df3-a23654fd85d6 tempest-ProjectReaderTests-505950547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-47271804-7b85-4542-b341-0ac613f013b4 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:46 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-a996b037-5fa3-43e1-b6fa-54390e1319b7 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Lock "cinder-250c6efe-15dd-4d09-bc7e-ab994c1cc061-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:29:46 devstack sudo[104800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-47271804-7b85-4542-b341-0ac613f013b4 1073741824 Aug 05 10:29:46 devstack sudo[104800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:46 devstack sudo[104797]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c89cd74d-c175-448d-abb0-8f8741c7130b tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0b6a55b5-d3ef-4e31-a9f9-cdd6613aa65a" returned: 0 in 0.426s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c89cd74d-c175-448d-abb0-8f8741c7130b tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0b6a55b5-d3ef-4e31-a9f9-cdd6613aa65a {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:46 devstack sudo[104806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0b6a55b5-d3ef-4e31-a9f9-cdd6613aa65a Aug 05 10:29:46 devstack sudo[104806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:47 devstack sudo[104806]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:47 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c89cd74d-c175-448d-abb0-8f8741c7130b tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0b6a55b5-d3ef-4e31-a9f9-cdd6613aa65a" returned: 0 in 0.356s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:47 devstack sudo[104800]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:47 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f8b7e1a2-dcd7-4aa4-9df3-a23654fd85d6 tempest-ProjectReaderTests-505950547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-47271804-7b85-4542-b341-0ac613f013b4 1073741824" returned: 0 in 0.544s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:47 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-c89cd74d-c175-448d-abb0-8f8741c7130b tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Lock "cinder-quobyte-0b6a55b5-d3ef-4e31-a9f9-cdd6613aa65a" released by "delete_volume" :: held 0.844s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:29:47 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f8b7e1a2-dcd7-4aa4-9df3-a23654fd85d6 tempest-ProjectReaderTests-505950547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-47271804-7b85-4542-b341-0ac613f013b4 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:47 devstack sudo[104813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-47271804-7b85-4542-b341-0ac613f013b4 Aug 05 10:29:47 devstack sudo[104813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:47 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-c89cd74d-c175-448d-abb0-8f8741c7130b tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Created reservations ['51e0ccfc-053f-4c59-bec6-6de5230fb958', '931fd9e4-989c-4fc9-9285-e2e894c7dfa1', '22005151-3b68-4ad7-8df8-cc6eb7a7f977', 'fce6760d-a8af-447a-9412-1a800f194417'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:29:47 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c89cd74d-c175-448d-abb0-8f8741c7130b tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:47 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c89cd74d-c175-448d-abb0-8f8741c7130b tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:47 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-c89cd74d-c175-448d-abb0-8f8741c7130b tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:29:47 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-c89cd74d-c175-448d-abb0-8f8741c7130b tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:29:47 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c89cd74d-c175-448d-abb0-8f8741c7130b tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:47 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c89cd74d-c175-448d-abb0-8f8741c7130b tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:47 devstack sudo[104815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:29:47 devstack sudo[104815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:47 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-40166330-2a92-4ed0-b125-2fc23f1d9251 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Acquiring lock "cinder-70d67898-31a6-4e4a-8e57-11de053e89c0-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:29:47 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-40166330-2a92-4ed0-b125-2fc23f1d9251 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Lock "cinder-70d67898-31a6-4e4a-8e57-11de053e89c0-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:29:47 devstack sudo[104813]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:47 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f8b7e1a2-dcd7-4aa4-9df3-a23654fd85d6 tempest-ProjectReaderTests-505950547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-47271804-7b85-4542-b341-0ac613f013b4" returned: 0 in 0.410s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:47 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-f8b7e1a2-dcd7-4aa4-9df3-a23654fd85d6 tempest-ProjectReaderTests-505950547 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:29:47 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-f8b7e1a2-dcd7-4aa4-9df3-a23654fd85d6 tempest-ProjectReaderTests-505950547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:47 devstack sudo[104815]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:47 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-40166330-2a92-4ed0-b125-2fc23f1d9251 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Acquiring lock "cinder-quobyte-70d67898-31a6-4e4a-8e57-11de053e89c0" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:29:47 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-f8b7e1a2-dcd7-4aa4-9df3-a23654fd85d6 tempest-ProjectReaderTests-505950547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac8364d5-e7d9-4843-9f71-f090fef798a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47271804-7b85-4542-b341-0ac613f013b4', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:47 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-f8b7e1a2-dcd7-4aa4-9df3-a23654fd85d6 tempest-ProjectReaderTests-505950547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54a230a8-a3a8-4858-a47a-eddbe172b842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:47 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c89cd74d-c175-448d-abb0-8f8741c7130b tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.337s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:47 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-c89cd74d-c175-448d-abb0-8f8741c7130b tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:29:47 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-c89cd74d-c175-448d-abb0-8f8741c7130b tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Deleted volume successfully. Aug 05 10:29:47 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-40166330-2a92-4ed0-b125-2fc23f1d9251 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Lock "cinder-quobyte-70d67898-31a6-4e4a-8e57-11de053e89c0" acquired by "delete_volume" :: waited 0.051s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:29:47 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-f8b7e1a2-dcd7-4aa4-9df3-a23654fd85d6 tempest-ProjectReaderTests-505950547 None] Volume volume-47271804-7b85-4542-b341-0ac613f013b4 (47271804-7b85-4542-b341-0ac613f013b4): created successfully Aug 05 10:29:47 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-f8b7e1a2-dcd7-4aa4-9df3-a23654fd85d6 tempest-ProjectReaderTests-505950547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54a230a8-a3a8-4858-a47a-eddbe172b842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:47 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-f8b7e1a2-dcd7-4aa4-9df3-a23654fd85d6 tempest-ProjectReaderTests-505950547 None] Flow 'volume_create_manager' (79e719b4-aea0-415d-99e9-173a6a3c27e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:29:47 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[025f6ac0-aeb6-4adb-97a7-e5343eabfd15]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:29:47 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-40166330-2a92-4ed0-b125-2fc23f1d9251 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-70d67898-31a6-4e4a-8e57-11de053e89c0 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:47 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-c89cd74d-c175-448d-abb0-8f8741c7130b tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Lock "cinder-0b6a55b5-d3ef-4e31-a9f9-cdd6613aa65a-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:29:47 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-f8b7e1a2-dcd7-4aa4-9df3-a23654fd85d6 tempest-ProjectReaderTests-505950547 None] Created volume successfully. Aug 05 10:29:47 devstack sudo[104819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-70d67898-31a6-4e4a-8e57-11de053e89c0 Aug 05 10:29:47 devstack sudo[104819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:48 devstack sudo[104819]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:48 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-40166330-2a92-4ed0-b125-2fc23f1d9251 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-70d67898-31a6-4e4a-8e57-11de053e89c0" returned: 0 in 0.441s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:48 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-40166330-2a92-4ed0-b125-2fc23f1d9251 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-70d67898-31a6-4e4a-8e57-11de053e89c0 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:48 devstack sudo[104824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-70d67898-31a6-4e4a-8e57-11de053e89c0 Aug 05 10:29:48 devstack sudo[104824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:48 devstack sudo[104824]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:48 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-40166330-2a92-4ed0-b125-2fc23f1d9251 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-70d67898-31a6-4e4a-8e57-11de053e89c0" returned: 0 in 0.250s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:48 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-40166330-2a92-4ed0-b125-2fc23f1d9251 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Lock "cinder-quobyte-70d67898-31a6-4e4a-8e57-11de053e89c0" released by "delete_volume" :: held 0.778s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:29:48 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-40166330-2a92-4ed0-b125-2fc23f1d9251 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Created reservations ['a367603d-1ebf-43e0-895c-0602d67c05bc', 'deae2285-adc8-4de4-83ac-f6a1559b7b1f', 'd4004161-af74-40f7-b6fe-a95e57899640', 'baff1d95-dc4d-4a96-b903-d048d61bc651'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:29:48 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-40166330-2a92-4ed0-b125-2fc23f1d9251 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:48 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-40166330-2a92-4ed0-b125-2fc23f1d9251 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:48 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-40166330-2a92-4ed0-b125-2fc23f1d9251 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:29:48 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-40166330-2a92-4ed0-b125-2fc23f1d9251 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:29:48 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-40166330-2a92-4ed0-b125-2fc23f1d9251 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:48 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-40166330-2a92-4ed0-b125-2fc23f1d9251 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:48 devstack sudo[104827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:29:48 devstack sudo[104827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:48 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-dbd61bd2-b760-4f20-98e8-4a41b2bf0a88 tempest-ProjectReaderTests-505950547 None] Acquiring lock "cinder-47271804-7b85-4542-b341-0ac613f013b4-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:29:48 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-dbd61bd2-b760-4f20-98e8-4a41b2bf0a88 tempest-ProjectReaderTests-505950547 None] Lock "cinder-47271804-7b85-4542-b341-0ac613f013b4-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:29:48 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-dbd61bd2-b760-4f20-98e8-4a41b2bf0a88 tempest-ProjectReaderTests-505950547 None] Acquiring lock "cinder-quobyte-47271804-7b85-4542-b341-0ac613f013b4" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:29:48 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-dbd61bd2-b760-4f20-98e8-4a41b2bf0a88 tempest-ProjectReaderTests-505950547 None] Lock "cinder-quobyte-47271804-7b85-4542-b341-0ac613f013b4" acquired by "delete_volume" :: waited 0.020s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:29:48 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-5dc64bb1-a8dc-410c-baa7-00107c32ea3e tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Acquiring lock "cinder-4cc8d083-72c0-405d-ad6f-51466bf8e86f-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:29:48 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-5dc64bb1-a8dc-410c-baa7-00107c32ea3e tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Lock "cinder-4cc8d083-72c0-405d-ad6f-51466bf8e86f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:29:48 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[058b90c9-7aed-402c-80c8-0060858f7c01]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:29:48 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-dbd61bd2-b760-4f20-98e8-4a41b2bf0a88 tempest-ProjectReaderTests-505950547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-47271804-7b85-4542-b341-0ac613f013b4 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:48 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-5dc64bb1-a8dc-410c-baa7-00107c32ea3e tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Acquiring lock "cinder-quobyte-4cc8d083-72c0-405d-ad6f-51466bf8e86f" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:29:48 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-5dc64bb1-a8dc-410c-baa7-00107c32ea3e tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Lock "cinder-quobyte-4cc8d083-72c0-405d-ad6f-51466bf8e86f" acquired by "delete_volume" :: waited 0.030s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:29:48 devstack sudo[104827]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:48 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-40166330-2a92-4ed0-b125-2fc23f1d9251 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.371s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:48 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-40166330-2a92-4ed0-b125-2fc23f1d9251 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:29:48 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-40166330-2a92-4ed0-b125-2fc23f1d9251 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Deleted volume successfully. Aug 05 10:29:48 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a530e29-6ef7-4eae-b04f-2b72582d5333]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:29:48 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5dc64bb1-a8dc-410c-baa7-00107c32ea3e tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-4cc8d083-72c0-405d-ad6f-51466bf8e86f {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:48 devstack sudo[104829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-47271804-7b85-4542-b341-0ac613f013b4 Aug 05 10:29:48 devstack sudo[104829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:48 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-40166330-2a92-4ed0-b125-2fc23f1d9251 tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Lock "cinder-70d67898-31a6-4e4a-8e57-11de053e89c0-delete_volume" released by "delete_volume" :: held 1.499s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:29:49 devstack sudo[104831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-4cc8d083-72c0-405d-ad6f-51466bf8e86f Aug 05 10:29:49 devstack sudo[104831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:49 devstack sudo[104829]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-dbd61bd2-b760-4f20-98e8-4a41b2bf0a88 tempest-ProjectReaderTests-505950547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-47271804-7b85-4542-b341-0ac613f013b4" returned: 0 in 0.433s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-dbd61bd2-b760-4f20-98e8-4a41b2bf0a88 tempest-ProjectReaderTests-505950547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-47271804-7b85-4542-b341-0ac613f013b4 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:49 devstack sudo[104838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-47271804-7b85-4542-b341-0ac613f013b4 Aug 05 10:29:49 devstack sudo[104838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:49 devstack sudo[104831]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5dc64bb1-a8dc-410c-baa7-00107c32ea3e tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-4cc8d083-72c0-405d-ad6f-51466bf8e86f" returned: 0 in 0.448s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5dc64bb1-a8dc-410c-baa7-00107c32ea3e tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-4cc8d083-72c0-405d-ad6f-51466bf8e86f {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:49 devstack sudo[104843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-4cc8d083-72c0-405d-ad6f-51466bf8e86f Aug 05 10:29:49 devstack sudo[104843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:49 devstack sudo[104838]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-dbd61bd2-b760-4f20-98e8-4a41b2bf0a88 tempest-ProjectReaderTests-505950547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-47271804-7b85-4542-b341-0ac613f013b4" returned: 0 in 0.274s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:49 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-dbd61bd2-b760-4f20-98e8-4a41b2bf0a88 tempest-ProjectReaderTests-505950547 None] Lock "cinder-quobyte-47271804-7b85-4542-b341-0ac613f013b4" released by "delete_volume" :: held 0.798s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:29:49 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-dbd61bd2-b760-4f20-98e8-4a41b2bf0a88 tempest-ProjectReaderTests-505950547 None] Created reservations ['9184e21b-e23c-4677-9777-2430631c6672', '8dca514a-7c1e-4d6b-98fb-0f8b1f5ac506', '286bafc4-4a68-4dd8-a0a9-569595f73ab1', '55f89553-58c8-4b48-83c5-84a7768edaf1'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:29:49 devstack sudo[104843]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5dc64bb1-a8dc-410c-baa7-00107c32ea3e tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-4cc8d083-72c0-405d-ad6f-51466bf8e86f" returned: 0 in 0.338s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:49 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-5dc64bb1-a8dc-410c-baa7-00107c32ea3e tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Lock "cinder-quobyte-4cc8d083-72c0-405d-ad6f-51466bf8e86f" released by "delete_volume" :: held 0.854s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:29:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-dbd61bd2-b760-4f20-98e8-4a41b2bf0a88 tempest-ProjectReaderTests-505950547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-dbd61bd2-b760-4f20-98e8-4a41b2bf0a88 tempest-ProjectReaderTests-505950547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:49 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-dbd61bd2-b760-4f20-98e8-4a41b2bf0a88 tempest-ProjectReaderTests-505950547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:29:49 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-dbd61bd2-b760-4f20-98e8-4a41b2bf0a88 tempest-ProjectReaderTests-505950547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:29:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-dbd61bd2-b760-4f20-98e8-4a41b2bf0a88 tempest-ProjectReaderTests-505950547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-dbd61bd2-b760-4f20-98e8-4a41b2bf0a88 tempest-ProjectReaderTests-505950547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:49 devstack sudo[104847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:29:49 devstack sudo[104847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:49 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-5dc64bb1-a8dc-410c-baa7-00107c32ea3e tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Created reservations ['20643582-f89f-4ae5-8197-fa81c7c6f64e', '15c8ec1a-fb69-412a-8aca-eabb4a86e968', '8693d00c-d00e-4ef2-bfb1-1e7634fa5ea7', 'bc6e1c3d-2e77-4062-86e1-b5f2f1664f48'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:29:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5dc64bb1-a8dc-410c-baa7-00107c32ea3e tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5dc64bb1-a8dc-410c-baa7-00107c32ea3e tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:49 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-5dc64bb1-a8dc-410c-baa7-00107c32ea3e tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:29:49 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-5dc64bb1-a8dc-410c-baa7-00107c32ea3e tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:29:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5dc64bb1-a8dc-410c-baa7-00107c32ea3e tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5dc64bb1-a8dc-410c-baa7-00107c32ea3e tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:50 devstack sudo[104849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:29:50 devstack sudo[104849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:50 devstack sudo[104847]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-dbd61bd2-b760-4f20-98e8-4a41b2bf0a88 tempest-ProjectReaderTests-505950547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.348s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:50 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-dbd61bd2-b760-4f20-98e8-4a41b2bf0a88 tempest-ProjectReaderTests-505950547 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:29:50 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-dbd61bd2-b760-4f20-98e8-4a41b2bf0a88 tempest-ProjectReaderTests-505950547 None] Deleted volume successfully. Aug 05 10:29:50 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-dbd61bd2-b760-4f20-98e8-4a41b2bf0a88 tempest-ProjectReaderTests-505950547 None] Lock "cinder-47271804-7b85-4542-b341-0ac613f013b4-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:29:50 devstack sudo[104849]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5dc64bb1-a8dc-410c-baa7-00107c32ea3e tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.358s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:50 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-5dc64bb1-a8dc-410c-baa7-00107c32ea3e tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:29:50 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-5dc64bb1-a8dc-410c-baa7-00107c32ea3e tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Deleted volume successfully. Aug 05 10:29:50 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-5dc64bb1-a8dc-410c-baa7-00107c32ea3e tempest-CreateVolumesFromSourceVolumeTest-2009401882 None] Lock "cinder-4cc8d083-72c0-405d-ad6f-51466bf8e86f-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:29:50 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-88f256a6-2559-49ee-ac21-f8a80dbc8ac7 tempest-ProjectReaderTests-505950547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:29:50 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-88f256a6-2559-49ee-ac21-f8a80dbc8ac7 tempest-ProjectReaderTests-505950547 None] Flow 'volume_create_manager' (9267df9d-b034-411a-9f6c-eb0d35a288e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:29:50 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-88f256a6-2559-49ee-ac21-f8a80dbc8ac7 tempest-ProjectReaderTests-505950547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b4f578a-5a1b-4433-955c-f368b41f01ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:50 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-88f256a6-2559-49ee-ac21-f8a80dbc8ac7 tempest-ProjectReaderTests-505950547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b4f578a-5a1b-4433-955c-f368b41f01ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-363149007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41fda794-381c-4ccd-acc4-b1008b45c3b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d41f00ff7f849a0bc4dbcd6f0e2f409',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:29:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:29:50Z,use_quota=True,user_id='bc0567b7a9304b05a5d239c26e171f57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:50 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-88f256a6-2559-49ee-ac21-f8a80dbc8ac7 tempest-ProjectReaderTests-505950547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3e87b36-8a45-46c4-bfcd-95ebc2f13c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:50 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-88f256a6-2559-49ee-ac21-f8a80dbc8ac7 tempest-ProjectReaderTests-505950547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3e87b36-8a45-46c4-bfcd-95ebc2f13c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:50 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-88f256a6-2559-49ee-ac21-f8a80dbc8ac7 tempest-ProjectReaderTests-505950547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c254b899-034c-4827-b4e4-25c428b9641c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:50 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-88f256a6-2559-49ee-ac21-f8a80dbc8ac7 tempest-ProjectReaderTests-505950547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c254b899-034c-4827-b4e4-25c428b9641c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41fda794-381c-4ccd-acc4-b1008b45c3b1', 'volume_name': 'volume-41fda794-381c-4ccd-acc4-b1008b45c3b1', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:50 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-88f256a6-2559-49ee-ac21-f8a80dbc8ac7 tempest-ProjectReaderTests-505950547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96ed5b6f-ba81-47ac-9a87-ea9fa804396e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:50 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-88f256a6-2559-49ee-ac21-f8a80dbc8ac7 tempest-ProjectReaderTests-505950547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96ed5b6f-ba81-47ac-9a87-ea9fa804396e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:50 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-88f256a6-2559-49ee-ac21-f8a80dbc8ac7 tempest-ProjectReaderTests-505950547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41cc5fcf-59c3-4516-8a41-87317d1012e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:50 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-88f256a6-2559-49ee-ac21-f8a80dbc8ac7 tempest-ProjectReaderTests-505950547 None] Volume 41fda794-381c-4ccd-acc4-b1008b45c3b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41fda794-381c-4ccd-acc4-b1008b45c3b1', 'volume_size': 1} Aug 05 10:29:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-88f256a6-2559-49ee-ac21-f8a80dbc8ac7 tempest-ProjectReaderTests-505950547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-88f256a6-2559-49ee-ac21-f8a80dbc8ac7 tempest-ProjectReaderTests-505950547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:50 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-88f256a6-2559-49ee-ac21-f8a80dbc8ac7 tempest-ProjectReaderTests-505950547 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-363149007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41fda794-381c-4ccd-acc4-b1008b45c3b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d41f00ff7f849a0bc4dbcd6f0e2f409',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:29:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:29:50Z,use_quota=True,user_id='bc0567b7a9304b05a5d239c26e171f57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:29:50 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-88f256a6-2559-49ee-ac21-f8a80dbc8ac7 tempest-ProjectReaderTests-505950547 None] Creating volume 41fda794-381c-4ccd-acc4-b1008b45c3b1 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:29:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-88f256a6-2559-49ee-ac21-f8a80dbc8ac7 tempest-ProjectReaderTests-505950547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-88f256a6-2559-49ee-ac21-f8a80dbc8ac7 tempest-ProjectReaderTests-505950547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:50 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-88f256a6-2559-49ee-ac21-f8a80dbc8ac7 tempest-ProjectReaderTests-505950547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:29:50 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-88f256a6-2559-49ee-ac21-f8a80dbc8ac7 tempest-ProjectReaderTests-505950547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:29:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-88f256a6-2559-49ee-ac21-f8a80dbc8ac7 tempest-ProjectReaderTests-505950547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:50 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-88f256a6-2559-49ee-ac21-f8a80dbc8ac7 tempest-ProjectReaderTests-505950547 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:29:50 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-88f256a6-2559-49ee-ac21-f8a80dbc8ac7 tempest-ProjectReaderTests-505950547 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:29:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-88f256a6-2559-49ee-ac21-f8a80dbc8ac7 tempest-ProjectReaderTests-505950547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-41fda794-381c-4ccd-acc4-b1008b45c3b1 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:50 devstack sudo[104854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-41fda794-381c-4ccd-acc4-b1008b45c3b1 1073741824 Aug 05 10:29:50 devstack sudo[104854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:51 devstack sudo[104854]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-88f256a6-2559-49ee-ac21-f8a80dbc8ac7 tempest-ProjectReaderTests-505950547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-41fda794-381c-4ccd-acc4-b1008b45c3b1 1073741824" returned: 0 in 0.517s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-88f256a6-2559-49ee-ac21-f8a80dbc8ac7 tempest-ProjectReaderTests-505950547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-41fda794-381c-4ccd-acc4-b1008b45c3b1 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:51 devstack sudo[104860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-41fda794-381c-4ccd-acc4-b1008b45c3b1 Aug 05 10:29:51 devstack sudo[104860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:51 devstack sudo[104860]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-88f256a6-2559-49ee-ac21-f8a80dbc8ac7 tempest-ProjectReaderTests-505950547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-41fda794-381c-4ccd-acc4-b1008b45c3b1" returned: 0 in 0.308s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:51 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-88f256a6-2559-49ee-ac21-f8a80dbc8ac7 tempest-ProjectReaderTests-505950547 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:29:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-88f256a6-2559-49ee-ac21-f8a80dbc8ac7 tempest-ProjectReaderTests-505950547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:51 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-88f256a6-2559-49ee-ac21-f8a80dbc8ac7 tempest-ProjectReaderTests-505950547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41cc5fcf-59c3-4516-8a41-87317d1012e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41fda794-381c-4ccd-acc4-b1008b45c3b1', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:51 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-88f256a6-2559-49ee-ac21-f8a80dbc8ac7 tempest-ProjectReaderTests-505950547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (959cd1e9-e5bf-434e-850b-35a250512660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:51 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-88f256a6-2559-49ee-ac21-f8a80dbc8ac7 tempest-ProjectReaderTests-505950547 None] Volume volume-41fda794-381c-4ccd-acc4-b1008b45c3b1 (41fda794-381c-4ccd-acc4-b1008b45c3b1): created successfully Aug 05 10:29:51 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-88f256a6-2559-49ee-ac21-f8a80dbc8ac7 tempest-ProjectReaderTests-505950547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (959cd1e9-e5bf-434e-850b-35a250512660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:51 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-88f256a6-2559-49ee-ac21-f8a80dbc8ac7 tempest-ProjectReaderTests-505950547 None] Flow 'volume_create_manager' (9267df9d-b034-411a-9f6c-eb0d35a288e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:29:51 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-88f256a6-2559-49ee-ac21-f8a80dbc8ac7 tempest-ProjectReaderTests-505950547 None] Created volume successfully. Aug 05 10:29:52 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-6d154b55-66df-41ba-8dfd-c98a549434a6 tempest-ProjectReaderTests-505950547 None] Acquiring lock "cinder-41fda794-381c-4ccd-acc4-b1008b45c3b1-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:29:52 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-6d154b55-66df-41ba-8dfd-c98a549434a6 tempest-ProjectReaderTests-505950547 None] Lock "cinder-41fda794-381c-4ccd-acc4-b1008b45c3b1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:29:52 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-6d154b55-66df-41ba-8dfd-c98a549434a6 tempest-ProjectReaderTests-505950547 None] Acquiring lock "cinder-quobyte-41fda794-381c-4ccd-acc4-b1008b45c3b1" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:29:52 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-6d154b55-66df-41ba-8dfd-c98a549434a6 tempest-ProjectReaderTests-505950547 None] Lock "cinder-quobyte-41fda794-381c-4ccd-acc4-b1008b45c3b1" acquired by "delete_volume" :: waited 0.027s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:29:52 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfead78b-6ee2-4dc4-a0c3-27161c17a542]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:29:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6d154b55-66df-41ba-8dfd-c98a549434a6 tempest-ProjectReaderTests-505950547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-41fda794-381c-4ccd-acc4-b1008b45c3b1 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:52 devstack sudo[104863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-41fda794-381c-4ccd-acc4-b1008b45c3b1 Aug 05 10:29:52 devstack sudo[104863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:53 devstack sudo[104863]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6d154b55-66df-41ba-8dfd-c98a549434a6 tempest-ProjectReaderTests-505950547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-41fda794-381c-4ccd-acc4-b1008b45c3b1" returned: 0 in 0.394s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6d154b55-66df-41ba-8dfd-c98a549434a6 tempest-ProjectReaderTests-505950547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-41fda794-381c-4ccd-acc4-b1008b45c3b1 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:53 devstack sudo[104869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-41fda794-381c-4ccd-acc4-b1008b45c3b1 Aug 05 10:29:53 devstack sudo[104869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:53 devstack sudo[104869]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6d154b55-66df-41ba-8dfd-c98a549434a6 tempest-ProjectReaderTests-505950547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-41fda794-381c-4ccd-acc4-b1008b45c3b1" returned: 0 in 0.259s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:53 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-6d154b55-66df-41ba-8dfd-c98a549434a6 tempest-ProjectReaderTests-505950547 None] Lock "cinder-quobyte-41fda794-381c-4ccd-acc4-b1008b45c3b1" released by "delete_volume" :: held 0.709s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:29:53 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-6d154b55-66df-41ba-8dfd-c98a549434a6 tempest-ProjectReaderTests-505950547 None] Created reservations ['c81af154-45ab-488f-8b0a-3495f1b64381', '76411b2e-6137-4f49-9be6-0da65e3cc8ca', '9788b054-06bc-4bb6-ad92-496ac4ba8dea', 'f19bccdb-7eb8-4099-bb1e-69969bef45af'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:29:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-6d154b55-66df-41ba-8dfd-c98a549434a6 tempest-ProjectReaderTests-505950547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-6d154b55-66df-41ba-8dfd-c98a549434a6 tempest-ProjectReaderTests-505950547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:53 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-6d154b55-66df-41ba-8dfd-c98a549434a6 tempest-ProjectReaderTests-505950547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:29:53 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-6d154b55-66df-41ba-8dfd-c98a549434a6 tempest-ProjectReaderTests-505950547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:29:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-6d154b55-66df-41ba-8dfd-c98a549434a6 tempest-ProjectReaderTests-505950547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6d154b55-66df-41ba-8dfd-c98a549434a6 tempest-ProjectReaderTests-505950547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:53 devstack sudo[104872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:29:53 devstack sudo[104872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:54 devstack sudo[104872]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6d154b55-66df-41ba-8dfd-c98a549434a6 tempest-ProjectReaderTests-505950547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.486s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:54 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-6d154b55-66df-41ba-8dfd-c98a549434a6 tempest-ProjectReaderTests-505950547 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:29:54 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-6d154b55-66df-41ba-8dfd-c98a549434a6 tempest-ProjectReaderTests-505950547 None] Deleted volume successfully. Aug 05 10:29:54 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-6d154b55-66df-41ba-8dfd-c98a549434a6 tempest-ProjectReaderTests-505950547 None] Lock "cinder-41fda794-381c-4ccd-acc4-b1008b45c3b1-delete_volume" released by "delete_volume" :: held 1.481s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:30:03 devstack cinder-volume[88613]: DEBUG dbcounter [-] [88613] Writing DB stats cinder:SELECT=126,cinder:UPDATE=184,cinder:INSERT=44,cinder:DELETE=10 {{(pid=88613) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:30:04 devstack cinder-volume[88613]: DEBUG dbcounter [-] [88613] Writing DB stats cinder:SELECT=122,cinder:UPDATE=187,cinder:INSERT=50,cinder:DELETE=23 {{(pid=88613) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:30:21 devstack cinder-volume[88613]: DEBUG oslo_service.periodic_task [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88613) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:30:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:30:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:30:21 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:30:21 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:30:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:30:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:21 devstack sudo[105048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:30:21 devstack sudo[105048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:22 devstack sudo[105048]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.238s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:22 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:30:22 devstack cinder-volume[88613]: DEBUG oslo_service.periodic_task [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Running periodic task VolumeManager._thread_info {{(pid=88613) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:30:22 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] thread count: 29 {{(pid=88613) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 10:30:22 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] thread info: [<_MainThread(MainThread, started 126173666128000)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88613) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 10:30:31 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-1400040f-b23f-4e55-9906-566582e5da96 tempest-TestServerVolumeAttachScenarioOldVersion-1882293319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:30:31 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1400040f-b23f-4e55-9906-566582e5da96 tempest-TestServerVolumeAttachScenarioOldVersion-1882293319 None] Flow 'volume_create_manager' (ff8319f1-24de-4e8e-91ec-7e2b5d422436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:30:31 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1400040f-b23f-4e55-9906-566582e5da96 tempest-TestServerVolumeAttachScenarioOldVersion-1882293319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (988b3755-206d-4a26-8abc-44f276a28404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:31 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1400040f-b23f-4e55-9906-566582e5da96 tempest-TestServerVolumeAttachScenarioOldVersion-1882293319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (988b3755-206d-4a26-8abc-44f276a28404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:30:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-340981655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5c467af-189c-41c3-b298-f0bec402190b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bbe431b123d4a06b4c5b2e578dcba83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:30:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:30:32Z,use_quota=True,user_id='da954c7181d24ebb8b3e842a58de7b27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:31 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1400040f-b23f-4e55-9906-566582e5da96 tempest-TestServerVolumeAttachScenarioOldVersion-1882293319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99db083f-97f5-4211-9c79-96be9eb172ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:31 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1400040f-b23f-4e55-9906-566582e5da96 tempest-TestServerVolumeAttachScenarioOldVersion-1882293319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99db083f-97f5-4211-9c79-96be9eb172ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:31 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1400040f-b23f-4e55-9906-566582e5da96 tempest-TestServerVolumeAttachScenarioOldVersion-1882293319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (669cdc05-5631-440b-8e46-5ba6e4e7ec76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:31 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1400040f-b23f-4e55-9906-566582e5da96 tempest-TestServerVolumeAttachScenarioOldVersion-1882293319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (669cdc05-5631-440b-8e46-5ba6e4e7ec76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5c467af-189c-41c3-b298-f0bec402190b', 'volume_name': 'volume-e5c467af-189c-41c3-b298-f0bec402190b', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:31 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1400040f-b23f-4e55-9906-566582e5da96 tempest-TestServerVolumeAttachScenarioOldVersion-1882293319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30a7df6b-de2b-406a-8476-0dac8ee93f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:31 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1400040f-b23f-4e55-9906-566582e5da96 tempest-TestServerVolumeAttachScenarioOldVersion-1882293319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30a7df6b-de2b-406a-8476-0dac8ee93f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:31 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1400040f-b23f-4e55-9906-566582e5da96 tempest-TestServerVolumeAttachScenarioOldVersion-1882293319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3b7118b-7c02-46cf-b669-e9a047918a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:31 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-1400040f-b23f-4e55-9906-566582e5da96 tempest-TestServerVolumeAttachScenarioOldVersion-1882293319 None] Volume e5c467af-189c-41c3-b298-f0bec402190b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5c467af-189c-41c3-b298-f0bec402190b', 'volume_size': 1} Aug 05 10:30:31 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-1400040f-b23f-4e55-9906-566582e5da96 tempest-TestServerVolumeAttachScenarioOldVersion-1882293319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:30:31 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-1400040f-b23f-4e55-9906-566582e5da96 tempest-TestServerVolumeAttachScenarioOldVersion-1882293319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:30:31 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-1400040f-b23f-4e55-9906-566582e5da96 tempest-TestServerVolumeAttachScenarioOldVersion-1882293319 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:30:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-340981655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5c467af-189c-41c3-b298-f0bec402190b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bbe431b123d4a06b4c5b2e578dcba83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:30:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:30:32Z,use_quota=True,user_id='da954c7181d24ebb8b3e842a58de7b27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:30:31 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-1400040f-b23f-4e55-9906-566582e5da96 tempest-TestServerVolumeAttachScenarioOldVersion-1882293319 None] Creating volume e5c467af-189c-41c3-b298-f0bec402190b {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:30:31 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-1400040f-b23f-4e55-9906-566582e5da96 tempest-TestServerVolumeAttachScenarioOldVersion-1882293319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:30:31 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-1400040f-b23f-4e55-9906-566582e5da96 tempest-TestServerVolumeAttachScenarioOldVersion-1882293319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:30:31 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-1400040f-b23f-4e55-9906-566582e5da96 tempest-TestServerVolumeAttachScenarioOldVersion-1882293319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:30:31 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-1400040f-b23f-4e55-9906-566582e5da96 tempest-TestServerVolumeAttachScenarioOldVersion-1882293319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:30:31 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-1400040f-b23f-4e55-9906-566582e5da96 tempest-TestServerVolumeAttachScenarioOldVersion-1882293319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:30:31 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-1400040f-b23f-4e55-9906-566582e5da96 tempest-TestServerVolumeAttachScenarioOldVersion-1882293319 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:30:31 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-1400040f-b23f-4e55-9906-566582e5da96 tempest-TestServerVolumeAttachScenarioOldVersion-1882293319 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:30:31 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1400040f-b23f-4e55-9906-566582e5da96 tempest-TestServerVolumeAttachScenarioOldVersion-1882293319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5c467af-189c-41c3-b298-f0bec402190b 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:31 devstack sudo[105054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5c467af-189c-41c3-b298-f0bec402190b 1073741824 Aug 05 10:30:31 devstack sudo[105054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:32 devstack sudo[105054]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:32 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1400040f-b23f-4e55-9906-566582e5da96 tempest-TestServerVolumeAttachScenarioOldVersion-1882293319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5c467af-189c-41c3-b298-f0bec402190b 1073741824" returned: 0 in 0.405s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:32 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1400040f-b23f-4e55-9906-566582e5da96 tempest-TestServerVolumeAttachScenarioOldVersion-1882293319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5c467af-189c-41c3-b298-f0bec402190b {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:32 devstack sudo[105059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5c467af-189c-41c3-b298-f0bec402190b Aug 05 10:30:32 devstack sudo[105059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:32 devstack sudo[105059]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:32 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1400040f-b23f-4e55-9906-566582e5da96 tempest-TestServerVolumeAttachScenarioOldVersion-1882293319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5c467af-189c-41c3-b298-f0bec402190b" returned: 0 in 0.253s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:32 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-1400040f-b23f-4e55-9906-566582e5da96 tempest-TestServerVolumeAttachScenarioOldVersion-1882293319 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:30:32 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-1400040f-b23f-4e55-9906-566582e5da96 tempest-TestServerVolumeAttachScenarioOldVersion-1882293319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:30:32 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1400040f-b23f-4e55-9906-566582e5da96 tempest-TestServerVolumeAttachScenarioOldVersion-1882293319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3b7118b-7c02-46cf-b669-e9a047918a0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5c467af-189c-41c3-b298-f0bec402190b', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:32 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1400040f-b23f-4e55-9906-566582e5da96 tempest-TestServerVolumeAttachScenarioOldVersion-1882293319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9044e8e0-a302-437b-8515-4349c8a1904c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:32 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-1400040f-b23f-4e55-9906-566582e5da96 tempest-TestServerVolumeAttachScenarioOldVersion-1882293319 None] Volume volume-e5c467af-189c-41c3-b298-f0bec402190b (e5c467af-189c-41c3-b298-f0bec402190b): created successfully Aug 05 10:30:32 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1400040f-b23f-4e55-9906-566582e5da96 tempest-TestServerVolumeAttachScenarioOldVersion-1882293319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9044e8e0-a302-437b-8515-4349c8a1904c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:32 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1400040f-b23f-4e55-9906-566582e5da96 tempest-TestServerVolumeAttachScenarioOldVersion-1882293319 None] Flow 'volume_create_manager' (ff8319f1-24de-4e8e-91ec-7e2b5d422436) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:30:32 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-1400040f-b23f-4e55-9906-566582e5da96 tempest-TestServerVolumeAttachScenarioOldVersion-1882293319 None] Created volume successfully. Aug 05 10:30:33 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-b871bc44-2c65-42ba-b004-bc81e31884b7 req-e7b33f9b-76f0-4932-8d55-e7e960aa382e tempest-TestServerVolumeAttachScenarioOldVersion-1882293319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:30:33 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-b871bc44-2c65-42ba-b004-bc81e31884b7 req-e7b33f9b-76f0-4932-8d55-e7e960aa382e tempest-TestServerVolumeAttachScenarioOldVersion-1882293319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:30:33 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [req-b871bc44-2c65-42ba-b004-bc81e31884b7 req-e7b33f9b-76f0-4932-8d55-e7e960aa382e tempest-TestServerVolumeAttachScenarioOldVersion-1882293319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:30:33 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [req-b871bc44-2c65-42ba-b004-bc81e31884b7 req-e7b33f9b-76f0-4932-8d55-e7e960aa382e tempest-TestServerVolumeAttachScenarioOldVersion-1882293319 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1', 'name': 'volume-e5c467af-189c-41c3-b298-f0bec402190b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '862b388d-b466-4fa2-8d32-4e92d92b909e', 'enforce_multipath': True} {{(pid=88613) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 10:30:33 devstack cinder-volume[88613]: INFO cinder.volume.manager [req-b871bc44-2c65-42ba-b004-bc81e31884b7 req-e7b33f9b-76f0-4932-8d55-e7e960aa382e tempest-TestServerVolumeAttachScenarioOldVersion-1882293319 None] attachment_update completed successfully. Aug 05 10:30:36 devstack cinder-volume[88613]: INFO cinder.volume.manager [req-9c67e09b-6a50-44e7-9404-3f0aecc46c20 req-b96a44b9-dfb2-4314-a17b-b67da3f8a529 tempest-TestServerVolumeAttachScenarioOldVersion-1882293319 None] Terminate volume connection completed successfully. Aug 05 10:30:36 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [req-9c67e09b-6a50-44e7-9404-3f0aecc46c20 req-b96a44b9-dfb2-4314-a17b-b67da3f8a529 tempest-TestServerVolumeAttachScenarioOldVersion-1882293319 None] Deleting attachment 862b388d-b466-4fa2-8d32-4e92d92b909e. {{(pid=88613) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 10:30:37 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-5e931909-17e0-49d0-b683-671c4fb88b4e tempest-TestServerVolumeAttachScenarioOldVersion-1882293319 None] Acquiring lock "cinder-e5c467af-189c-41c3-b298-f0bec402190b-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:30:37 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-5e931909-17e0-49d0-b683-671c4fb88b4e tempest-TestServerVolumeAttachScenarioOldVersion-1882293319 None] Lock "cinder-e5c467af-189c-41c3-b298-f0bec402190b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:30:37 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-5e931909-17e0-49d0-b683-671c4fb88b4e tempest-TestServerVolumeAttachScenarioOldVersion-1882293319 None] Acquiring lock "cinder-quobyte-e5c467af-189c-41c3-b298-f0bec402190b" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:30:37 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-5e931909-17e0-49d0-b683-671c4fb88b4e tempest-TestServerVolumeAttachScenarioOldVersion-1882293319 None] Lock "cinder-quobyte-e5c467af-189c-41c3-b298-f0bec402190b" acquired by "delete_volume" :: waited 0.017s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:30:37 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[d07ae901-4b84-403d-8cf2-14009d5c7c79]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:30:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5e931909-17e0-49d0-b683-671c4fb88b4e tempest-TestServerVolumeAttachScenarioOldVersion-1882293319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5c467af-189c-41c3-b298-f0bec402190b {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:37 devstack sudo[105490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5c467af-189c-41c3-b298-f0bec402190b Aug 05 10:30:37 devstack sudo[105490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:37 devstack sudo[105490]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5e931909-17e0-49d0-b683-671c4fb88b4e tempest-TestServerVolumeAttachScenarioOldVersion-1882293319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5c467af-189c-41c3-b298-f0bec402190b" returned: 0 in 0.351s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5e931909-17e0-49d0-b683-671c4fb88b4e tempest-TestServerVolumeAttachScenarioOldVersion-1882293319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5c467af-189c-41c3-b298-f0bec402190b {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:37 devstack sudo[105495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5c467af-189c-41c3-b298-f0bec402190b Aug 05 10:30:37 devstack sudo[105495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:37 devstack sudo[105495]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5e931909-17e0-49d0-b683-671c4fb88b4e tempest-TestServerVolumeAttachScenarioOldVersion-1882293319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5c467af-189c-41c3-b298-f0bec402190b" returned: 0 in 0.244s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:37 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-5e931909-17e0-49d0-b683-671c4fb88b4e tempest-TestServerVolumeAttachScenarioOldVersion-1882293319 None] Lock "cinder-quobyte-e5c467af-189c-41c3-b298-f0bec402190b" released by "delete_volume" :: held 0.632s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:30:37 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-5e931909-17e0-49d0-b683-671c4fb88b4e tempest-TestServerVolumeAttachScenarioOldVersion-1882293319 None] Created reservations ['c3e9b96e-abb9-4bd9-994d-77746649a6b0', '462c6030-c5a4-4b05-a2f6-1e8763518efc', '3d41302c-b0e7-486f-a644-1d69f9b8e466', '3f1b982b-2370-4eb9-bebf-51a41117dd1c'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:30:38 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5e931909-17e0-49d0-b683-671c4fb88b4e tempest-TestServerVolumeAttachScenarioOldVersion-1882293319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:30:38 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5e931909-17e0-49d0-b683-671c4fb88b4e tempest-TestServerVolumeAttachScenarioOldVersion-1882293319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:30:38 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-5e931909-17e0-49d0-b683-671c4fb88b4e tempest-TestServerVolumeAttachScenarioOldVersion-1882293319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:30:38 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-5e931909-17e0-49d0-b683-671c4fb88b4e tempest-TestServerVolumeAttachScenarioOldVersion-1882293319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:30:38 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5e931909-17e0-49d0-b683-671c4fb88b4e tempest-TestServerVolumeAttachScenarioOldVersion-1882293319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:30:38 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5e931909-17e0-49d0-b683-671c4fb88b4e tempest-TestServerVolumeAttachScenarioOldVersion-1882293319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:38 devstack sudo[105498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:30:38 devstack sudo[105498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:38 devstack sudo[105498]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:38 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5e931909-17e0-49d0-b683-671c4fb88b4e tempest-TestServerVolumeAttachScenarioOldVersion-1882293319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.240s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:38 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-5e931909-17e0-49d0-b683-671c4fb88b4e tempest-TestServerVolumeAttachScenarioOldVersion-1882293319 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:30:38 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-5e931909-17e0-49d0-b683-671c4fb88b4e tempest-TestServerVolumeAttachScenarioOldVersion-1882293319 None] Deleted volume successfully. Aug 05 10:30:38 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-5e931909-17e0-49d0-b683-671c4fb88b4e tempest-TestServerVolumeAttachScenarioOldVersion-1882293319 None] Lock "cinder-e5c467af-189c-41c3-b298-f0bec402190b-delete_volume" released by "delete_volume" :: held 1.071s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:30:48 devstack cinder-volume[88613]: DEBUG dbcounter [-] [88613] Writing DB stats cinder:SELECT=18,cinder:UPDATE=13,cinder:DELETE=1,cinder:INSERT=2 {{(pid=88613) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:30:48 devstack cinder-volume[88613]: DEBUG dbcounter [-] [88613] Writing DB stats cinder:UPDATE=13,cinder:SELECT=12,cinder:INSERT=3,cinder:DELETE=1 {{(pid=88613) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:30:52 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-01c687a8-fd6e-4733-be32-16c4527d6992 tempest-CreateVolumesFromSnapshotTest-533849331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:30:52 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-01c687a8-fd6e-4733-be32-16c4527d6992 tempest-CreateVolumesFromSnapshotTest-533849331 None] Flow 'volume_create_manager' (5c5ab491-ac67-4702-aeb2-f5ce063cc094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:30:52 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-01c687a8-fd6e-4733-be32-16c4527d6992 tempest-CreateVolumesFromSnapshotTest-533849331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd551642-60e2-4f86-8f42-e7e2848b6cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:52 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-01c687a8-fd6e-4733-be32-16c4527d6992 tempest-CreateVolumesFromSnapshotTest-533849331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd551642-60e2-4f86-8f42-e7e2848b6cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:30:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1045752480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0b721ae-7a66-4121-80e1-f31bfa8d0bd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bb9d5705f694c089b3688415d761410',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:30:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:30:52Z,use_quota=True,user_id='38d88985e1474ff3b123a7ac8ec6d907',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:52 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-01c687a8-fd6e-4733-be32-16c4527d6992 tempest-CreateVolumesFromSnapshotTest-533849331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54bfe19d-0200-4b0a-9e69-67dc28cf8f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:52 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-01c687a8-fd6e-4733-be32-16c4527d6992 tempest-CreateVolumesFromSnapshotTest-533849331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54bfe19d-0200-4b0a-9e69-67dc28cf8f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:52 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-01c687a8-fd6e-4733-be32-16c4527d6992 tempest-CreateVolumesFromSnapshotTest-533849331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1b50711-7a28-42cf-9960-deaf04e143fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:52 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-01c687a8-fd6e-4733-be32-16c4527d6992 tempest-CreateVolumesFromSnapshotTest-533849331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1b50711-7a28-42cf-9960-deaf04e143fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0b721ae-7a66-4121-80e1-f31bfa8d0bd9', 'volume_name': 'volume-f0b721ae-7a66-4121-80e1-f31bfa8d0bd9', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:52 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-01c687a8-fd6e-4733-be32-16c4527d6992 tempest-CreateVolumesFromSnapshotTest-533849331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1fea4a8-9d8a-4abd-aa05-90390fe63c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:52 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-01c687a8-fd6e-4733-be32-16c4527d6992 tempest-CreateVolumesFromSnapshotTest-533849331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1fea4a8-9d8a-4abd-aa05-90390fe63c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:52 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-01c687a8-fd6e-4733-be32-16c4527d6992 tempest-CreateVolumesFromSnapshotTest-533849331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c371aea-dd67-433d-87c1-4ffc6933f14b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:52 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-01c687a8-fd6e-4733-be32-16c4527d6992 tempest-CreateVolumesFromSnapshotTest-533849331 None] Volume f0b721ae-7a66-4121-80e1-f31bfa8d0bd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0b721ae-7a66-4121-80e1-f31bfa8d0bd9', 'volume_size': 1} Aug 05 10:30:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-01c687a8-fd6e-4733-be32-16c4527d6992 tempest-CreateVolumesFromSnapshotTest-533849331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:30:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-01c687a8-fd6e-4733-be32-16c4527d6992 tempest-CreateVolumesFromSnapshotTest-533849331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:30:52 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-01c687a8-fd6e-4733-be32-16c4527d6992 tempest-CreateVolumesFromSnapshotTest-533849331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:30:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1045752480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0b721ae-7a66-4121-80e1-f31bfa8d0bd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bb9d5705f694c089b3688415d761410',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:30:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:30:52Z,use_quota=True,user_id='38d88985e1474ff3b123a7ac8ec6d907',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:30:52 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-01c687a8-fd6e-4733-be32-16c4527d6992 tempest-CreateVolumesFromSnapshotTest-533849331 None] Creating volume f0b721ae-7a66-4121-80e1-f31bfa8d0bd9 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:30:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-01c687a8-fd6e-4733-be32-16c4527d6992 tempest-CreateVolumesFromSnapshotTest-533849331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:30:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-01c687a8-fd6e-4733-be32-16c4527d6992 tempest-CreateVolumesFromSnapshotTest-533849331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:30:52 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-01c687a8-fd6e-4733-be32-16c4527d6992 tempest-CreateVolumesFromSnapshotTest-533849331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:30:52 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-01c687a8-fd6e-4733-be32-16c4527d6992 tempest-CreateVolumesFromSnapshotTest-533849331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:30:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-01c687a8-fd6e-4733-be32-16c4527d6992 tempest-CreateVolumesFromSnapshotTest-533849331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:30:52 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-01c687a8-fd6e-4733-be32-16c4527d6992 tempest-CreateVolumesFromSnapshotTest-533849331 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:30:52 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-01c687a8-fd6e-4733-be32-16c4527d6992 tempest-CreateVolumesFromSnapshotTest-533849331 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:30:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-01c687a8-fd6e-4733-be32-16c4527d6992 tempest-CreateVolumesFromSnapshotTest-533849331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f0b721ae-7a66-4121-80e1-f31bfa8d0bd9 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:52 devstack sudo[105537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f0b721ae-7a66-4121-80e1-f31bfa8d0bd9 1073741824 Aug 05 10:30:52 devstack sudo[105537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:52 devstack sudo[105537]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-01c687a8-fd6e-4733-be32-16c4527d6992 tempest-CreateVolumesFromSnapshotTest-533849331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f0b721ae-7a66-4121-80e1-f31bfa8d0bd9 1073741824" returned: 0 in 0.408s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-01c687a8-fd6e-4733-be32-16c4527d6992 tempest-CreateVolumesFromSnapshotTest-533849331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f0b721ae-7a66-4121-80e1-f31bfa8d0bd9 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:52 devstack sudo[105544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f0b721ae-7a66-4121-80e1-f31bfa8d0bd9 Aug 05 10:30:52 devstack sudo[105544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:52 devstack sudo[105544]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-01c687a8-fd6e-4733-be32-16c4527d6992 tempest-CreateVolumesFromSnapshotTest-533849331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f0b721ae-7a66-4121-80e1-f31bfa8d0bd9" returned: 0 in 0.231s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:52 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-01c687a8-fd6e-4733-be32-16c4527d6992 tempest-CreateVolumesFromSnapshotTest-533849331 None] <== create_volume: return (680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:30:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-01c687a8-fd6e-4733-be32-16c4527d6992 tempest-CreateVolumesFromSnapshotTest-533849331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.682s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:30:52 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-01c687a8-fd6e-4733-be32-16c4527d6992 tempest-CreateVolumesFromSnapshotTest-533849331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c371aea-dd67-433d-87c1-4ffc6933f14b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0b721ae-7a66-4121-80e1-f31bfa8d0bd9', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:52 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-01c687a8-fd6e-4733-be32-16c4527d6992 tempest-CreateVolumesFromSnapshotTest-533849331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73b8a6bb-24af-4c4e-9440-cd5783d46bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:52 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-01c687a8-fd6e-4733-be32-16c4527d6992 tempest-CreateVolumesFromSnapshotTest-533849331 None] Volume volume-f0b721ae-7a66-4121-80e1-f31bfa8d0bd9 (f0b721ae-7a66-4121-80e1-f31bfa8d0bd9): created successfully Aug 05 10:30:52 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-01c687a8-fd6e-4733-be32-16c4527d6992 tempest-CreateVolumesFromSnapshotTest-533849331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73b8a6bb-24af-4c4e-9440-cd5783d46bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:52 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-01c687a8-fd6e-4733-be32-16c4527d6992 tempest-CreateVolumesFromSnapshotTest-533849331 None] Flow 'volume_create_manager' (5c5ab491-ac67-4702-aeb2-f5ce063cc094) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:30:52 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-01c687a8-fd6e-4733-be32-16c4527d6992 tempest-CreateVolumesFromSnapshotTest-533849331 None] Created volume successfully. Aug 05 10:30:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5c16be87-dde3-456b-a026-31293223d9b2 tempest-CreateVolumesFromSnapshotTest-533849331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:30:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5c16be87-dde3-456b-a026-31293223d9b2 tempest-CreateVolumesFromSnapshotTest-533849331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:30:53 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-5c16be87-dde3-456b-a026-31293223d9b2 tempest-CreateVolumesFromSnapshotTest-533849331 None] Creating offline snapshot c57706b2-912a-4142-8819-0e339f6bd5d7 of volume f0b721ae-7a66-4121-80e1-f31bfa8d0bd9 {{(pid=88613) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:30:53 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[4691e3f0-d405-4a07-8233-03cc9aeeaf4e]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:30:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5c16be87-dde3-456b-a026-31293223d9b2 tempest-CreateVolumesFromSnapshotTest-533849331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f0b721ae-7a66-4121-80e1-f31bfa8d0bd9 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:53 devstack sudo[105547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f0b721ae-7a66-4121-80e1-f31bfa8d0bd9 Aug 05 10:30:53 devstack sudo[105547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:53 devstack sudo[105547]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5c16be87-dde3-456b-a026-31293223d9b2 tempest-CreateVolumesFromSnapshotTest-533849331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f0b721ae-7a66-4121-80e1-f31bfa8d0bd9" returned: 0 in 0.340s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5c16be87-dde3-456b-a026-31293223d9b2 tempest-CreateVolumesFromSnapshotTest-533849331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f0b721ae-7a66-4121-80e1-f31bfa8d0bd9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f0b721ae-7a66-4121-80e1-f31bfa8d0bd9.c57706b2-912a-4142-8819-0e339f6bd5d7 1G {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:53 devstack sudo[105552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f0b721ae-7a66-4121-80e1-f31bfa8d0bd9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f0b721ae-7a66-4121-80e1-f31bfa8d0bd9.c57706b2-912a-4142-8819-0e339f6bd5d7 1G Aug 05 10:30:53 devstack sudo[105552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:54 devstack sudo[105552]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5c16be87-dde3-456b-a026-31293223d9b2 tempest-CreateVolumesFromSnapshotTest-533849331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f0b721ae-7a66-4121-80e1-f31bfa8d0bd9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f0b721ae-7a66-4121-80e1-f31bfa8d0bd9.c57706b2-912a-4142-8819-0e339f6bd5d7 1G" returned: 0 in 0.373s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5c16be87-dde3-456b-a026-31293223d9b2 tempest-CreateVolumesFromSnapshotTest-533849331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0b721ae-7a66-4121-80e1-f31bfa8d0bd9 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f0b721ae-7a66-4121-80e1-f31bfa8d0bd9.c57706b2-912a-4142-8819-0e339f6bd5d7 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:54 devstack sudo[105557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0b721ae-7a66-4121-80e1-f31bfa8d0bd9 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f0b721ae-7a66-4121-80e1-f31bfa8d0bd9.c57706b2-912a-4142-8819-0e339f6bd5d7 Aug 05 10:30:54 devstack sudo[105557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:54 devstack sudo[105557]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5c16be87-dde3-456b-a026-31293223d9b2 tempest-CreateVolumesFromSnapshotTest-533849331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0b721ae-7a66-4121-80e1-f31bfa8d0bd9 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f0b721ae-7a66-4121-80e1-f31bfa8d0bd9.c57706b2-912a-4142-8819-0e339f6bd5d7" returned: 0 in 0.273s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:54 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-5c16be87-dde3-456b-a026-31293223d9b2 tempest-CreateVolumesFromSnapshotTest-533849331 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f0b721ae-7a66-4121-80e1-f31bfa8d0bd9.c57706b2-912a-4142-8819-0e339f6bd5d7 is being set with open permissions: ugo+rw Aug 05 10:30:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5c16be87-dde3-456b-a026-31293223d9b2 tempest-CreateVolumesFromSnapshotTest-533849331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f0b721ae-7a66-4121-80e1-f31bfa8d0bd9.c57706b2-912a-4142-8819-0e339f6bd5d7 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:54 devstack sudo[105562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f0b721ae-7a66-4121-80e1-f31bfa8d0bd9.c57706b2-912a-4142-8819-0e339f6bd5d7 Aug 05 10:30:54 devstack sudo[105562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:54 devstack sudo[105562]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5c16be87-dde3-456b-a026-31293223d9b2 tempest-CreateVolumesFromSnapshotTest-533849331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f0b721ae-7a66-4121-80e1-f31bfa8d0bd9.c57706b2-912a-4142-8819-0e339f6bd5d7" returned: 0 in 0.234s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5c16be87-dde3-456b-a026-31293223d9b2 tempest-CreateVolumesFromSnapshotTest-533849331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f0b721ae-7a66-4121-80e1-f31bfa8d0bd9.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:54 devstack sudo[105566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f0b721ae-7a66-4121-80e1-f31bfa8d0bd9.info Aug 05 10:30:54 devstack sudo[105566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:54 devstack sudo[105566]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5c16be87-dde3-456b-a026-31293223d9b2 tempest-CreateVolumesFromSnapshotTest-533849331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f0b721ae-7a66-4121-80e1-f31bfa8d0bd9.info" returned: 0 in 0.235s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:54 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-5c16be87-dde3-456b-a026-31293223d9b2 tempest-CreateVolumesFromSnapshotTest-533849331 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f0b721ae-7a66-4121-80e1-f31bfa8d0bd9.info is being set with open permissions: ugo+rw Aug 05 10:30:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5c16be87-dde3-456b-a026-31293223d9b2 tempest-CreateVolumesFromSnapshotTest-533849331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f0b721ae-7a66-4121-80e1-f31bfa8d0bd9.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:54 devstack sudo[105569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f0b721ae-7a66-4121-80e1-f31bfa8d0bd9.info Aug 05 10:30:54 devstack sudo[105569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:55 devstack sudo[105569]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:55 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5c16be87-dde3-456b-a026-31293223d9b2 tempest-CreateVolumesFromSnapshotTest-533849331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f0b721ae-7a66-4121-80e1-f31bfa8d0bd9.info" returned: 0 in 0.232s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:55 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5c16be87-dde3-456b-a026-31293223d9b2 tempest-CreateVolumesFromSnapshotTest-533849331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.765s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:30:55 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-5c16be87-dde3-456b-a026-31293223d9b2 tempest-CreateVolumesFromSnapshotTest-533849331 None] Create snapshot completed successfully Aug 05 10:30:55 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-36adf990-3d0b-4f14-b1f4-ca26647f8d6c tempest-CreateVolumesFromSnapshotTest-533849331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:30:55 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-36adf990-3d0b-4f14-b1f4-ca26647f8d6c tempest-CreateVolumesFromSnapshotTest-533849331 None] Flow 'volume_create_manager' (91999870-614a-47ab-97c4-60948526ec80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:30:55 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-36adf990-3d0b-4f14-b1f4-ca26647f8d6c tempest-CreateVolumesFromSnapshotTest-533849331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7ffcbf9-520f-4d1c-9068-86bb4c9c7303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:55 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-36adf990-3d0b-4f14-b1f4-ca26647f8d6c tempest-CreateVolumesFromSnapshotTest-533849331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7ffcbf9-520f-4d1c-9068-86bb4c9c7303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:30:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-765570190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4ab5105-bf69-4844-8a4a-0547e4d6b22a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bb9d5705f694c089b3688415d761410',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:30:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:30:56Z,use_quota=True,user_id='38d88985e1474ff3b123a7ac8ec6d907',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:55 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-36adf990-3d0b-4f14-b1f4-ca26647f8d6c tempest-CreateVolumesFromSnapshotTest-533849331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42a83350-01db-46d7-aa6e-363d60ea6cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:55 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-36adf990-3d0b-4f14-b1f4-ca26647f8d6c tempest-CreateVolumesFromSnapshotTest-533849331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42a83350-01db-46d7-aa6e-363d60ea6cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:55 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-36adf990-3d0b-4f14-b1f4-ca26647f8d6c tempest-CreateVolumesFromSnapshotTest-533849331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33c3a133-0d4d-4a73-9ddc-cf3968c7866c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:55 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-36adf990-3d0b-4f14-b1f4-ca26647f8d6c tempest-CreateVolumesFromSnapshotTest-533849331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33c3a133-0d4d-4a73-9ddc-cf3968c7866c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4ab5105-bf69-4844-8a4a-0547e4d6b22a', 'volume_name': 'volume-e4ab5105-bf69-4844-8a4a-0547e4d6b22a', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:55 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-36adf990-3d0b-4f14-b1f4-ca26647f8d6c tempest-CreateVolumesFromSnapshotTest-533849331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (486a6c53-2809-49d6-bc19-65887cc9430b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:55 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-36adf990-3d0b-4f14-b1f4-ca26647f8d6c tempest-CreateVolumesFromSnapshotTest-533849331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (486a6c53-2809-49d6-bc19-65887cc9430b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:55 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-36adf990-3d0b-4f14-b1f4-ca26647f8d6c tempest-CreateVolumesFromSnapshotTest-533849331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b85d99ed-1b1a-4092-8a35-48c134db2f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:55 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-36adf990-3d0b-4f14-b1f4-ca26647f8d6c tempest-CreateVolumesFromSnapshotTest-533849331 None] Volume e4ab5105-bf69-4844-8a4a-0547e4d6b22a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4ab5105-bf69-4844-8a4a-0547e4d6b22a', 'volume_size': 1} Aug 05 10:30:55 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-36adf990-3d0b-4f14-b1f4-ca26647f8d6c tempest-CreateVolumesFromSnapshotTest-533849331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:30:55 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-36adf990-3d0b-4f14-b1f4-ca26647f8d6c tempest-CreateVolumesFromSnapshotTest-533849331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:30:55 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-36adf990-3d0b-4f14-b1f4-ca26647f8d6c tempest-CreateVolumesFromSnapshotTest-533849331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:30:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-765570190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4ab5105-bf69-4844-8a4a-0547e4d6b22a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bb9d5705f694c089b3688415d761410',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:30:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:30:56Z,use_quota=True,user_id='38d88985e1474ff3b123a7ac8ec6d907',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:30:55 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-36adf990-3d0b-4f14-b1f4-ca26647f8d6c tempest-CreateVolumesFromSnapshotTest-533849331 None] Creating volume e4ab5105-bf69-4844-8a4a-0547e4d6b22a {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:30:55 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-36adf990-3d0b-4f14-b1f4-ca26647f8d6c tempest-CreateVolumesFromSnapshotTest-533849331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:30:55 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-36adf990-3d0b-4f14-b1f4-ca26647f8d6c tempest-CreateVolumesFromSnapshotTest-533849331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:30:55 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-36adf990-3d0b-4f14-b1f4-ca26647f8d6c tempest-CreateVolumesFromSnapshotTest-533849331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:30:55 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-36adf990-3d0b-4f14-b1f4-ca26647f8d6c tempest-CreateVolumesFromSnapshotTest-533849331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:30:55 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-36adf990-3d0b-4f14-b1f4-ca26647f8d6c tempest-CreateVolumesFromSnapshotTest-533849331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:30:55 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-36adf990-3d0b-4f14-b1f4-ca26647f8d6c tempest-CreateVolumesFromSnapshotTest-533849331 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:30:55 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-36adf990-3d0b-4f14-b1f4-ca26647f8d6c tempest-CreateVolumesFromSnapshotTest-533849331 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:30:55 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-36adf990-3d0b-4f14-b1f4-ca26647f8d6c tempest-CreateVolumesFromSnapshotTest-533849331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e4ab5105-bf69-4844-8a4a-0547e4d6b22a 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:55 devstack sudo[105572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e4ab5105-bf69-4844-8a4a-0547e4d6b22a 1073741824 Aug 05 10:30:55 devstack sudo[105572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:56 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-5be9e8c3-d6bd-41c6-aa98-4614395da9aa tempest-CreateVolumesFromSnapshotTest-533849331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:30:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5be9e8c3-d6bd-41c6-aa98-4614395da9aa tempest-CreateVolumesFromSnapshotTest-533849331 None] Flow 'volume_create_manager' (f031c034-f7fd-4948-afe1-809367d85bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:30:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5be9e8c3-d6bd-41c6-aa98-4614395da9aa tempest-CreateVolumesFromSnapshotTest-533849331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c49fba5e-890f-48bc-8ac2-80a091c761fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5be9e8c3-d6bd-41c6-aa98-4614395da9aa tempest-CreateVolumesFromSnapshotTest-533849331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c49fba5e-890f-48bc-8ac2-80a091c761fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:30:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-181961974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96193dc0-cd41-45ba-82d6-d5d36c5b0afb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bb9d5705f694c089b3688415d761410',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:30:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:30:56Z,use_quota=True,user_id='38d88985e1474ff3b123a7ac8ec6d907',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5be9e8c3-d6bd-41c6-aa98-4614395da9aa tempest-CreateVolumesFromSnapshotTest-533849331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (611b6cf6-0386-4e2a-b3ae-f634353dc333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5be9e8c3-d6bd-41c6-aa98-4614395da9aa tempest-CreateVolumesFromSnapshotTest-533849331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (611b6cf6-0386-4e2a-b3ae-f634353dc333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5be9e8c3-d6bd-41c6-aa98-4614395da9aa tempest-CreateVolumesFromSnapshotTest-533849331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a4c02d5-7e70-438a-a2f3-8228a0771def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5be9e8c3-d6bd-41c6-aa98-4614395da9aa tempest-CreateVolumesFromSnapshotTest-533849331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a4c02d5-7e70-438a-a2f3-8228a0771def) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96193dc0-cd41-45ba-82d6-d5d36c5b0afb', 'volume_name': 'volume-96193dc0-cd41-45ba-82d6-d5d36c5b0afb', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5be9e8c3-d6bd-41c6-aa98-4614395da9aa tempest-CreateVolumesFromSnapshotTest-533849331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e52cc10e-fde5-4af6-8d08-dd2efcd4aca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5be9e8c3-d6bd-41c6-aa98-4614395da9aa tempest-CreateVolumesFromSnapshotTest-533849331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e52cc10e-fde5-4af6-8d08-dd2efcd4aca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5be9e8c3-d6bd-41c6-aa98-4614395da9aa tempest-CreateVolumesFromSnapshotTest-533849331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73cb6391-5b04-470f-a21c-08c16993ea03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:56 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-5be9e8c3-d6bd-41c6-aa98-4614395da9aa tempest-CreateVolumesFromSnapshotTest-533849331 None] Volume 96193dc0-cd41-45ba-82d6-d5d36c5b0afb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96193dc0-cd41-45ba-82d6-d5d36c5b0afb', 'volume_size': 1} Aug 05 10:30:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5be9e8c3-d6bd-41c6-aa98-4614395da9aa tempest-CreateVolumesFromSnapshotTest-533849331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:30:56 devstack sudo[105572]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-36adf990-3d0b-4f14-b1f4-ca26647f8d6c tempest-CreateVolumesFromSnapshotTest-533849331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e4ab5105-bf69-4844-8a4a-0547e4d6b22a 1073741824" returned: 0 in 0.481s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-36adf990-3d0b-4f14-b1f4-ca26647f8d6c tempest-CreateVolumesFromSnapshotTest-533849331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e4ab5105-bf69-4844-8a4a-0547e4d6b22a {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:56 devstack sudo[105578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e4ab5105-bf69-4844-8a4a-0547e4d6b22a Aug 05 10:30:56 devstack sudo[105578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:56 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-00bd0d4d-5884-471a-96b1-59727dd97861 tempest-CreateVolumesFromSnapshotTest-533849331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:30:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-00bd0d4d-5884-471a-96b1-59727dd97861 tempest-CreateVolumesFromSnapshotTest-533849331 None] Flow 'volume_create_manager' (dbc1123f-4aaf-4fb9-a932-bc60b5f418c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:30:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-00bd0d4d-5884-471a-96b1-59727dd97861 tempest-CreateVolumesFromSnapshotTest-533849331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88867d3e-5ec1-471c-9218-b652db4e3b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-00bd0d4d-5884-471a-96b1-59727dd97861 tempest-CreateVolumesFromSnapshotTest-533849331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88867d3e-5ec1-471c-9218-b652db4e3b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:30:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1361074086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=674dca18-012a-454a-a8bd-7fa428f18439,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bb9d5705f694c089b3688415d761410',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:30:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:30:57Z,use_quota=True,user_id='38d88985e1474ff3b123a7ac8ec6d907',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-00bd0d4d-5884-471a-96b1-59727dd97861 tempest-CreateVolumesFromSnapshotTest-533849331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71f5724f-aae5-4de9-a710-f950948c6a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-00bd0d4d-5884-471a-96b1-59727dd97861 tempest-CreateVolumesFromSnapshotTest-533849331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71f5724f-aae5-4de9-a710-f950948c6a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-00bd0d4d-5884-471a-96b1-59727dd97861 tempest-CreateVolumesFromSnapshotTest-533849331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e9d39fa-5591-4351-83fa-6a3aa8f24fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-00bd0d4d-5884-471a-96b1-59727dd97861 tempest-CreateVolumesFromSnapshotTest-533849331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e9d39fa-5591-4351-83fa-6a3aa8f24fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '674dca18-012a-454a-a8bd-7fa428f18439', 'volume_name': 'volume-674dca18-012a-454a-a8bd-7fa428f18439', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-00bd0d4d-5884-471a-96b1-59727dd97861 tempest-CreateVolumesFromSnapshotTest-533849331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1c0268d-19af-48f8-88e6-12cb54a1d659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-00bd0d4d-5884-471a-96b1-59727dd97861 tempest-CreateVolumesFromSnapshotTest-533849331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1c0268d-19af-48f8-88e6-12cb54a1d659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-00bd0d4d-5884-471a-96b1-59727dd97861 tempest-CreateVolumesFromSnapshotTest-533849331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81a09bb3-64ef-4813-acd1-3bbcdb36d1c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:56 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-00bd0d4d-5884-471a-96b1-59727dd97861 tempest-CreateVolumesFromSnapshotTest-533849331 None] Volume 674dca18-012a-454a-a8bd-7fa428f18439: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-674dca18-012a-454a-a8bd-7fa428f18439', 'volume_size': 1} Aug 05 10:30:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-00bd0d4d-5884-471a-96b1-59727dd97861 tempest-CreateVolumesFromSnapshotTest-533849331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:30:56 devstack sudo[105578]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-36adf990-3d0b-4f14-b1f4-ca26647f8d6c tempest-CreateVolumesFromSnapshotTest-533849331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e4ab5105-bf69-4844-8a4a-0547e4d6b22a" returned: 0 in 0.268s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:56 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-36adf990-3d0b-4f14-b1f4-ca26647f8d6c tempest-CreateVolumesFromSnapshotTest-533849331 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:30:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-36adf990-3d0b-4f14-b1f4-ca26647f8d6c tempest-CreateVolumesFromSnapshotTest-533849331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:30:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5be9e8c3-d6bd-41c6-aa98-4614395da9aa tempest-CreateVolumesFromSnapshotTest-533849331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.407s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:30:56 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-5be9e8c3-d6bd-41c6-aa98-4614395da9aa tempest-CreateVolumesFromSnapshotTest-533849331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:30:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-181961974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96193dc0-cd41-45ba-82d6-d5d36c5b0afb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bb9d5705f694c089b3688415d761410',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:30:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:30:56Z,use_quota=True,user_id='38d88985e1474ff3b123a7ac8ec6d907',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:30:56 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-5be9e8c3-d6bd-41c6-aa98-4614395da9aa tempest-CreateVolumesFromSnapshotTest-533849331 None] Creating volume 96193dc0-cd41-45ba-82d6-d5d36c5b0afb {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:30:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5be9e8c3-d6bd-41c6-aa98-4614395da9aa tempest-CreateVolumesFromSnapshotTest-533849331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:30:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5be9e8c3-d6bd-41c6-aa98-4614395da9aa tempest-CreateVolumesFromSnapshotTest-533849331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:30:56 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-5be9e8c3-d6bd-41c6-aa98-4614395da9aa tempest-CreateVolumesFromSnapshotTest-533849331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:30:56 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-5be9e8c3-d6bd-41c6-aa98-4614395da9aa tempest-CreateVolumesFromSnapshotTest-533849331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:30:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5be9e8c3-d6bd-41c6-aa98-4614395da9aa tempest-CreateVolumesFromSnapshotTest-533849331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:30:56 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-5be9e8c3-d6bd-41c6-aa98-4614395da9aa tempest-CreateVolumesFromSnapshotTest-533849331 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:30:56 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-5be9e8c3-d6bd-41c6-aa98-4614395da9aa tempest-CreateVolumesFromSnapshotTest-533849331 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:30:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5be9e8c3-d6bd-41c6-aa98-4614395da9aa tempest-CreateVolumesFromSnapshotTest-533849331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-96193dc0-cd41-45ba-82d6-d5d36c5b0afb 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-36adf990-3d0b-4f14-b1f4-ca26647f8d6c tempest-CreateVolumesFromSnapshotTest-533849331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b85d99ed-1b1a-4092-8a35-48c134db2f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4ab5105-bf69-4844-8a4a-0547e4d6b22a', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:56 devstack sudo[105581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-96193dc0-cd41-45ba-82d6-d5d36c5b0afb 1073741824 Aug 05 10:30:56 devstack sudo[105581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-36adf990-3d0b-4f14-b1f4-ca26647f8d6c tempest-CreateVolumesFromSnapshotTest-533849331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa00c612-4dcb-44f9-999b-724092a373b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:56 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-36adf990-3d0b-4f14-b1f4-ca26647f8d6c tempest-CreateVolumesFromSnapshotTest-533849331 None] Volume volume-e4ab5105-bf69-4844-8a4a-0547e4d6b22a (e4ab5105-bf69-4844-8a4a-0547e4d6b22a): created successfully Aug 05 10:30:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-36adf990-3d0b-4f14-b1f4-ca26647f8d6c tempest-CreateVolumesFromSnapshotTest-533849331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa00c612-4dcb-44f9-999b-724092a373b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:56 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-36adf990-3d0b-4f14-b1f4-ca26647f8d6c tempest-CreateVolumesFromSnapshotTest-533849331 None] Flow 'volume_create_manager' (91999870-614a-47ab-97c4-60948526ec80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:30:56 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-36adf990-3d0b-4f14-b1f4-ca26647f8d6c tempest-CreateVolumesFromSnapshotTest-533849331 None] Created volume successfully. Aug 05 10:30:57 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b2240fb-3f33-44b2-af1c-4b1e9ca88674 tempest-CreateVolumesFromSnapshotTest-533849331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:30:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5b2240fb-3f33-44b2-af1c-4b1e9ca88674 tempest-CreateVolumesFromSnapshotTest-533849331 None] Flow 'volume_create_manager' (6b52e0a9-904b-48cb-b3d8-3d3d3d1cbc12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:30:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5b2240fb-3f33-44b2-af1c-4b1e9ca88674 tempest-CreateVolumesFromSnapshotTest-533849331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e8411d4-1acc-4207-9836-f97225a9ae19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5b2240fb-3f33-44b2-af1c-4b1e9ca88674 tempest-CreateVolumesFromSnapshotTest-533849331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e8411d4-1acc-4207-9836-f97225a9ae19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:30:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1128536801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b471cb6a-b186-4d24-b1bf-8dd141e016d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bb9d5705f694c089b3688415d761410',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:30:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:30:57Z,use_quota=True,user_id='38d88985e1474ff3b123a7ac8ec6d907',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5b2240fb-3f33-44b2-af1c-4b1e9ca88674 tempest-CreateVolumesFromSnapshotTest-533849331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1d23eb4-faac-4c23-90be-b0a5b56a9459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5b2240fb-3f33-44b2-af1c-4b1e9ca88674 tempest-CreateVolumesFromSnapshotTest-533849331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1d23eb4-faac-4c23-90be-b0a5b56a9459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5b2240fb-3f33-44b2-af1c-4b1e9ca88674 tempest-CreateVolumesFromSnapshotTest-533849331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77c96a14-f865-4b5c-9ebc-f76e07ee0fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5b2240fb-3f33-44b2-af1c-4b1e9ca88674 tempest-CreateVolumesFromSnapshotTest-533849331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77c96a14-f865-4b5c-9ebc-f76e07ee0fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b471cb6a-b186-4d24-b1bf-8dd141e016d9', 'volume_name': 'volume-b471cb6a-b186-4d24-b1bf-8dd141e016d9', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5b2240fb-3f33-44b2-af1c-4b1e9ca88674 tempest-CreateVolumesFromSnapshotTest-533849331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (830dea04-3af9-48ab-83d1-558e9ff522a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5b2240fb-3f33-44b2-af1c-4b1e9ca88674 tempest-CreateVolumesFromSnapshotTest-533849331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (830dea04-3af9-48ab-83d1-558e9ff522a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5b2240fb-3f33-44b2-af1c-4b1e9ca88674 tempest-CreateVolumesFromSnapshotTest-533849331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7de4e7a0-18ef-410b-a1da-60bdcc85091e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:57 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-5b2240fb-3f33-44b2-af1c-4b1e9ca88674 tempest-CreateVolumesFromSnapshotTest-533849331 None] Volume b471cb6a-b186-4d24-b1bf-8dd141e016d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b471cb6a-b186-4d24-b1bf-8dd141e016d9', 'volume_size': 1} Aug 05 10:30:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5b2240fb-3f33-44b2-af1c-4b1e9ca88674 tempest-CreateVolumesFromSnapshotTest-533849331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:30:57 devstack sudo[105581]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5be9e8c3-d6bd-41c6-aa98-4614395da9aa tempest-CreateVolumesFromSnapshotTest-533849331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-96193dc0-cd41-45ba-82d6-d5d36c5b0afb 1073741824" returned: 0 in 0.508s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5be9e8c3-d6bd-41c6-aa98-4614395da9aa tempest-CreateVolumesFromSnapshotTest-533849331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-96193dc0-cd41-45ba-82d6-d5d36c5b0afb {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:57 devstack sudo[105586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-96193dc0-cd41-45ba-82d6-d5d36c5b0afb Aug 05 10:30:57 devstack sudo[105586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:57 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-79ad34c3-6b60-4ae4-b7b1-b9c3a528ae22 tempest-CreateVolumesFromSnapshotTest-533849331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:30:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-79ad34c3-6b60-4ae4-b7b1-b9c3a528ae22 tempest-CreateVolumesFromSnapshotTest-533849331 None] Flow 'volume_create_manager' (885101b4-3fc3-451c-9ff3-bc3889098985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:30:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-79ad34c3-6b60-4ae4-b7b1-b9c3a528ae22 tempest-CreateVolumesFromSnapshotTest-533849331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c00135a1-9584-48a9-a68c-67de255bf989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-79ad34c3-6b60-4ae4-b7b1-b9c3a528ae22 tempest-CreateVolumesFromSnapshotTest-533849331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c00135a1-9584-48a9-a68c-67de255bf989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:30:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-814114116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a03aaaff-8571-412f-ac28-77ac707a38c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bb9d5705f694c089b3688415d761410',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:30:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:30:57Z,use_quota=True,user_id='38d88985e1474ff3b123a7ac8ec6d907',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-79ad34c3-6b60-4ae4-b7b1-b9c3a528ae22 tempest-CreateVolumesFromSnapshotTest-533849331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eda54e13-b416-4794-8d35-b502b632f0f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-79ad34c3-6b60-4ae4-b7b1-b9c3a528ae22 tempest-CreateVolumesFromSnapshotTest-533849331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eda54e13-b416-4794-8d35-b502b632f0f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-79ad34c3-6b60-4ae4-b7b1-b9c3a528ae22 tempest-CreateVolumesFromSnapshotTest-533849331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4840e32f-a1a7-4b29-a3fa-c8303e9ac399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-79ad34c3-6b60-4ae4-b7b1-b9c3a528ae22 tempest-CreateVolumesFromSnapshotTest-533849331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4840e32f-a1a7-4b29-a3fa-c8303e9ac399) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a03aaaff-8571-412f-ac28-77ac707a38c8', 'volume_name': 'volume-a03aaaff-8571-412f-ac28-77ac707a38c8', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-79ad34c3-6b60-4ae4-b7b1-b9c3a528ae22 tempest-CreateVolumesFromSnapshotTest-533849331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17765115-32f6-4dca-9508-a32880a9ac76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-79ad34c3-6b60-4ae4-b7b1-b9c3a528ae22 tempest-CreateVolumesFromSnapshotTest-533849331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17765115-32f6-4dca-9508-a32880a9ac76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-79ad34c3-6b60-4ae4-b7b1-b9c3a528ae22 tempest-CreateVolumesFromSnapshotTest-533849331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e51f183-8e9c-4475-aeb4-d17cd0389b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:57 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-79ad34c3-6b60-4ae4-b7b1-b9c3a528ae22 tempest-CreateVolumesFromSnapshotTest-533849331 None] Volume a03aaaff-8571-412f-ac28-77ac707a38c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a03aaaff-8571-412f-ac28-77ac707a38c8', 'volume_size': 1} Aug 05 10:30:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-79ad34c3-6b60-4ae4-b7b1-b9c3a528ae22 tempest-CreateVolumesFromSnapshotTest-533849331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:30:57 devstack sudo[105586]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5be9e8c3-d6bd-41c6-aa98-4614395da9aa tempest-CreateVolumesFromSnapshotTest-533849331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-96193dc0-cd41-45ba-82d6-d5d36c5b0afb" returned: 0 in 0.245s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:57 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-5be9e8c3-d6bd-41c6-aa98-4614395da9aa tempest-CreateVolumesFromSnapshotTest-533849331 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:30:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5be9e8c3-d6bd-41c6-aa98-4614395da9aa tempest-CreateVolumesFromSnapshotTest-533849331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:30:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-00bd0d4d-5884-471a-96b1-59727dd97861 tempest-CreateVolumesFromSnapshotTest-533849331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.842s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:30:57 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-00bd0d4d-5884-471a-96b1-59727dd97861 tempest-CreateVolumesFromSnapshotTest-533849331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:30:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1361074086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=674dca18-012a-454a-a8bd-7fa428f18439,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bb9d5705f694c089b3688415d761410',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:30:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:30:57Z,use_quota=True,user_id='38d88985e1474ff3b123a7ac8ec6d907',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:30:57 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-00bd0d4d-5884-471a-96b1-59727dd97861 tempest-CreateVolumesFromSnapshotTest-533849331 None] Creating volume 674dca18-012a-454a-a8bd-7fa428f18439 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:30:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-00bd0d4d-5884-471a-96b1-59727dd97861 tempest-CreateVolumesFromSnapshotTest-533849331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:30:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-00bd0d4d-5884-471a-96b1-59727dd97861 tempest-CreateVolumesFromSnapshotTest-533849331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:30:57 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-00bd0d4d-5884-471a-96b1-59727dd97861 tempest-CreateVolumesFromSnapshotTest-533849331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:30:57 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-00bd0d4d-5884-471a-96b1-59727dd97861 tempest-CreateVolumesFromSnapshotTest-533849331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:30:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-00bd0d4d-5884-471a-96b1-59727dd97861 tempest-CreateVolumesFromSnapshotTest-533849331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:30:57 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-00bd0d4d-5884-471a-96b1-59727dd97861 tempest-CreateVolumesFromSnapshotTest-533849331 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:30:57 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-00bd0d4d-5884-471a-96b1-59727dd97861 tempest-CreateVolumesFromSnapshotTest-533849331 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:30:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-00bd0d4d-5884-471a-96b1-59727dd97861 tempest-CreateVolumesFromSnapshotTest-533849331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-674dca18-012a-454a-a8bd-7fa428f18439 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:57 devstack sudo[105589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-674dca18-012a-454a-a8bd-7fa428f18439 1073741824 Aug 05 10:30:57 devstack sudo[105589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5be9e8c3-d6bd-41c6-aa98-4614395da9aa tempest-CreateVolumesFromSnapshotTest-533849331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73cb6391-5b04-470f-a21c-08c16993ea03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96193dc0-cd41-45ba-82d6-d5d36c5b0afb', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5be9e8c3-d6bd-41c6-aa98-4614395da9aa tempest-CreateVolumesFromSnapshotTest-533849331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e9f9e9d-b963-4794-a11c-4ee2aef44a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:57 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-5be9e8c3-d6bd-41c6-aa98-4614395da9aa tempest-CreateVolumesFromSnapshotTest-533849331 None] Volume volume-96193dc0-cd41-45ba-82d6-d5d36c5b0afb (96193dc0-cd41-45ba-82d6-d5d36c5b0afb): created successfully Aug 05 10:30:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5be9e8c3-d6bd-41c6-aa98-4614395da9aa tempest-CreateVolumesFromSnapshotTest-533849331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e9f9e9d-b963-4794-a11c-4ee2aef44a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5be9e8c3-d6bd-41c6-aa98-4614395da9aa tempest-CreateVolumesFromSnapshotTest-533849331 None] Flow 'volume_create_manager' (f031c034-f7fd-4948-afe1-809367d85bc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:30:57 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-5be9e8c3-d6bd-41c6-aa98-4614395da9aa tempest-CreateVolumesFromSnapshotTest-533849331 None] Created volume successfully. Aug 05 10:30:57 devstack sudo[105589]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-00bd0d4d-5884-471a-96b1-59727dd97861 tempest-CreateVolumesFromSnapshotTest-533849331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-674dca18-012a-454a-a8bd-7fa428f18439 1073741824" returned: 0 in 0.428s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-00bd0d4d-5884-471a-96b1-59727dd97861 tempest-CreateVolumesFromSnapshotTest-533849331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-674dca18-012a-454a-a8bd-7fa428f18439 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:58 devstack sudo[105594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-674dca18-012a-454a-a8bd-7fa428f18439 Aug 05 10:30:58 devstack sudo[105594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:58 devstack sudo[105594]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-00bd0d4d-5884-471a-96b1-59727dd97861 tempest-CreateVolumesFromSnapshotTest-533849331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-674dca18-012a-454a-a8bd-7fa428f18439" returned: 0 in 0.236s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:58 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-00bd0d4d-5884-471a-96b1-59727dd97861 tempest-CreateVolumesFromSnapshotTest-533849331 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:30:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-00bd0d4d-5884-471a-96b1-59727dd97861 tempest-CreateVolumesFromSnapshotTest-533849331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:30:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5b2240fb-3f33-44b2-af1c-4b1e9ca88674 tempest-CreateVolumesFromSnapshotTest-533849331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.180s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:30:58 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-5b2240fb-3f33-44b2-af1c-4b1e9ca88674 tempest-CreateVolumesFromSnapshotTest-533849331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:30:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1128536801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b471cb6a-b186-4d24-b1bf-8dd141e016d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bb9d5705f694c089b3688415d761410',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:30:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:30:57Z,use_quota=True,user_id='38d88985e1474ff3b123a7ac8ec6d907',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:30:58 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-5b2240fb-3f33-44b2-af1c-4b1e9ca88674 tempest-CreateVolumesFromSnapshotTest-533849331 None] Creating volume b471cb6a-b186-4d24-b1bf-8dd141e016d9 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:30:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5b2240fb-3f33-44b2-af1c-4b1e9ca88674 tempest-CreateVolumesFromSnapshotTest-533849331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:30:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5b2240fb-3f33-44b2-af1c-4b1e9ca88674 tempest-CreateVolumesFromSnapshotTest-533849331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:30:58 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-5b2240fb-3f33-44b2-af1c-4b1e9ca88674 tempest-CreateVolumesFromSnapshotTest-533849331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:30:58 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-5b2240fb-3f33-44b2-af1c-4b1e9ca88674 tempest-CreateVolumesFromSnapshotTest-533849331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:30:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5b2240fb-3f33-44b2-af1c-4b1e9ca88674 tempest-CreateVolumesFromSnapshotTest-533849331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:30:58 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-5b2240fb-3f33-44b2-af1c-4b1e9ca88674 tempest-CreateVolumesFromSnapshotTest-533849331 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:30:58 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-5b2240fb-3f33-44b2-af1c-4b1e9ca88674 tempest-CreateVolumesFromSnapshotTest-533849331 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:30:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5b2240fb-3f33-44b2-af1c-4b1e9ca88674 tempest-CreateVolumesFromSnapshotTest-533849331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-b471cb6a-b186-4d24-b1bf-8dd141e016d9 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:58 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-00bd0d4d-5884-471a-96b1-59727dd97861 tempest-CreateVolumesFromSnapshotTest-533849331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81a09bb3-64ef-4813-acd1-3bbcdb36d1c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-674dca18-012a-454a-a8bd-7fa428f18439', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:58 devstack sudo[105597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-b471cb6a-b186-4d24-b1bf-8dd141e016d9 1073741824 Aug 05 10:30:58 devstack sudo[105597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:58 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-00bd0d4d-5884-471a-96b1-59727dd97861 tempest-CreateVolumesFromSnapshotTest-533849331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ba1228e-fad3-48f2-a7e2-ed88e5aadcf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:58 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-00bd0d4d-5884-471a-96b1-59727dd97861 tempest-CreateVolumesFromSnapshotTest-533849331 None] Volume volume-674dca18-012a-454a-a8bd-7fa428f18439 (674dca18-012a-454a-a8bd-7fa428f18439): created successfully Aug 05 10:30:58 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-00bd0d4d-5884-471a-96b1-59727dd97861 tempest-CreateVolumesFromSnapshotTest-533849331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ba1228e-fad3-48f2-a7e2-ed88e5aadcf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:58 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-00bd0d4d-5884-471a-96b1-59727dd97861 tempest-CreateVolumesFromSnapshotTest-533849331 None] Flow 'volume_create_manager' (dbc1123f-4aaf-4fb9-a932-bc60b5f418c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:30:58 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-00bd0d4d-5884-471a-96b1-59727dd97861 tempest-CreateVolumesFromSnapshotTest-533849331 None] Created volume successfully. Aug 05 10:30:58 devstack sudo[105597]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5b2240fb-3f33-44b2-af1c-4b1e9ca88674 tempest-CreateVolumesFromSnapshotTest-533849331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-b471cb6a-b186-4d24-b1bf-8dd141e016d9 1073741824" returned: 0 in 0.408s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5b2240fb-3f33-44b2-af1c-4b1e9ca88674 tempest-CreateVolumesFromSnapshotTest-533849331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-b471cb6a-b186-4d24-b1bf-8dd141e016d9 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:58 devstack sudo[105602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-b471cb6a-b186-4d24-b1bf-8dd141e016d9 Aug 05 10:30:58 devstack sudo[105602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:58 devstack sudo[105602]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5b2240fb-3f33-44b2-af1c-4b1e9ca88674 tempest-CreateVolumesFromSnapshotTest-533849331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-b471cb6a-b186-4d24-b1bf-8dd141e016d9" returned: 0 in 0.240s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:58 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-5b2240fb-3f33-44b2-af1c-4b1e9ca88674 tempest-CreateVolumesFromSnapshotTest-533849331 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:30:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5b2240fb-3f33-44b2-af1c-4b1e9ca88674 tempest-CreateVolumesFromSnapshotTest-533849331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:30:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-79ad34c3-6b60-4ae4-b7b1-b9c3a528ae22 tempest-CreateVolumesFromSnapshotTest-533849331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.483s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:30:58 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-79ad34c3-6b60-4ae4-b7b1-b9c3a528ae22 tempest-CreateVolumesFromSnapshotTest-533849331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:30:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-814114116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a03aaaff-8571-412f-ac28-77ac707a38c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bb9d5705f694c089b3688415d761410',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:30:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:30:57Z,use_quota=True,user_id='38d88985e1474ff3b123a7ac8ec6d907',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:30:58 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-79ad34c3-6b60-4ae4-b7b1-b9c3a528ae22 tempest-CreateVolumesFromSnapshotTest-533849331 None] Creating volume a03aaaff-8571-412f-ac28-77ac707a38c8 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:30:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-79ad34c3-6b60-4ae4-b7b1-b9c3a528ae22 tempest-CreateVolumesFromSnapshotTest-533849331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:30:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-79ad34c3-6b60-4ae4-b7b1-b9c3a528ae22 tempest-CreateVolumesFromSnapshotTest-533849331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:30:58 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-79ad34c3-6b60-4ae4-b7b1-b9c3a528ae22 tempest-CreateVolumesFromSnapshotTest-533849331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:30:58 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-79ad34c3-6b60-4ae4-b7b1-b9c3a528ae22 tempest-CreateVolumesFromSnapshotTest-533849331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:30:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-79ad34c3-6b60-4ae4-b7b1-b9c3a528ae22 tempest-CreateVolumesFromSnapshotTest-533849331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:30:58 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-79ad34c3-6b60-4ae4-b7b1-b9c3a528ae22 tempest-CreateVolumesFromSnapshotTest-533849331 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:30:58 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-79ad34c3-6b60-4ae4-b7b1-b9c3a528ae22 tempest-CreateVolumesFromSnapshotTest-533849331 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:30:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-79ad34c3-6b60-4ae4-b7b1-b9c3a528ae22 tempest-CreateVolumesFromSnapshotTest-533849331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a03aaaff-8571-412f-ac28-77ac707a38c8 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:58 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5b2240fb-3f33-44b2-af1c-4b1e9ca88674 tempest-CreateVolumesFromSnapshotTest-533849331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7de4e7a0-18ef-410b-a1da-60bdcc85091e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b471cb6a-b186-4d24-b1bf-8dd141e016d9', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:58 devstack sudo[105605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a03aaaff-8571-412f-ac28-77ac707a38c8 1073741824 Aug 05 10:30:58 devstack sudo[105605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:58 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5b2240fb-3f33-44b2-af1c-4b1e9ca88674 tempest-CreateVolumesFromSnapshotTest-533849331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (474615b7-5eb1-46a3-bdd9-256871e94f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:59 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-5b2240fb-3f33-44b2-af1c-4b1e9ca88674 tempest-CreateVolumesFromSnapshotTest-533849331 None] Volume volume-b471cb6a-b186-4d24-b1bf-8dd141e016d9 (b471cb6a-b186-4d24-b1bf-8dd141e016d9): created successfully Aug 05 10:30:59 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5b2240fb-3f33-44b2-af1c-4b1e9ca88674 tempest-CreateVolumesFromSnapshotTest-533849331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (474615b7-5eb1-46a3-bdd9-256871e94f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:59 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5b2240fb-3f33-44b2-af1c-4b1e9ca88674 tempest-CreateVolumesFromSnapshotTest-533849331 None] Flow 'volume_create_manager' (6b52e0a9-904b-48cb-b3d8-3d3d3d1cbc12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:30:59 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-5b2240fb-3f33-44b2-af1c-4b1e9ca88674 tempest-CreateVolumesFromSnapshotTest-533849331 None] Created volume successfully. Aug 05 10:30:59 devstack sudo[105605]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-79ad34c3-6b60-4ae4-b7b1-b9c3a528ae22 tempest-CreateVolumesFromSnapshotTest-533849331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a03aaaff-8571-412f-ac28-77ac707a38c8 1073741824" returned: 0 in 0.402s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-79ad34c3-6b60-4ae4-b7b1-b9c3a528ae22 tempest-CreateVolumesFromSnapshotTest-533849331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a03aaaff-8571-412f-ac28-77ac707a38c8 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:59 devstack sudo[105610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a03aaaff-8571-412f-ac28-77ac707a38c8 Aug 05 10:30:59 devstack sudo[105610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:59 devstack sudo[105610]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-79ad34c3-6b60-4ae4-b7b1-b9c3a528ae22 tempest-CreateVolumesFromSnapshotTest-533849331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a03aaaff-8571-412f-ac28-77ac707a38c8" returned: 0 in 0.250s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:59 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-79ad34c3-6b60-4ae4-b7b1-b9c3a528ae22 tempest-CreateVolumesFromSnapshotTest-533849331 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:30:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-79ad34c3-6b60-4ae4-b7b1-b9c3a528ae22 tempest-CreateVolumesFromSnapshotTest-533849331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:30:59 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-79ad34c3-6b60-4ae4-b7b1-b9c3a528ae22 tempest-CreateVolumesFromSnapshotTest-533849331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e51f183-8e9c-4475-aeb4-d17cd0389b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a03aaaff-8571-412f-ac28-77ac707a38c8', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:59 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-79ad34c3-6b60-4ae4-b7b1-b9c3a528ae22 tempest-CreateVolumesFromSnapshotTest-533849331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f7fbd18-5866-4698-aeaf-f2cf1a8d32eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:59 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-79ad34c3-6b60-4ae4-b7b1-b9c3a528ae22 tempest-CreateVolumesFromSnapshotTest-533849331 None] Volume volume-a03aaaff-8571-412f-ac28-77ac707a38c8 (a03aaaff-8571-412f-ac28-77ac707a38c8): created successfully Aug 05 10:30:59 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-79ad34c3-6b60-4ae4-b7b1-b9c3a528ae22 tempest-CreateVolumesFromSnapshotTest-533849331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f7fbd18-5866-4698-aeaf-f2cf1a8d32eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:59 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-79ad34c3-6b60-4ae4-b7b1-b9c3a528ae22 tempest-CreateVolumesFromSnapshotTest-533849331 None] Flow 'volume_create_manager' (885101b4-3fc3-451c-9ff3-bc3889098985) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:30:59 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-79ad34c3-6b60-4ae4-b7b1-b9c3a528ae22 tempest-CreateVolumesFromSnapshotTest-533849331 None] Created volume successfully. Aug 05 10:31:00 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-1dbfce9b-a959-45db-99b3-ee1ceec2a14f tempest-CreateVolumesFromSnapshotTest-533849331 None] Acquiring lock "cinder-a03aaaff-8571-412f-ac28-77ac707a38c8-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:31:00 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-1dbfce9b-a959-45db-99b3-ee1ceec2a14f tempest-CreateVolumesFromSnapshotTest-533849331 None] Lock "cinder-a03aaaff-8571-412f-ac28-77ac707a38c8-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:31:00 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-1dbfce9b-a959-45db-99b3-ee1ceec2a14f tempest-CreateVolumesFromSnapshotTest-533849331 None] Acquiring lock "cinder-quobyte-a03aaaff-8571-412f-ac28-77ac707a38c8" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:31:00 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-1dbfce9b-a959-45db-99b3-ee1ceec2a14f tempest-CreateVolumesFromSnapshotTest-533849331 None] Lock "cinder-quobyte-a03aaaff-8571-412f-ac28-77ac707a38c8" acquired by "delete_volume" :: waited 0.013s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:31:00 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[2482155c-3856-4856-ac9a-a219ae3195ed]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:31:00 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1dbfce9b-a959-45db-99b3-ee1ceec2a14f tempest-CreateVolumesFromSnapshotTest-533849331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a03aaaff-8571-412f-ac28-77ac707a38c8 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:00 devstack sudo[105649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a03aaaff-8571-412f-ac28-77ac707a38c8 Aug 05 10:31:00 devstack sudo[105649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:01 devstack sudo[105649]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:01 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1dbfce9b-a959-45db-99b3-ee1ceec2a14f tempest-CreateVolumesFromSnapshotTest-533849331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a03aaaff-8571-412f-ac28-77ac707a38c8" returned: 0 in 0.349s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:01 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1dbfce9b-a959-45db-99b3-ee1ceec2a14f tempest-CreateVolumesFromSnapshotTest-533849331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a03aaaff-8571-412f-ac28-77ac707a38c8 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:01 devstack sudo[105654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a03aaaff-8571-412f-ac28-77ac707a38c8 Aug 05 10:31:01 devstack sudo[105654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:01 devstack sudo[105654]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:01 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1dbfce9b-a959-45db-99b3-ee1ceec2a14f tempest-CreateVolumesFromSnapshotTest-533849331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a03aaaff-8571-412f-ac28-77ac707a38c8" returned: 0 in 0.237s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:01 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-1dbfce9b-a959-45db-99b3-ee1ceec2a14f tempest-CreateVolumesFromSnapshotTest-533849331 None] Lock "cinder-quobyte-a03aaaff-8571-412f-ac28-77ac707a38c8" released by "delete_volume" :: held 0.623s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:31:01 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-1dbfce9b-a959-45db-99b3-ee1ceec2a14f tempest-CreateVolumesFromSnapshotTest-533849331 None] Created reservations ['233ad5ec-67a4-4891-be42-dc3947447a9e', '57b3272f-bd30-4e04-9340-89745d027803', 'c804b320-3cb3-4257-9948-44a53ffc65c1', '6c3c54da-7eaa-4222-a8a8-24b54a3d14c0'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:31:01 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-1dbfce9b-a959-45db-99b3-ee1ceec2a14f tempest-CreateVolumesFromSnapshotTest-533849331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:31:01 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-1dbfce9b-a959-45db-99b3-ee1ceec2a14f tempest-CreateVolumesFromSnapshotTest-533849331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:31:01 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-1dbfce9b-a959-45db-99b3-ee1ceec2a14f tempest-CreateVolumesFromSnapshotTest-533849331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:31:01 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-1dbfce9b-a959-45db-99b3-ee1ceec2a14f tempest-CreateVolumesFromSnapshotTest-533849331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:31:01 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-1dbfce9b-a959-45db-99b3-ee1ceec2a14f tempest-CreateVolumesFromSnapshotTest-533849331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:31:01 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1dbfce9b-a959-45db-99b3-ee1ceec2a14f tempest-CreateVolumesFromSnapshotTest-533849331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:01 devstack sudo[105657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:31:01 devstack sudo[105657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:01 devstack sudo[105657]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:01 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1dbfce9b-a959-45db-99b3-ee1ceec2a14f tempest-CreateVolumesFromSnapshotTest-533849331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.236s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:01 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-1dbfce9b-a959-45db-99b3-ee1ceec2a14f tempest-CreateVolumesFromSnapshotTest-533849331 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:31:01 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-1dbfce9b-a959-45db-99b3-ee1ceec2a14f tempest-CreateVolumesFromSnapshotTest-533849331 None] Deleted volume successfully. Aug 05 10:31:01 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-1dbfce9b-a959-45db-99b3-ee1ceec2a14f tempest-CreateVolumesFromSnapshotTest-533849331 None] Lock "cinder-a03aaaff-8571-412f-ac28-77ac707a38c8-delete_volume" released by "delete_volume" :: held 1.048s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:31:01 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-18e2a1d2-4057-48a9-8c2b-6d8dedb21ac1 tempest-CreateVolumesFromSnapshotTest-533849331 None] Acquiring lock "cinder-b471cb6a-b186-4d24-b1bf-8dd141e016d9-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:31:01 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-18e2a1d2-4057-48a9-8c2b-6d8dedb21ac1 tempest-CreateVolumesFromSnapshotTest-533849331 None] Lock "cinder-b471cb6a-b186-4d24-b1bf-8dd141e016d9-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:31:01 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-18e2a1d2-4057-48a9-8c2b-6d8dedb21ac1 tempest-CreateVolumesFromSnapshotTest-533849331 None] Acquiring lock "cinder-quobyte-b471cb6a-b186-4d24-b1bf-8dd141e016d9" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:31:01 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-18e2a1d2-4057-48a9-8c2b-6d8dedb21ac1 tempest-CreateVolumesFromSnapshotTest-533849331 None] Lock "cinder-quobyte-b471cb6a-b186-4d24-b1bf-8dd141e016d9" acquired by "delete_volume" :: waited 0.014s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:31:01 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[b825f848-c9b1-4c07-ab16-5920b9653c57]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:31:01 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-18e2a1d2-4057-48a9-8c2b-6d8dedb21ac1 tempest-CreateVolumesFromSnapshotTest-533849331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-b471cb6a-b186-4d24-b1bf-8dd141e016d9 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:02 devstack sudo[105660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-b471cb6a-b186-4d24-b1bf-8dd141e016d9 Aug 05 10:31:02 devstack sudo[105660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:02 devstack sudo[105660]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:02 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-18e2a1d2-4057-48a9-8c2b-6d8dedb21ac1 tempest-CreateVolumesFromSnapshotTest-533849331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-b471cb6a-b186-4d24-b1bf-8dd141e016d9" returned: 0 in 0.342s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:02 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-18e2a1d2-4057-48a9-8c2b-6d8dedb21ac1 tempest-CreateVolumesFromSnapshotTest-533849331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-b471cb6a-b186-4d24-b1bf-8dd141e016d9 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:02 devstack sudo[105665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-b471cb6a-b186-4d24-b1bf-8dd141e016d9 Aug 05 10:31:02 devstack sudo[105665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:02 devstack sudo[105665]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:02 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-18e2a1d2-4057-48a9-8c2b-6d8dedb21ac1 tempest-CreateVolumesFromSnapshotTest-533849331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-b471cb6a-b186-4d24-b1bf-8dd141e016d9" returned: 0 in 0.230s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:02 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-18e2a1d2-4057-48a9-8c2b-6d8dedb21ac1 tempest-CreateVolumesFromSnapshotTest-533849331 None] Lock "cinder-quobyte-b471cb6a-b186-4d24-b1bf-8dd141e016d9" released by "delete_volume" :: held 0.607s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:31:02 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-18e2a1d2-4057-48a9-8c2b-6d8dedb21ac1 tempest-CreateVolumesFromSnapshotTest-533849331 None] Created reservations ['3edca18e-b3b8-4c95-9c65-b5fc7a5e6d80', '9aa7b2e5-0c16-46c6-ba21-1ef738c7e941', '7f233e34-3536-4251-a8c4-88382e6efca0', 'd044ef37-9dab-4df3-8abb-977ef4a9f97c'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:31:02 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-18e2a1d2-4057-48a9-8c2b-6d8dedb21ac1 tempest-CreateVolumesFromSnapshotTest-533849331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:31:02 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-18e2a1d2-4057-48a9-8c2b-6d8dedb21ac1 tempest-CreateVolumesFromSnapshotTest-533849331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:31:02 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-18e2a1d2-4057-48a9-8c2b-6d8dedb21ac1 tempest-CreateVolumesFromSnapshotTest-533849331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:31:02 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-18e2a1d2-4057-48a9-8c2b-6d8dedb21ac1 tempest-CreateVolumesFromSnapshotTest-533849331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:31:02 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-18e2a1d2-4057-48a9-8c2b-6d8dedb21ac1 tempest-CreateVolumesFromSnapshotTest-533849331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:31:02 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-18e2a1d2-4057-48a9-8c2b-6d8dedb21ac1 tempest-CreateVolumesFromSnapshotTest-533849331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:02 devstack sudo[105668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:31:02 devstack sudo[105668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:02 devstack sudo[105668]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:02 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-18e2a1d2-4057-48a9-8c2b-6d8dedb21ac1 tempest-CreateVolumesFromSnapshotTest-533849331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.232s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:02 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-18e2a1d2-4057-48a9-8c2b-6d8dedb21ac1 tempest-CreateVolumesFromSnapshotTest-533849331 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:31:02 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-18e2a1d2-4057-48a9-8c2b-6d8dedb21ac1 tempest-CreateVolumesFromSnapshotTest-533849331 None] Deleted volume successfully. Aug 05 10:31:02 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-18e2a1d2-4057-48a9-8c2b-6d8dedb21ac1 tempest-CreateVolumesFromSnapshotTest-533849331 None] Lock "cinder-b471cb6a-b186-4d24-b1bf-8dd141e016d9-delete_volume" released by "delete_volume" :: held 1.017s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:31:03 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-642db11e-8474-4c0b-97ca-b7e7373f240c tempest-CreateVolumesFromSnapshotTest-533849331 None] Acquiring lock "cinder-674dca18-012a-454a-a8bd-7fa428f18439-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:31:03 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-642db11e-8474-4c0b-97ca-b7e7373f240c tempest-CreateVolumesFromSnapshotTest-533849331 None] Lock "cinder-674dca18-012a-454a-a8bd-7fa428f18439-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:31:03 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-642db11e-8474-4c0b-97ca-b7e7373f240c tempest-CreateVolumesFromSnapshotTest-533849331 None] Acquiring lock "cinder-quobyte-674dca18-012a-454a-a8bd-7fa428f18439" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:31:03 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-642db11e-8474-4c0b-97ca-b7e7373f240c tempest-CreateVolumesFromSnapshotTest-533849331 None] Lock "cinder-quobyte-674dca18-012a-454a-a8bd-7fa428f18439" acquired by "delete_volume" :: waited 0.014s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:31:03 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b496a0-c115-4fb6-8b04-b15b617791ad]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:31:03 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-642db11e-8474-4c0b-97ca-b7e7373f240c tempest-CreateVolumesFromSnapshotTest-533849331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-674dca18-012a-454a-a8bd-7fa428f18439 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:03 devstack sudo[105671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-674dca18-012a-454a-a8bd-7fa428f18439 Aug 05 10:31:03 devstack sudo[105671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:03 devstack sudo[105671]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:03 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-642db11e-8474-4c0b-97ca-b7e7373f240c tempest-CreateVolumesFromSnapshotTest-533849331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-674dca18-012a-454a-a8bd-7fa428f18439" returned: 0 in 0.342s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:03 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-642db11e-8474-4c0b-97ca-b7e7373f240c tempest-CreateVolumesFromSnapshotTest-533849331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-674dca18-012a-454a-a8bd-7fa428f18439 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:03 devstack sudo[105676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-674dca18-012a-454a-a8bd-7fa428f18439 Aug 05 10:31:03 devstack sudo[105676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:03 devstack sudo[105676]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:03 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-642db11e-8474-4c0b-97ca-b7e7373f240c tempest-CreateVolumesFromSnapshotTest-533849331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-674dca18-012a-454a-a8bd-7fa428f18439" returned: 0 in 0.237s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:03 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-642db11e-8474-4c0b-97ca-b7e7373f240c tempest-CreateVolumesFromSnapshotTest-533849331 None] Lock "cinder-quobyte-674dca18-012a-454a-a8bd-7fa428f18439" released by "delete_volume" :: held 0.618s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:31:03 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-642db11e-8474-4c0b-97ca-b7e7373f240c tempest-CreateVolumesFromSnapshotTest-533849331 None] Created reservations ['386d4476-8a39-4544-b090-3326940345ee', '43cea94b-3483-44cd-8082-b504da00b6b1', '8f33ad65-e57a-4235-8aea-0cd75bfb754b', 'f52d1162-7262-4630-ad44-51a800f9d865'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:31:03 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-642db11e-8474-4c0b-97ca-b7e7373f240c tempest-CreateVolumesFromSnapshotTest-533849331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:31:03 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-642db11e-8474-4c0b-97ca-b7e7373f240c tempest-CreateVolumesFromSnapshotTest-533849331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:31:03 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-642db11e-8474-4c0b-97ca-b7e7373f240c tempest-CreateVolumesFromSnapshotTest-533849331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:31:03 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-642db11e-8474-4c0b-97ca-b7e7373f240c tempest-CreateVolumesFromSnapshotTest-533849331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:31:03 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-642db11e-8474-4c0b-97ca-b7e7373f240c tempest-CreateVolumesFromSnapshotTest-533849331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:31:03 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-642db11e-8474-4c0b-97ca-b7e7373f240c tempest-CreateVolumesFromSnapshotTest-533849331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:03 devstack sudo[105679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:31:03 devstack sudo[105679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:04 devstack sudo[105679]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-642db11e-8474-4c0b-97ca-b7e7373f240c tempest-CreateVolumesFromSnapshotTest-533849331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.247s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:04 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-642db11e-8474-4c0b-97ca-b7e7373f240c tempest-CreateVolumesFromSnapshotTest-533849331 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:31:04 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-642db11e-8474-4c0b-97ca-b7e7373f240c tempest-CreateVolumesFromSnapshotTest-533849331 None] Deleted volume successfully. Aug 05 10:31:04 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-642db11e-8474-4c0b-97ca-b7e7373f240c tempest-CreateVolumesFromSnapshotTest-533849331 None] Lock "cinder-674dca18-012a-454a-a8bd-7fa428f18439-delete_volume" released by "delete_volume" :: held 1.061s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:31:04 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d9384698-8ec2-4b59-b630-56d972a304a3 tempest-CreateVolumesFromSnapshotTest-533849331 None] Acquiring lock "cinder-96193dc0-cd41-45ba-82d6-d5d36c5b0afb-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:31:04 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d9384698-8ec2-4b59-b630-56d972a304a3 tempest-CreateVolumesFromSnapshotTest-533849331 None] Lock "cinder-96193dc0-cd41-45ba-82d6-d5d36c5b0afb-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:31:04 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d9384698-8ec2-4b59-b630-56d972a304a3 tempest-CreateVolumesFromSnapshotTest-533849331 None] Acquiring lock "cinder-quobyte-96193dc0-cd41-45ba-82d6-d5d36c5b0afb" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:31:04 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d9384698-8ec2-4b59-b630-56d972a304a3 tempest-CreateVolumesFromSnapshotTest-533849331 None] Lock "cinder-quobyte-96193dc0-cd41-45ba-82d6-d5d36c5b0afb" acquired by "delete_volume" :: waited 0.014s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:31:04 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0762834-c3b0-4ae1-b8c6-0c5c9069b992]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:31:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d9384698-8ec2-4b59-b630-56d972a304a3 tempest-CreateVolumesFromSnapshotTest-533849331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-96193dc0-cd41-45ba-82d6-d5d36c5b0afb {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:04 devstack sudo[105682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-96193dc0-cd41-45ba-82d6-d5d36c5b0afb Aug 05 10:31:04 devstack sudo[105682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:04 devstack sudo[105682]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d9384698-8ec2-4b59-b630-56d972a304a3 tempest-CreateVolumesFromSnapshotTest-533849331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-96193dc0-cd41-45ba-82d6-d5d36c5b0afb" returned: 0 in 0.338s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d9384698-8ec2-4b59-b630-56d972a304a3 tempest-CreateVolumesFromSnapshotTest-533849331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-96193dc0-cd41-45ba-82d6-d5d36c5b0afb {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:04 devstack sudo[105687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-96193dc0-cd41-45ba-82d6-d5d36c5b0afb Aug 05 10:31:04 devstack sudo[105687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:04 devstack sudo[105687]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d9384698-8ec2-4b59-b630-56d972a304a3 tempest-CreateVolumesFromSnapshotTest-533849331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-96193dc0-cd41-45ba-82d6-d5d36c5b0afb" returned: 0 in 0.255s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:04 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d9384698-8ec2-4b59-b630-56d972a304a3 tempest-CreateVolumesFromSnapshotTest-533849331 None] Lock "cinder-quobyte-96193dc0-cd41-45ba-82d6-d5d36c5b0afb" released by "delete_volume" :: held 0.632s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:31:04 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-d9384698-8ec2-4b59-b630-56d972a304a3 tempest-CreateVolumesFromSnapshotTest-533849331 None] Created reservations ['eb593547-4122-450f-9c97-b0553ebd9a99', '229db9c5-01eb-45f4-a5ed-5dd3e5f355c6', '44f59ea8-7937-46a7-a5ff-caaf935bd5d9', '078130dd-ee35-45ad-a6e1-4fc84f8802f7'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:31:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-d9384698-8ec2-4b59-b630-56d972a304a3 tempest-CreateVolumesFromSnapshotTest-533849331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:31:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-d9384698-8ec2-4b59-b630-56d972a304a3 tempest-CreateVolumesFromSnapshotTest-533849331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:31:04 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-d9384698-8ec2-4b59-b630-56d972a304a3 tempest-CreateVolumesFromSnapshotTest-533849331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:31:05 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-d9384698-8ec2-4b59-b630-56d972a304a3 tempest-CreateVolumesFromSnapshotTest-533849331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:31:05 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-d9384698-8ec2-4b59-b630-56d972a304a3 tempest-CreateVolumesFromSnapshotTest-533849331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:31:05 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d9384698-8ec2-4b59-b630-56d972a304a3 tempest-CreateVolumesFromSnapshotTest-533849331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:05 devstack sudo[105691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:31:05 devstack sudo[105691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:05 devstack sudo[105691]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:05 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d9384698-8ec2-4b59-b630-56d972a304a3 tempest-CreateVolumesFromSnapshotTest-533849331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.233s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:05 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-d9384698-8ec2-4b59-b630-56d972a304a3 tempest-CreateVolumesFromSnapshotTest-533849331 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:31:05 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-d9384698-8ec2-4b59-b630-56d972a304a3 tempest-CreateVolumesFromSnapshotTest-533849331 None] Deleted volume successfully. Aug 05 10:31:05 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d9384698-8ec2-4b59-b630-56d972a304a3 tempest-CreateVolumesFromSnapshotTest-533849331 None] Lock "cinder-96193dc0-cd41-45ba-82d6-d5d36c5b0afb-delete_volume" released by "delete_volume" :: held 1.057s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:31:05 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-cf2cca63-9e73-4494-8261-110717550677 tempest-CreateVolumesFromSnapshotTest-533849331 None] Acquiring lock "cinder-e4ab5105-bf69-4844-8a4a-0547e4d6b22a-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:31:05 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-cf2cca63-9e73-4494-8261-110717550677 tempest-CreateVolumesFromSnapshotTest-533849331 None] Lock "cinder-e4ab5105-bf69-4844-8a4a-0547e4d6b22a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:31:05 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-cf2cca63-9e73-4494-8261-110717550677 tempest-CreateVolumesFromSnapshotTest-533849331 None] Acquiring lock "cinder-quobyte-e4ab5105-bf69-4844-8a4a-0547e4d6b22a" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:31:05 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-cf2cca63-9e73-4494-8261-110717550677 tempest-CreateVolumesFromSnapshotTest-533849331 None] Lock "cinder-quobyte-e4ab5105-bf69-4844-8a4a-0547e4d6b22a" acquired by "delete_volume" :: waited 0.014s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:31:05 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[826625c7-c84f-4e7e-98dc-0ee48f02dd63]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:31:05 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-cf2cca63-9e73-4494-8261-110717550677 tempest-CreateVolumesFromSnapshotTest-533849331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e4ab5105-bf69-4844-8a4a-0547e4d6b22a {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:05 devstack sudo[105694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e4ab5105-bf69-4844-8a4a-0547e4d6b22a Aug 05 10:31:05 devstack sudo[105694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:05 devstack sudo[105694]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:05 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-cf2cca63-9e73-4494-8261-110717550677 tempest-CreateVolumesFromSnapshotTest-533849331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e4ab5105-bf69-4844-8a4a-0547e4d6b22a" returned: 0 in 0.346s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:05 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-cf2cca63-9e73-4494-8261-110717550677 tempest-CreateVolumesFromSnapshotTest-533849331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e4ab5105-bf69-4844-8a4a-0547e4d6b22a {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:05 devstack sudo[105699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e4ab5105-bf69-4844-8a4a-0547e4d6b22a Aug 05 10:31:05 devstack sudo[105699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:06 devstack sudo[105699]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-cf2cca63-9e73-4494-8261-110717550677 tempest-CreateVolumesFromSnapshotTest-533849331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e4ab5105-bf69-4844-8a4a-0547e4d6b22a" returned: 0 in 0.236s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:06 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-cf2cca63-9e73-4494-8261-110717550677 tempest-CreateVolumesFromSnapshotTest-533849331 None] Lock "cinder-quobyte-e4ab5105-bf69-4844-8a4a-0547e4d6b22a" released by "delete_volume" :: held 0.620s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:31:06 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-cf2cca63-9e73-4494-8261-110717550677 tempest-CreateVolumesFromSnapshotTest-533849331 None] Created reservations ['9736b3c8-0fff-476f-a696-c173e3f52dce', 'b8bcea3f-53c1-4c55-9078-11c5054e5bc1', '80b80236-9d9c-4a9a-bab6-5bb458f8c6b2', 'f1798d6c-f500-4a05-8464-1c1396165c7a'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:31:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-cf2cca63-9e73-4494-8261-110717550677 tempest-CreateVolumesFromSnapshotTest-533849331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:31:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-cf2cca63-9e73-4494-8261-110717550677 tempest-CreateVolumesFromSnapshotTest-533849331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:31:06 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-cf2cca63-9e73-4494-8261-110717550677 tempest-CreateVolumesFromSnapshotTest-533849331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:31:06 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-cf2cca63-9e73-4494-8261-110717550677 tempest-CreateVolumesFromSnapshotTest-533849331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:31:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-cf2cca63-9e73-4494-8261-110717550677 tempest-CreateVolumesFromSnapshotTest-533849331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:31:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-cf2cca63-9e73-4494-8261-110717550677 tempest-CreateVolumesFromSnapshotTest-533849331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:06 devstack sudo[105702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:31:06 devstack sudo[105702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:06 devstack sudo[105702]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-cf2cca63-9e73-4494-8261-110717550677 tempest-CreateVolumesFromSnapshotTest-533849331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.235s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:06 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-cf2cca63-9e73-4494-8261-110717550677 tempest-CreateVolumesFromSnapshotTest-533849331 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:31:06 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-cf2cca63-9e73-4494-8261-110717550677 tempest-CreateVolumesFromSnapshotTest-533849331 None] Deleted volume successfully. Aug 05 10:31:06 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-cf2cca63-9e73-4494-8261-110717550677 tempest-CreateVolumesFromSnapshotTest-533849331 None] Lock "cinder-e4ab5105-bf69-4844-8a4a-0547e4d6b22a-delete_volume" released by "delete_volume" :: held 1.031s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:31:06 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-61f64157-7a49-4690-9571-0be09fb29727 tempest-CreateVolumesFromSnapshotTest-533849331 None] Acquiring lock "cinder-c57706b2-912a-4142-8819-0e339f6bd5d7-delete_snapshot" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:31:06 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-61f64157-7a49-4690-9571-0be09fb29727 tempest-CreateVolumesFromSnapshotTest-533849331 None] Lock "cinder-c57706b2-912a-4142-8819-0e339f6bd5d7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:31:06 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-61f64157-7a49-4690-9571-0be09fb29727 tempest-CreateVolumesFromSnapshotTest-533849331 None] Acquiring lock "cinder-quobyte-f0b721ae-7a66-4121-80e1-f31bfa8d0bd9" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:31:06 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-61f64157-7a49-4690-9571-0be09fb29727 tempest-CreateVolumesFromSnapshotTest-533849331 None] Lock "cinder-quobyte-f0b721ae-7a66-4121-80e1-f31bfa8d0bd9" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:31:06 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-61f64157-7a49-4690-9571-0be09fb29727 tempest-CreateVolumesFromSnapshotTest-533849331 None] Acquiring lock "cinder-quobyte-c57706b2-912a-4142-8819-0e339f6bd5d7" by "_delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:31:06 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-61f64157-7a49-4690-9571-0be09fb29727 tempest-CreateVolumesFromSnapshotTest-533849331 None] Lock "cinder-quobyte-c57706b2-912a-4142-8819-0e339f6bd5d7" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:31:06 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-61f64157-7a49-4690-9571-0be09fb29727 tempest-CreateVolumesFromSnapshotTest-533849331 None] Deleting offline snapshot c57706b2-912a-4142-8819-0e339f6bd5d7 of volume f0b721ae-7a66-4121-80e1-f31bfa8d0bd9 {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:31:06 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-61f64157-7a49-4690-9571-0be09fb29727 tempest-CreateVolumesFromSnapshotTest-533849331 None] snapshot_file for this snap is: volume-f0b721ae-7a66-4121-80e1-f31bfa8d0bd9.c57706b2-912a-4142-8819-0e339f6bd5d7 {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:31:06 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b9ad3b-4679-43f7-9962-369f15450e31]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:31:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-61f64157-7a49-4690-9571-0be09fb29727 tempest-CreateVolumesFromSnapshotTest-533849331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f0b721ae-7a66-4121-80e1-f31bfa8d0bd9.c57706b2-912a-4142-8819-0e339f6bd5d7 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:06 devstack sudo[105705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f0b721ae-7a66-4121-80e1-f31bfa8d0bd9.c57706b2-912a-4142-8819-0e339f6bd5d7 Aug 05 10:31:06 devstack sudo[105705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:06 devstack sudo[105705]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-61f64157-7a49-4690-9571-0be09fb29727 tempest-CreateVolumesFromSnapshotTest-533849331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f0b721ae-7a66-4121-80e1-f31bfa8d0bd9.c57706b2-912a-4142-8819-0e339f6bd5d7" returned: 0 in 0.342s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:06 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-61f64157-7a49-4690-9571-0be09fb29727 tempest-CreateVolumesFromSnapshotTest-533849331 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0b721ae-7a66-4121-80e1-f31bfa8d0bd9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88613) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:31:06 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c02b586-6fa0-4e94-9944-bd687081b42c]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:31:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-61f64157-7a49-4690-9571-0be09fb29727 tempest-CreateVolumesFromSnapshotTest-533849331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f0b721ae-7a66-4121-80e1-f31bfa8d0bd9 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:07 devstack sudo[105710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f0b721ae-7a66-4121-80e1-f31bfa8d0bd9 Aug 05 10:31:07 devstack sudo[105710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:07 devstack sudo[105710]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-61f64157-7a49-4690-9571-0be09fb29727 tempest-CreateVolumesFromSnapshotTest-533849331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f0b721ae-7a66-4121-80e1-f31bfa8d0bd9" returned: 0 in 0.340s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-61f64157-7a49-4690-9571-0be09fb29727 tempest-CreateVolumesFromSnapshotTest-533849331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f0b721ae-7a66-4121-80e1-f31bfa8d0bd9.c57706b2-912a-4142-8819-0e339f6bd5d7 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:07 devstack sudo[105715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f0b721ae-7a66-4121-80e1-f31bfa8d0bd9.c57706b2-912a-4142-8819-0e339f6bd5d7 Aug 05 10:31:07 devstack sudo[105715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:07 devstack sudo[105715]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-61f64157-7a49-4690-9571-0be09fb29727 tempest-CreateVolumesFromSnapshotTest-533849331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f0b721ae-7a66-4121-80e1-f31bfa8d0bd9.c57706b2-912a-4142-8819-0e339f6bd5d7" returned: 0 in 0.331s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-61f64157-7a49-4690-9571-0be09fb29727 tempest-CreateVolumesFromSnapshotTest-533849331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f0b721ae-7a66-4121-80e1-f31bfa8d0bd9.c57706b2-912a-4142-8819-0e339f6bd5d7 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:07 devstack sudo[105720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f0b721ae-7a66-4121-80e1-f31bfa8d0bd9.c57706b2-912a-4142-8819-0e339f6bd5d7 Aug 05 10:31:07 devstack sudo[105720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:07 devstack sudo[105720]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-61f64157-7a49-4690-9571-0be09fb29727 tempest-CreateVolumesFromSnapshotTest-533849331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f0b721ae-7a66-4121-80e1-f31bfa8d0bd9.c57706b2-912a-4142-8819-0e339f6bd5d7" returned: 0 in 0.233s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:07 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-61f64157-7a49-4690-9571-0be09fb29727 tempest-CreateVolumesFromSnapshotTest-533849331 None] Lock "cinder-quobyte-c57706b2-912a-4142-8819-0e339f6bd5d7" released by "_delete_snapshot" :: held 1.342s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:31:07 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-61f64157-7a49-4690-9571-0be09fb29727 tempest-CreateVolumesFromSnapshotTest-533849331 None] Lock "cinder-quobyte-f0b721ae-7a66-4121-80e1-f31bfa8d0bd9" released by "delete_snapshot" :: held 1.364s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:31:07 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-61f64157-7a49-4690-9571-0be09fb29727 tempest-CreateVolumesFromSnapshotTest-533849331 None] Created reservations ['1c39f535-6c66-4fdb-bd6d-82265afefd2d', '5e059f81-22f4-42ca-abc6-98480dfef423', 'a168563b-bfc7-4d96-9751-90832eca3951', '0a3d4a2a-503b-41fc-814e-ff4c0ccba708'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:31:07 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-61f64157-7a49-4690-9571-0be09fb29727 tempest-CreateVolumesFromSnapshotTest-533849331 None] Delete snapshot completed successfully. Aug 05 10:31:07 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-61f64157-7a49-4690-9571-0be09fb29727 tempest-CreateVolumesFromSnapshotTest-533849331 None] Lock "cinder-c57706b2-912a-4142-8819-0e339f6bd5d7-delete_snapshot" released by "delete_snapshot" :: held 1.487s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:31:08 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-5fd00d4c-f41d-4d50-b1ce-bb5e9ce2cd53 tempest-CreateVolumesFromSnapshotTest-533849331 None] Acquiring lock "cinder-f0b721ae-7a66-4121-80e1-f31bfa8d0bd9-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:31:08 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-5fd00d4c-f41d-4d50-b1ce-bb5e9ce2cd53 tempest-CreateVolumesFromSnapshotTest-533849331 None] Lock "cinder-f0b721ae-7a66-4121-80e1-f31bfa8d0bd9-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:31:08 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-5fd00d4c-f41d-4d50-b1ce-bb5e9ce2cd53 tempest-CreateVolumesFromSnapshotTest-533849331 None] Acquiring lock "cinder-quobyte-f0b721ae-7a66-4121-80e1-f31bfa8d0bd9" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:31:08 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-5fd00d4c-f41d-4d50-b1ce-bb5e9ce2cd53 tempest-CreateVolumesFromSnapshotTest-533849331 None] Lock "cinder-quobyte-f0b721ae-7a66-4121-80e1-f31bfa8d0bd9" acquired by "delete_volume" :: waited 0.013s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:31:08 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[03dc1aa5-c00f-4626-9ae1-35c58bbb273f]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:31:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5fd00d4c-f41d-4d50-b1ce-bb5e9ce2cd53 tempest-CreateVolumesFromSnapshotTest-533849331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f0b721ae-7a66-4121-80e1-f31bfa8d0bd9 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:08 devstack sudo[105729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f0b721ae-7a66-4121-80e1-f31bfa8d0bd9 Aug 05 10:31:08 devstack sudo[105729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:09 devstack sudo[105729]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5fd00d4c-f41d-4d50-b1ce-bb5e9ce2cd53 tempest-CreateVolumesFromSnapshotTest-533849331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f0b721ae-7a66-4121-80e1-f31bfa8d0bd9" returned: 0 in 0.338s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5fd00d4c-f41d-4d50-b1ce-bb5e9ce2cd53 tempest-CreateVolumesFromSnapshotTest-533849331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f0b721ae-7a66-4121-80e1-f31bfa8d0bd9 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:09 devstack sudo[105734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f0b721ae-7a66-4121-80e1-f31bfa8d0bd9 Aug 05 10:31:09 devstack sudo[105734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:09 devstack sudo[105734]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5fd00d4c-f41d-4d50-b1ce-bb5e9ce2cd53 tempest-CreateVolumesFromSnapshotTest-533849331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f0b721ae-7a66-4121-80e1-f31bfa8d0bd9" returned: 0 in 0.229s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:09 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-5fd00d4c-f41d-4d50-b1ce-bb5e9ce2cd53 tempest-CreateVolumesFromSnapshotTest-533849331 None] Lock "cinder-quobyte-f0b721ae-7a66-4121-80e1-f31bfa8d0bd9" released by "delete_volume" :: held 0.620s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:31:09 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-5fd00d4c-f41d-4d50-b1ce-bb5e9ce2cd53 tempest-CreateVolumesFromSnapshotTest-533849331 None] Created reservations ['0c13ecbf-9411-468d-8937-8f2954b54d26', 'fbb2579b-bbfe-408a-9c9d-82b722c8ff0a', '3f6b1d7d-9286-4d33-856f-e5d2a4342679', 'c9c2d76f-49fb-4a35-b1bc-c7db7708d406'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:31:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5fd00d4c-f41d-4d50-b1ce-bb5e9ce2cd53 tempest-CreateVolumesFromSnapshotTest-533849331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:31:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5fd00d4c-f41d-4d50-b1ce-bb5e9ce2cd53 tempest-CreateVolumesFromSnapshotTest-533849331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:31:09 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-5fd00d4c-f41d-4d50-b1ce-bb5e9ce2cd53 tempest-CreateVolumesFromSnapshotTest-533849331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:31:09 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-5fd00d4c-f41d-4d50-b1ce-bb5e9ce2cd53 tempest-CreateVolumesFromSnapshotTest-533849331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:31:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5fd00d4c-f41d-4d50-b1ce-bb5e9ce2cd53 tempest-CreateVolumesFromSnapshotTest-533849331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:31:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5fd00d4c-f41d-4d50-b1ce-bb5e9ce2cd53 tempest-CreateVolumesFromSnapshotTest-533849331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:09 devstack sudo[105737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:31:09 devstack sudo[105737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:09 devstack sudo[105737]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5fd00d4c-f41d-4d50-b1ce-bb5e9ce2cd53 tempest-CreateVolumesFromSnapshotTest-533849331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.231s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:09 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-5fd00d4c-f41d-4d50-b1ce-bb5e9ce2cd53 tempest-CreateVolumesFromSnapshotTest-533849331 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:31:09 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-5fd00d4c-f41d-4d50-b1ce-bb5e9ce2cd53 tempest-CreateVolumesFromSnapshotTest-533849331 None] Deleted volume successfully. Aug 05 10:31:09 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-5fd00d4c-f41d-4d50-b1ce-bb5e9ce2cd53 tempest-CreateVolumesFromSnapshotTest-533849331 None] Lock "cinder-f0b721ae-7a66-4121-80e1-f31bfa8d0bd9-delete_volume" released by "delete_volume" :: held 1.032s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:31:12 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2e6c198-f4ea-4803-8638-512da5b6a9c2 tempest-VolumeDependencyTests-2775705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:31:12 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c2e6c198-f4ea-4803-8638-512da5b6a9c2 tempest-VolumeDependencyTests-2775705 None] Flow 'volume_create_manager' (b63f3130-864e-4d8f-8bb7-caba821f3306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:31:12 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c2e6c198-f4ea-4803-8638-512da5b6a9c2 tempest-VolumeDependencyTests-2775705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a647cce9-2f97-4360-838a-01b558813ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:31:12 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c2e6c198-f4ea-4803-8638-512da5b6a9c2 tempest-VolumeDependencyTests-2775705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a647cce9-2f97-4360-838a-01b558813ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:31:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1082956863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f23d21b-7c01-48dd-87f2-07f736cec27e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39e6db2276b449c58e4e0c210803404a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:31:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:31:12Z,use_quota=True,user_id='f1fdcfc76b314b67bdb02bd36f230cff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:31:12 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c2e6c198-f4ea-4803-8638-512da5b6a9c2 tempest-VolumeDependencyTests-2775705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5751197-fe69-452b-a0e9-50aee641e7fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:31:12 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c2e6c198-f4ea-4803-8638-512da5b6a9c2 tempest-VolumeDependencyTests-2775705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5751197-fe69-452b-a0e9-50aee641e7fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:31:12 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c2e6c198-f4ea-4803-8638-512da5b6a9c2 tempest-VolumeDependencyTests-2775705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ae2cb06-5237-4385-a130-bd7b378c66fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:31:12 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c2e6c198-f4ea-4803-8638-512da5b6a9c2 tempest-VolumeDependencyTests-2775705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ae2cb06-5237-4385-a130-bd7b378c66fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f23d21b-7c01-48dd-87f2-07f736cec27e', 'volume_name': 'volume-8f23d21b-7c01-48dd-87f2-07f736cec27e', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:31:12 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c2e6c198-f4ea-4803-8638-512da5b6a9c2 tempest-VolumeDependencyTests-2775705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1443d3c0-9e48-44f5-8a1d-d29f58b8bc7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:31:12 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c2e6c198-f4ea-4803-8638-512da5b6a9c2 tempest-VolumeDependencyTests-2775705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1443d3c0-9e48-44f5-8a1d-d29f58b8bc7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:31:12 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c2e6c198-f4ea-4803-8638-512da5b6a9c2 tempest-VolumeDependencyTests-2775705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fabfafc-8d18-40e8-bb42-5f6ad7e82c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:31:12 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-c2e6c198-f4ea-4803-8638-512da5b6a9c2 tempest-VolumeDependencyTests-2775705 None] Volume 8f23d21b-7c01-48dd-87f2-07f736cec27e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f23d21b-7c01-48dd-87f2-07f736cec27e', 'volume_size': 1} Aug 05 10:31:12 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c2e6c198-f4ea-4803-8638-512da5b6a9c2 tempest-VolumeDependencyTests-2775705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:31:12 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c2e6c198-f4ea-4803-8638-512da5b6a9c2 tempest-VolumeDependencyTests-2775705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:31:12 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-c2e6c198-f4ea-4803-8638-512da5b6a9c2 tempest-VolumeDependencyTests-2775705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:31:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1082956863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f23d21b-7c01-48dd-87f2-07f736cec27e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39e6db2276b449c58e4e0c210803404a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:31:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:31:12Z,use_quota=True,user_id='f1fdcfc76b314b67bdb02bd36f230cff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:31:12 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-c2e6c198-f4ea-4803-8638-512da5b6a9c2 tempest-VolumeDependencyTests-2775705 None] Creating volume 8f23d21b-7c01-48dd-87f2-07f736cec27e {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:31:12 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c2e6c198-f4ea-4803-8638-512da5b6a9c2 tempest-VolumeDependencyTests-2775705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:31:12 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c2e6c198-f4ea-4803-8638-512da5b6a9c2 tempest-VolumeDependencyTests-2775705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:31:12 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-c2e6c198-f4ea-4803-8638-512da5b6a9c2 tempest-VolumeDependencyTests-2775705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:31:12 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-c2e6c198-f4ea-4803-8638-512da5b6a9c2 tempest-VolumeDependencyTests-2775705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:31:12 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c2e6c198-f4ea-4803-8638-512da5b6a9c2 tempest-VolumeDependencyTests-2775705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:31:12 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-c2e6c198-f4ea-4803-8638-512da5b6a9c2 tempest-VolumeDependencyTests-2775705 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:31:12 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-c2e6c198-f4ea-4803-8638-512da5b6a9c2 tempest-VolumeDependencyTests-2775705 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:31:12 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c2e6c198-f4ea-4803-8638-512da5b6a9c2 tempest-VolumeDependencyTests-2775705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8f23d21b-7c01-48dd-87f2-07f736cec27e 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:12 devstack sudo[105741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8f23d21b-7c01-48dd-87f2-07f736cec27e 1073741824 Aug 05 10:31:12 devstack sudo[105741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:12 devstack sudo[105741]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:12 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c2e6c198-f4ea-4803-8638-512da5b6a9c2 tempest-VolumeDependencyTests-2775705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8f23d21b-7c01-48dd-87f2-07f736cec27e 1073741824" returned: 0 in 0.391s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:12 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c2e6c198-f4ea-4803-8638-512da5b6a9c2 tempest-VolumeDependencyTests-2775705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8f23d21b-7c01-48dd-87f2-07f736cec27e {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:12 devstack sudo[105747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8f23d21b-7c01-48dd-87f2-07f736cec27e Aug 05 10:31:12 devstack sudo[105747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:12 devstack sudo[105747]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:12 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c2e6c198-f4ea-4803-8638-512da5b6a9c2 tempest-VolumeDependencyTests-2775705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8f23d21b-7c01-48dd-87f2-07f736cec27e" returned: 0 in 0.234s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:12 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-c2e6c198-f4ea-4803-8638-512da5b6a9c2 tempest-VolumeDependencyTests-2775705 None] <== create_volume: return (663ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:31:12 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c2e6c198-f4ea-4803-8638-512da5b6a9c2 tempest-VolumeDependencyTests-2775705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.665s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:31:12 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c2e6c198-f4ea-4803-8638-512da5b6a9c2 tempest-VolumeDependencyTests-2775705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fabfafc-8d18-40e8-bb42-5f6ad7e82c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f23d21b-7c01-48dd-87f2-07f736cec27e', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:31:12 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c2e6c198-f4ea-4803-8638-512da5b6a9c2 tempest-VolumeDependencyTests-2775705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78361357-0b20-4cae-bccf-41391c6b95cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:31:12 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-c2e6c198-f4ea-4803-8638-512da5b6a9c2 tempest-VolumeDependencyTests-2775705 None] Volume volume-8f23d21b-7c01-48dd-87f2-07f736cec27e (8f23d21b-7c01-48dd-87f2-07f736cec27e): created successfully Aug 05 10:31:13 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c2e6c198-f4ea-4803-8638-512da5b6a9c2 tempest-VolumeDependencyTests-2775705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78361357-0b20-4cae-bccf-41391c6b95cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:31:13 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c2e6c198-f4ea-4803-8638-512da5b6a9c2 tempest-VolumeDependencyTests-2775705 None] Flow 'volume_create_manager' (b63f3130-864e-4d8f-8bb7-caba821f3306) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:31:13 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-c2e6c198-f4ea-4803-8638-512da5b6a9c2 tempest-VolumeDependencyTests-2775705 None] Created volume successfully. Aug 05 10:31:13 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-39a3389f-accb-45f9-bcbc-7bbb4652ba0c tempest-VolumeDependencyTests-2775705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:31:13 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-39a3389f-accb-45f9-bcbc-7bbb4652ba0c tempest-VolumeDependencyTests-2775705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:31:13 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-39a3389f-accb-45f9-bcbc-7bbb4652ba0c tempest-VolumeDependencyTests-2775705 None] Creating offline snapshot f8722c82-8bb1-4bb0-803d-4db0e730fc78 of volume 8f23d21b-7c01-48dd-87f2-07f736cec27e {{(pid=88613) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:31:13 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0398c66-d93b-4de4-af16-a318c7f1a504]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:31:13 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-39a3389f-accb-45f9-bcbc-7bbb4652ba0c tempest-VolumeDependencyTests-2775705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8f23d21b-7c01-48dd-87f2-07f736cec27e {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:13 devstack sudo[105750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8f23d21b-7c01-48dd-87f2-07f736cec27e Aug 05 10:31:13 devstack sudo[105750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:13 devstack sudo[105750]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:13 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-39a3389f-accb-45f9-bcbc-7bbb4652ba0c tempest-VolumeDependencyTests-2775705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8f23d21b-7c01-48dd-87f2-07f736cec27e" returned: 0 in 0.352s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:13 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-39a3389f-accb-45f9-bcbc-7bbb4652ba0c tempest-VolumeDependencyTests-2775705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8f23d21b-7c01-48dd-87f2-07f736cec27e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8f23d21b-7c01-48dd-87f2-07f736cec27e.f8722c82-8bb1-4bb0-803d-4db0e730fc78 1G {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:13 devstack sudo[105756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8f23d21b-7c01-48dd-87f2-07f736cec27e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8f23d21b-7c01-48dd-87f2-07f736cec27e.f8722c82-8bb1-4bb0-803d-4db0e730fc78 1G Aug 05 10:31:13 devstack sudo[105756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:14 devstack sudo[105756]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:14 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-39a3389f-accb-45f9-bcbc-7bbb4652ba0c tempest-VolumeDependencyTests-2775705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8f23d21b-7c01-48dd-87f2-07f736cec27e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8f23d21b-7c01-48dd-87f2-07f736cec27e.f8722c82-8bb1-4bb0-803d-4db0e730fc78 1G" returned: 0 in 0.369s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:14 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-39a3389f-accb-45f9-bcbc-7bbb4652ba0c tempest-VolumeDependencyTests-2775705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f23d21b-7c01-48dd-87f2-07f736cec27e -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8f23d21b-7c01-48dd-87f2-07f736cec27e.f8722c82-8bb1-4bb0-803d-4db0e730fc78 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:14 devstack sudo[105761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f23d21b-7c01-48dd-87f2-07f736cec27e -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8f23d21b-7c01-48dd-87f2-07f736cec27e.f8722c82-8bb1-4bb0-803d-4db0e730fc78 Aug 05 10:31:14 devstack sudo[105761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:14 devstack sudo[105761]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:14 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-39a3389f-accb-45f9-bcbc-7bbb4652ba0c tempest-VolumeDependencyTests-2775705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f23d21b-7c01-48dd-87f2-07f736cec27e -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8f23d21b-7c01-48dd-87f2-07f736cec27e.f8722c82-8bb1-4bb0-803d-4db0e730fc78" returned: 0 in 0.270s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:14 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-39a3389f-accb-45f9-bcbc-7bbb4652ba0c tempest-VolumeDependencyTests-2775705 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8f23d21b-7c01-48dd-87f2-07f736cec27e.f8722c82-8bb1-4bb0-803d-4db0e730fc78 is being set with open permissions: ugo+rw Aug 05 10:31:14 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-39a3389f-accb-45f9-bcbc-7bbb4652ba0c tempest-VolumeDependencyTests-2775705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8f23d21b-7c01-48dd-87f2-07f736cec27e.f8722c82-8bb1-4bb0-803d-4db0e730fc78 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:14 devstack sudo[105766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8f23d21b-7c01-48dd-87f2-07f736cec27e.f8722c82-8bb1-4bb0-803d-4db0e730fc78 Aug 05 10:31:14 devstack sudo[105766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:14 devstack sudo[105766]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:14 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-39a3389f-accb-45f9-bcbc-7bbb4652ba0c tempest-VolumeDependencyTests-2775705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8f23d21b-7c01-48dd-87f2-07f736cec27e.f8722c82-8bb1-4bb0-803d-4db0e730fc78" returned: 0 in 0.231s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:14 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-39a3389f-accb-45f9-bcbc-7bbb4652ba0c tempest-VolumeDependencyTests-2775705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8f23d21b-7c01-48dd-87f2-07f736cec27e.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:14 devstack sudo[105770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8f23d21b-7c01-48dd-87f2-07f736cec27e.info Aug 05 10:31:14 devstack sudo[105770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:14 devstack sudo[105770]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:14 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-39a3389f-accb-45f9-bcbc-7bbb4652ba0c tempest-VolumeDependencyTests-2775705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8f23d21b-7c01-48dd-87f2-07f736cec27e.info" returned: 0 in 0.235s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:14 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-39a3389f-accb-45f9-bcbc-7bbb4652ba0c tempest-VolumeDependencyTests-2775705 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8f23d21b-7c01-48dd-87f2-07f736cec27e.info is being set with open permissions: ugo+rw Aug 05 10:31:14 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-39a3389f-accb-45f9-bcbc-7bbb4652ba0c tempest-VolumeDependencyTests-2775705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8f23d21b-7c01-48dd-87f2-07f736cec27e.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:14 devstack sudo[105773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8f23d21b-7c01-48dd-87f2-07f736cec27e.info Aug 05 10:31:14 devstack sudo[105773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:15 devstack sudo[105773]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:15 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-39a3389f-accb-45f9-bcbc-7bbb4652ba0c tempest-VolumeDependencyTests-2775705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8f23d21b-7c01-48dd-87f2-07f736cec27e.info" returned: 0 in 0.230s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:15 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-39a3389f-accb-45f9-bcbc-7bbb4652ba0c tempest-VolumeDependencyTests-2775705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.768s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:31:15 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-39a3389f-accb-45f9-bcbc-7bbb4652ba0c tempest-VolumeDependencyTests-2775705 None] Create snapshot completed successfully Aug 05 10:31:15 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff3fba98-e175-400e-809c-817e4edf42a6 tempest-VolumeDependencyTests-2775705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:31:15 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ff3fba98-e175-400e-809c-817e4edf42a6 tempest-VolumeDependencyTests-2775705 None] Flow 'volume_create_manager' (db5512bf-01cb-4c2f-b6ba-c4f505c5872f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:31:15 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ff3fba98-e175-400e-809c-817e4edf42a6 tempest-VolumeDependencyTests-2775705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be797829-e3b3-449b-99ac-5200869d82b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:31:16 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ff3fba98-e175-400e-809c-817e4edf42a6 tempest-VolumeDependencyTests-2775705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be797829-e3b3-449b-99ac-5200869d82b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:31:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1151447607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3e1f247-6363-4ff9-86e3-8bfbd292e607,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39e6db2276b449c58e4e0c210803404a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:31:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f8722c82-8bb1-4bb0-803d-4db0e730fc78,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:31:16Z,use_quota=True,user_id='f1fdcfc76b314b67bdb02bd36f230cff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:31:16 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ff3fba98-e175-400e-809c-817e4edf42a6 tempest-VolumeDependencyTests-2775705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (196b3c6f-4385-4a2a-944b-740ecde8603d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:31:16 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ff3fba98-e175-400e-809c-817e4edf42a6 tempest-VolumeDependencyTests-2775705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (196b3c6f-4385-4a2a-944b-740ecde8603d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:31:16 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ff3fba98-e175-400e-809c-817e4edf42a6 tempest-VolumeDependencyTests-2775705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecee9607-e8e2-4deb-9470-e6898a3279d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:31:16 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ff3fba98-e175-400e-809c-817e4edf42a6 tempest-VolumeDependencyTests-2775705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecee9607-e8e2-4deb-9470-e6898a3279d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a3e1f247-6363-4ff9-86e3-8bfbd292e607', 'volume_name': 'volume-a3e1f247-6363-4ff9-86e3-8bfbd292e607', 'volume_size': 1, 'snapshot_id': 'f8722c82-8bb1-4bb0-803d-4db0e730fc78'}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:31:16 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ff3fba98-e175-400e-809c-817e4edf42a6 tempest-VolumeDependencyTests-2775705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c690b002-ec1b-4b34-8997-a21c0c2a7eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:31:16 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ff3fba98-e175-400e-809c-817e4edf42a6 tempest-VolumeDependencyTests-2775705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c690b002-ec1b-4b34-8997-a21c0c2a7eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:31:16 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ff3fba98-e175-400e-809c-817e4edf42a6 tempest-VolumeDependencyTests-2775705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (359d7717-6a62-42cc-98c1-d81e35e4defc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:31:16 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-ff3fba98-e175-400e-809c-817e4edf42a6 tempest-VolumeDependencyTests-2775705 None] Volume a3e1f247-6363-4ff9-86e3-8bfbd292e607: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a3e1f247-6363-4ff9-86e3-8bfbd292e607', 'volume_size': 1, 'snapshot_id': 'f8722c82-8bb1-4bb0-803d-4db0e730fc78'} Aug 05 10:31:16 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-ff3fba98-e175-400e-809c-817e4edf42a6 tempest-VolumeDependencyTests-2775705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:31:16 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-ff3fba98-e175-400e-809c-817e4edf42a6 tempest-VolumeDependencyTests-2775705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:31:16 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-ff3fba98-e175-400e-809c-817e4edf42a6 tempest-VolumeDependencyTests-2775705 None] Acquiring lock "cinder-quobyte-f8722c82-8bb1-4bb0-803d-4db0e730fc78-a3e1f247-6363-4ff9-86e3-8bfbd292e607" by "_create_volume_from_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:31:16 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-ff3fba98-e175-400e-809c-817e4edf42a6 tempest-VolumeDependencyTests-2775705 None] Lock "cinder-quobyte-f8722c82-8bb1-4bb0-803d-4db0e730fc78-a3e1f247-6363-4ff9-86e3-8bfbd292e607" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:31:16 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-ff3fba98-e175-400e-809c-817e4edf42a6 tempest-VolumeDependencyTests-2775705 None] Creating volume a3e1f247-6363-4ff9-86e3-8bfbd292e607 from snapshot f8722c82-8bb1-4bb0-803d-4db0e730fc78 {{(pid=88613) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 05 10:31:16 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-ff3fba98-e175-400e-809c-817e4edf42a6 tempest-VolumeDependencyTests-2775705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:31:16 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-ff3fba98-e175-400e-809c-817e4edf42a6 tempest-VolumeDependencyTests-2775705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:31:16 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-ff3fba98-e175-400e-809c-817e4edf42a6 tempest-VolumeDependencyTests-2775705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:31:16 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-ff3fba98-e175-400e-809c-817e4edf42a6 tempest-VolumeDependencyTests-2775705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:31:16 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-ff3fba98-e175-400e-809c-817e4edf42a6 tempest-VolumeDependencyTests-2775705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:31:16 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-ff3fba98-e175-400e-809c-817e4edf42a6 tempest-VolumeDependencyTests-2775705 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:31:16 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-ff3fba98-e175-400e-809c-817e4edf42a6 tempest-VolumeDependencyTests-2775705 None] Acquiring lock "cinder-quobyte-a3e1f247-6363-4ff9-86e3-8bfbd292e607" by "_copy_volume_from_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:31:16 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-ff3fba98-e175-400e-809c-817e4edf42a6 tempest-VolumeDependencyTests-2775705 None] Lock "cinder-quobyte-a3e1f247-6363-4ff9-86e3-8bfbd292e607" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:31:16 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-ff3fba98-e175-400e-809c-817e4edf42a6 tempest-VolumeDependencyTests-2775705 None] snapshot: f8722c82-8bb1-4bb0-803d-4db0e730fc78, volume: a3e1f247-6363-4ff9-86e3-8bfbd292e607, {{(pid=88613) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 05 10:31:16 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-ff3fba98-e175-400e-809c-817e4edf42a6 tempest-VolumeDependencyTests-2775705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:31:16 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-ff3fba98-e175-400e-809c-817e4edf42a6 tempest-VolumeDependencyTests-2775705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:31:16 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-ff3fba98-e175-400e-809c-817e4edf42a6 tempest-VolumeDependencyTests-2775705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:31:16 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-ff3fba98-e175-400e-809c-817e4edf42a6 tempest-VolumeDependencyTests-2775705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:31:16 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-ff3fba98-e175-400e-809c-817e4edf42a6 tempest-VolumeDependencyTests-2775705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:31:16 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[06150ec4-d5e9-436b-bbac-22a18f6eca0b]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:31:16 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ff3fba98-e175-400e-809c-817e4edf42a6 tempest-VolumeDependencyTests-2775705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8f23d21b-7c01-48dd-87f2-07f736cec27e.f8722c82-8bb1-4bb0-803d-4db0e730fc78 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:16 devstack sudo[105778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8f23d21b-7c01-48dd-87f2-07f736cec27e.f8722c82-8bb1-4bb0-803d-4db0e730fc78 Aug 05 10:31:16 devstack sudo[105778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:16 devstack sudo[105778]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:16 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ff3fba98-e175-400e-809c-817e4edf42a6 tempest-VolumeDependencyTests-2775705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8f23d21b-7c01-48dd-87f2-07f736cec27e.f8722c82-8bb1-4bb0-803d-4db0e730fc78" returned: 0 in 0.343s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:16 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-ff3fba98-e175-400e-809c-817e4edf42a6 tempest-VolumeDependencyTests-2775705 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f23d21b-7c01-48dd-87f2-07f736cec27e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88613) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:31:16 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[b73c5561-9a53-443a-aca4-17b11859dd7b]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:31:16 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ff3fba98-e175-400e-809c-817e4edf42a6 tempest-VolumeDependencyTests-2775705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8f23d21b-7c01-48dd-87f2-07f736cec27e {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:16 devstack sudo[105783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8f23d21b-7c01-48dd-87f2-07f736cec27e Aug 05 10:31:16 devstack sudo[105783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:16 devstack sudo[105783]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:16 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ff3fba98-e175-400e-809c-817e4edf42a6 tempest-VolumeDependencyTests-2775705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8f23d21b-7c01-48dd-87f2-07f736cec27e" returned: 0 in 0.385s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:16 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-ff3fba98-e175-400e-809c-817e4edf42a6 tempest-VolumeDependencyTests-2775705 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8f23d21b-7c01-48dd-87f2-07f736cec27e {{(pid=88613) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 05 10:31:16 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-ff3fba98-e175-400e-809c-817e4edf42a6 tempest-VolumeDependencyTests-2775705 None] Creating direct copy from snapshot {{(pid=88613) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 05 10:31:16 devstack cinder-volume[88613]: DEBUG cinder.utils [None req-ff3fba98-e175-400e-809c-817e4edf42a6 tempest-VolumeDependencyTests-2775705 None] Path /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a3e1f247-6363-4ff9-86e3-8bfbd292e607 not found in is_blk_device check {{(pid=88613) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 05 10:31:16 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ff3fba98-e175-400e-809c-817e4edf42a6 tempest-VolumeDependencyTests-2775705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8f23d21b-7c01-48dd-87f2-07f736cec27e /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a3e1f247-6363-4ff9-86e3-8bfbd292e607 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:16 devstack sudo[105788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8f23d21b-7c01-48dd-87f2-07f736cec27e /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a3e1f247-6363-4ff9-86e3-8bfbd292e607 Aug 05 10:31:16 devstack sudo[105788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:20 devstack sudo[105788]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ff3fba98-e175-400e-809c-817e4edf42a6 tempest-VolumeDependencyTests-2775705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8f23d21b-7c01-48dd-87f2-07f736cec27e /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a3e1f247-6363-4ff9-86e3-8bfbd292e607" returned: 0 in 3.997s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:20 devstack cinder-volume[88613]: DEBUG cinder.image.image_utils [None req-ff3fba98-e175-400e-809c-817e4edf42a6 tempest-VolumeDependencyTests-2775705 None] Image conversion details: src /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8f23d21b-7c01-48dd-87f2-07f736cec27e, size 1024.00 MB, duration 4.00 sec, destination /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a3e1f247-6363-4ff9-86e3-8bfbd292e607 {{(pid=88613) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 10:31:20 devstack cinder-volume[88613]: INFO cinder.image.image_utils [None req-ff3fba98-e175-400e-809c-817e4edf42a6 tempest-VolumeDependencyTests-2775705 None] Converted 1024.00 MB image at 256.12 MB/s Aug 05 10:31:20 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-ff3fba98-e175-400e-809c-817e4edf42a6 tempest-VolumeDependencyTests-2775705 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a3e1f247-6363-4ff9-86e3-8bfbd292e607 is being set with open permissions: ugo+rw Aug 05 10:31:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ff3fba98-e175-400e-809c-817e4edf42a6 tempest-VolumeDependencyTests-2775705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a3e1f247-6363-4ff9-86e3-8bfbd292e607 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:20 devstack sudo[105801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a3e1f247-6363-4ff9-86e3-8bfbd292e607 Aug 05 10:31:20 devstack sudo[105801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:21 devstack sudo[105801]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ff3fba98-e175-400e-809c-817e4edf42a6 tempest-VolumeDependencyTests-2775705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a3e1f247-6363-4ff9-86e3-8bfbd292e607" returned: 0 in 0.238s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:21 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-ff3fba98-e175-400e-809c-817e4edf42a6 tempest-VolumeDependencyTests-2775705 None] Lock "cinder-quobyte-a3e1f247-6363-4ff9-86e3-8bfbd292e607" released by "_copy_volume_from_snapshot" :: held 5.034s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:31:21 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-ff3fba98-e175-400e-809c-817e4edf42a6 tempest-VolumeDependencyTests-2775705 None] Lock "cinder-quobyte-f8722c82-8bb1-4bb0-803d-4db0e730fc78-a3e1f247-6363-4ff9-86e3-8bfbd292e607" released by "_create_volume_from_snapshot" :: held 5.091s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:31:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-ff3fba98-e175-400e-809c-817e4edf42a6 tempest-VolumeDependencyTests-2775705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.106s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:31:21 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ff3fba98-e175-400e-809c-817e4edf42a6 tempest-VolumeDependencyTests-2775705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (359d7717-6a62-42cc-98c1-d81e35e4defc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3e1f247-6363-4ff9-86e3-8bfbd292e607', 'volume_size': 1, 'snapshot_id': 'f8722c82-8bb1-4bb0-803d-4db0e730fc78'}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:31:21 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ff3fba98-e175-400e-809c-817e4edf42a6 tempest-VolumeDependencyTests-2775705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58b0bab0-9160-473b-90f6-36e2a13e1cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:31:21 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-ff3fba98-e175-400e-809c-817e4edf42a6 tempest-VolumeDependencyTests-2775705 None] Volume volume-a3e1f247-6363-4ff9-86e3-8bfbd292e607 (a3e1f247-6363-4ff9-86e3-8bfbd292e607): created successfully Aug 05 10:31:21 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ff3fba98-e175-400e-809c-817e4edf42a6 tempest-VolumeDependencyTests-2775705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58b0bab0-9160-473b-90f6-36e2a13e1cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:31:21 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-ff3fba98-e175-400e-809c-817e4edf42a6 tempest-VolumeDependencyTests-2775705 None] Flow 'volume_create_manager' (db5512bf-01cb-4c2f-b6ba-c4f505c5872f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:31:21 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-ff3fba98-e175-400e-809c-817e4edf42a6 tempest-VolumeDependencyTests-2775705 None] Created volume successfully. Aug 05 10:31:21 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-a9384a97-98d8-4039-814e-757647504c4b tempest-VolumeDependencyTests-2775705 None] Acquiring lock "cinder-f8722c82-8bb1-4bb0-803d-4db0e730fc78-delete_snapshot" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:31:21 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-a9384a97-98d8-4039-814e-757647504c4b tempest-VolumeDependencyTests-2775705 None] Lock "cinder-f8722c82-8bb1-4bb0-803d-4db0e730fc78-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:31:21 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-a9384a97-98d8-4039-814e-757647504c4b tempest-VolumeDependencyTests-2775705 None] Acquiring lock "cinder-quobyte-8f23d21b-7c01-48dd-87f2-07f736cec27e" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:31:21 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-a9384a97-98d8-4039-814e-757647504c4b tempest-VolumeDependencyTests-2775705 None] Lock "cinder-quobyte-8f23d21b-7c01-48dd-87f2-07f736cec27e" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:31:21 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-a9384a97-98d8-4039-814e-757647504c4b tempest-VolumeDependencyTests-2775705 None] Acquiring lock "cinder-quobyte-f8722c82-8bb1-4bb0-803d-4db0e730fc78" by "_delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:31:21 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-a9384a97-98d8-4039-814e-757647504c4b tempest-VolumeDependencyTests-2775705 None] Lock "cinder-quobyte-f8722c82-8bb1-4bb0-803d-4db0e730fc78" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:31:21 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-a9384a97-98d8-4039-814e-757647504c4b tempest-VolumeDependencyTests-2775705 None] Deleting offline snapshot f8722c82-8bb1-4bb0-803d-4db0e730fc78 of volume 8f23d21b-7c01-48dd-87f2-07f736cec27e {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:31:21 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-a9384a97-98d8-4039-814e-757647504c4b tempest-VolumeDependencyTests-2775705 None] snapshot_file for this snap is: volume-8f23d21b-7c01-48dd-87f2-07f736cec27e.f8722c82-8bb1-4bb0-803d-4db0e730fc78 {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:31:21 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[64091bf3-afef-4db9-ba29-372011352ad8]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:31:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a9384a97-98d8-4039-814e-757647504c4b tempest-VolumeDependencyTests-2775705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8f23d21b-7c01-48dd-87f2-07f736cec27e.f8722c82-8bb1-4bb0-803d-4db0e730fc78 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:21 devstack sudo[105804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8f23d21b-7c01-48dd-87f2-07f736cec27e.f8722c82-8bb1-4bb0-803d-4db0e730fc78 Aug 05 10:31:21 devstack sudo[105804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:21 devstack cinder-volume[88613]: DEBUG oslo_service.periodic_task [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88613) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:31:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:31:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:31:21 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:31:21 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:31:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:31:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:21 devstack sudo[105804]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a9384a97-98d8-4039-814e-757647504c4b tempest-VolumeDependencyTests-2775705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8f23d21b-7c01-48dd-87f2-07f736cec27e.f8722c82-8bb1-4bb0-803d-4db0e730fc78" returned: 0 in 0.357s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:21 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-a9384a97-98d8-4039-814e-757647504c4b tempest-VolumeDependencyTests-2775705 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f23d21b-7c01-48dd-87f2-07f736cec27e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88613) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:31:21 devstack sudo[105809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:31:21 devstack sudo[105809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:21 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[891a9daa-7e7c-4963-a5bc-4f986e52c1c1]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:31:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a9384a97-98d8-4039-814e-757647504c4b tempest-VolumeDependencyTests-2775705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8f23d21b-7c01-48dd-87f2-07f736cec27e {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:21 devstack sudo[105811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8f23d21b-7c01-48dd-87f2-07f736cec27e Aug 05 10:31:21 devstack sudo[105811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:22 devstack sudo[105809]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.240s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:22 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:31:22 devstack cinder-volume[88613]: DEBUG oslo_service.periodic_task [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Running periodic task VolumeManager._thread_info {{(pid=88613) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:31:22 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] thread count: 29 {{(pid=88613) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 10:31:22 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] thread info: [<_MainThread(MainThread, started 126173666128000)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88613) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 10:31:22 devstack sudo[105811]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a9384a97-98d8-4039-814e-757647504c4b tempest-VolumeDependencyTests-2775705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8f23d21b-7c01-48dd-87f2-07f736cec27e" returned: 0 in 0.542s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a9384a97-98d8-4039-814e-757647504c4b tempest-VolumeDependencyTests-2775705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8f23d21b-7c01-48dd-87f2-07f736cec27e.f8722c82-8bb1-4bb0-803d-4db0e730fc78 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:22 devstack sudo[105817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8f23d21b-7c01-48dd-87f2-07f736cec27e.f8722c82-8bb1-4bb0-803d-4db0e730fc78 Aug 05 10:31:22 devstack sudo[105817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:22 devstack sudo[105817]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a9384a97-98d8-4039-814e-757647504c4b tempest-VolumeDependencyTests-2775705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8f23d21b-7c01-48dd-87f2-07f736cec27e.f8722c82-8bb1-4bb0-803d-4db0e730fc78" returned: 0 in 0.337s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a9384a97-98d8-4039-814e-757647504c4b tempest-VolumeDependencyTests-2775705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8f23d21b-7c01-48dd-87f2-07f736cec27e.f8722c82-8bb1-4bb0-803d-4db0e730fc78 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:22 devstack sudo[105822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8f23d21b-7c01-48dd-87f2-07f736cec27e.f8722c82-8bb1-4bb0-803d-4db0e730fc78 Aug 05 10:31:22 devstack sudo[105822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:22 devstack sudo[105822]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a9384a97-98d8-4039-814e-757647504c4b tempest-VolumeDependencyTests-2775705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8f23d21b-7c01-48dd-87f2-07f736cec27e.f8722c82-8bb1-4bb0-803d-4db0e730fc78" returned: 0 in 0.243s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:23 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-a9384a97-98d8-4039-814e-757647504c4b tempest-VolumeDependencyTests-2775705 None] Lock "cinder-quobyte-f8722c82-8bb1-4bb0-803d-4db0e730fc78" released by "_delete_snapshot" :: held 1.583s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:31:23 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-a9384a97-98d8-4039-814e-757647504c4b tempest-VolumeDependencyTests-2775705 None] Lock "cinder-quobyte-8f23d21b-7c01-48dd-87f2-07f736cec27e" released by "delete_snapshot" :: held 1.605s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:31:23 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-a9384a97-98d8-4039-814e-757647504c4b tempest-VolumeDependencyTests-2775705 None] Created reservations ['d48b17ef-4833-484a-bce5-ac0688ddeb72', '5eb17052-e405-4ec7-8637-c9000e59e41b', '99f8f810-fefa-4a62-9b76-ad4671204f9c', '75dd953c-3056-4853-870a-e82d62721975'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:31:23 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-a9384a97-98d8-4039-814e-757647504c4b tempest-VolumeDependencyTests-2775705 None] Delete snapshot completed successfully. Aug 05 10:31:23 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-a9384a97-98d8-4039-814e-757647504c4b tempest-VolumeDependencyTests-2775705 None] Lock "cinder-f8722c82-8bb1-4bb0-803d-4db0e730fc78-delete_snapshot" released by "delete_snapshot" :: held 1.741s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:31:23 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-7e8a508e-827c-41ca-a49e-4870c068864c tempest-VolumeDependencyTests-2775705 None] Acquiring lock "cinder-8f23d21b-7c01-48dd-87f2-07f736cec27e-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:31:23 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-7e8a508e-827c-41ca-a49e-4870c068864c tempest-VolumeDependencyTests-2775705 None] Lock "cinder-8f23d21b-7c01-48dd-87f2-07f736cec27e-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:31:23 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-7e8a508e-827c-41ca-a49e-4870c068864c tempest-VolumeDependencyTests-2775705 None] Acquiring lock "cinder-quobyte-8f23d21b-7c01-48dd-87f2-07f736cec27e" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:31:23 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-7e8a508e-827c-41ca-a49e-4870c068864c tempest-VolumeDependencyTests-2775705 None] Lock "cinder-quobyte-8f23d21b-7c01-48dd-87f2-07f736cec27e" acquired by "delete_volume" :: waited 0.014s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:31:23 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b144d3-a5f7-4316-b385-76b169648934]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:31:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7e8a508e-827c-41ca-a49e-4870c068864c tempest-VolumeDependencyTests-2775705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8f23d21b-7c01-48dd-87f2-07f736cec27e {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:23 devstack sudo[105825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8f23d21b-7c01-48dd-87f2-07f736cec27e Aug 05 10:31:23 devstack sudo[105825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:23 devstack sudo[105825]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7e8a508e-827c-41ca-a49e-4870c068864c tempest-VolumeDependencyTests-2775705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8f23d21b-7c01-48dd-87f2-07f736cec27e" returned: 0 in 0.368s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7e8a508e-827c-41ca-a49e-4870c068864c tempest-VolumeDependencyTests-2775705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8f23d21b-7c01-48dd-87f2-07f736cec27e {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:24 devstack sudo[105830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8f23d21b-7c01-48dd-87f2-07f736cec27e Aug 05 10:31:24 devstack sudo[105830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:24 devstack sudo[105830]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:24 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7e8a508e-827c-41ca-a49e-4870c068864c tempest-VolumeDependencyTests-2775705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8f23d21b-7c01-48dd-87f2-07f736cec27e" returned: 0 in 0.248s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:24 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-7e8a508e-827c-41ca-a49e-4870c068864c tempest-VolumeDependencyTests-2775705 None] Lock "cinder-quobyte-8f23d21b-7c01-48dd-87f2-07f736cec27e" released by "delete_volume" :: held 0.680s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:31:24 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-7e8a508e-827c-41ca-a49e-4870c068864c tempest-VolumeDependencyTests-2775705 None] Created reservations ['b8cd08b9-e981-4355-a9a5-7433aca50db7', 'bb0ccc1f-fe4d-4108-b5c6-4db2c28c8279', 'dae405d4-7df4-4b26-b64c-aea8076bcd8a', '995163e6-1402-4cbf-82d1-68c2a4ace61e'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:31:24 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-7e8a508e-827c-41ca-a49e-4870c068864c tempest-VolumeDependencyTests-2775705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:31:24 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-7e8a508e-827c-41ca-a49e-4870c068864c tempest-VolumeDependencyTests-2775705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:31:24 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-7e8a508e-827c-41ca-a49e-4870c068864c tempest-VolumeDependencyTests-2775705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:31:24 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-7e8a508e-827c-41ca-a49e-4870c068864c tempest-VolumeDependencyTests-2775705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:31:24 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-7e8a508e-827c-41ca-a49e-4870c068864c tempest-VolumeDependencyTests-2775705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:31:24 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7e8a508e-827c-41ca-a49e-4870c068864c tempest-VolumeDependencyTests-2775705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:24 devstack sudo[105833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:31:24 devstack sudo[105833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:24 devstack sudo[105833]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:24 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7e8a508e-827c-41ca-a49e-4870c068864c tempest-VolumeDependencyTests-2775705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.254s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:24 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-7e8a508e-827c-41ca-a49e-4870c068864c tempest-VolumeDependencyTests-2775705 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:31:24 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-7e8a508e-827c-41ca-a49e-4870c068864c tempest-VolumeDependencyTests-2775705 None] Deleted volume successfully. Aug 05 10:31:24 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-7e8a508e-827c-41ca-a49e-4870c068864c tempest-VolumeDependencyTests-2775705 None] Lock "cinder-8f23d21b-7c01-48dd-87f2-07f736cec27e-delete_volume" released by "delete_volume" :: held 1.142s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:31:24 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-f51770ce-316d-486f-9d2c-79d4cf9f9d94 tempest-VolumeDependencyTests-2775705 None] Acquiring lock "cinder-a3e1f247-6363-4ff9-86e3-8bfbd292e607-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:31:24 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-f51770ce-316d-486f-9d2c-79d4cf9f9d94 tempest-VolumeDependencyTests-2775705 None] Lock "cinder-a3e1f247-6363-4ff9-86e3-8bfbd292e607-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:31:24 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-f51770ce-316d-486f-9d2c-79d4cf9f9d94 tempest-VolumeDependencyTests-2775705 None] Acquiring lock "cinder-quobyte-a3e1f247-6363-4ff9-86e3-8bfbd292e607" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:31:24 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-f51770ce-316d-486f-9d2c-79d4cf9f9d94 tempest-VolumeDependencyTests-2775705 None] Lock "cinder-quobyte-a3e1f247-6363-4ff9-86e3-8bfbd292e607" acquired by "delete_volume" :: waited 0.015s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:31:24 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[87150d6c-159d-41b6-86b7-a5737d6bcf74]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:31:24 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f51770ce-316d-486f-9d2c-79d4cf9f9d94 tempest-VolumeDependencyTests-2775705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a3e1f247-6363-4ff9-86e3-8bfbd292e607 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:24 devstack sudo[105837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a3e1f247-6363-4ff9-86e3-8bfbd292e607 Aug 05 10:31:24 devstack sudo[105837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:25 devstack sudo[105837]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f51770ce-316d-486f-9d2c-79d4cf9f9d94 tempest-VolumeDependencyTests-2775705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a3e1f247-6363-4ff9-86e3-8bfbd292e607" returned: 0 in 0.374s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f51770ce-316d-486f-9d2c-79d4cf9f9d94 tempest-VolumeDependencyTests-2775705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a3e1f247-6363-4ff9-86e3-8bfbd292e607 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:25 devstack sudo[105842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a3e1f247-6363-4ff9-86e3-8bfbd292e607 Aug 05 10:31:25 devstack sudo[105842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:25 devstack sudo[105842]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f51770ce-316d-486f-9d2c-79d4cf9f9d94 tempest-VolumeDependencyTests-2775705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a3e1f247-6363-4ff9-86e3-8bfbd292e607" returned: 0 in 0.247s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:25 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-f51770ce-316d-486f-9d2c-79d4cf9f9d94 tempest-VolumeDependencyTests-2775705 None] Lock "cinder-quobyte-a3e1f247-6363-4ff9-86e3-8bfbd292e607" released by "delete_volume" :: held 0.663s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:31:25 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-f51770ce-316d-486f-9d2c-79d4cf9f9d94 tempest-VolumeDependencyTests-2775705 None] Created reservations ['8eb7b461-e404-4a37-ab3d-878a4e2f97b7', '8757aaca-352b-4985-bb46-b5d03c84e092', '3aba8fd0-0cd5-42f3-b9c0-24d2721a90ea', 'cbb80dfd-c5c2-44f7-bfea-2f9a2ae28a30'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:31:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-f51770ce-316d-486f-9d2c-79d4cf9f9d94 tempest-VolumeDependencyTests-2775705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:31:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-f51770ce-316d-486f-9d2c-79d4cf9f9d94 tempest-VolumeDependencyTests-2775705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:31:25 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-f51770ce-316d-486f-9d2c-79d4cf9f9d94 tempest-VolumeDependencyTests-2775705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:31:25 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-f51770ce-316d-486f-9d2c-79d4cf9f9d94 tempest-VolumeDependencyTests-2775705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:31:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-f51770ce-316d-486f-9d2c-79d4cf9f9d94 tempest-VolumeDependencyTests-2775705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:31:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f51770ce-316d-486f-9d2c-79d4cf9f9d94 tempest-VolumeDependencyTests-2775705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:25 devstack sudo[105845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:31:25 devstack sudo[105845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:25 devstack sudo[105845]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f51770ce-316d-486f-9d2c-79d4cf9f9d94 tempest-VolumeDependencyTests-2775705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.245s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:25 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-f51770ce-316d-486f-9d2c-79d4cf9f9d94 tempest-VolumeDependencyTests-2775705 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:31:25 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-f51770ce-316d-486f-9d2c-79d4cf9f9d94 tempest-VolumeDependencyTests-2775705 None] Deleted volume successfully. Aug 05 10:31:25 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-f51770ce-316d-486f-9d2c-79d4cf9f9d94 tempest-VolumeDependencyTests-2775705 None] Lock "cinder-a3e1f247-6363-4ff9-86e3-8bfbd292e607-delete_volume" released by "delete_volume" :: held 1.106s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:31:30 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e35a5ed-55a8-41f0-bdb1-1e6e4a7636a9 tempest-VolumeImageDependencyTests-1989630145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:31:30 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1e35a5ed-55a8-41f0-bdb1-1e6e4a7636a9 tempest-VolumeImageDependencyTests-1989630145 None] Flow 'volume_create_manager' (c22da288-a8db-4971-92ae-700ec352f734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:31:30 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1e35a5ed-55a8-41f0-bdb1-1e6e4a7636a9 tempest-VolumeImageDependencyTests-1989630145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1d1fe62-a880-4d32-b6fa-7a391068d928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:31:30 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1e35a5ed-55a8-41f0-bdb1-1e6e4a7636a9 tempest-VolumeImageDependencyTests-1989630145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1d1fe62-a880-4d32-b6fa-7a391068d928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:31:30Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f18d494f-ed83-49b0-8a03-088390b1b597,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ababa473b2949cf83071aced36dd7c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:31:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:31:31Z,use_quota=True,user_id='403497f7c2934489968b1d67a1937e50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:31:30 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1e35a5ed-55a8-41f0-bdb1-1e6e4a7636a9 tempest-VolumeImageDependencyTests-1989630145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ed49079-1c8b-488f-88c6-4be4507226cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:31:30 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1e35a5ed-55a8-41f0-bdb1-1e6e4a7636a9 tempest-VolumeImageDependencyTests-1989630145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ed49079-1c8b-488f-88c6-4be4507226cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:31:30 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1e35a5ed-55a8-41f0-bdb1-1e6e4a7636a9 tempest-VolumeImageDependencyTests-1989630145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de4eeaf2-98e6-429a-b1c7-c96b9beab9c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:31:30 devstack cinder-volume[88613]: DEBUG cinder.image.glance [None req-1e35a5ed-55a8-41f0-bdb1-1e6e4a7636a9 tempest-VolumeImageDependencyTests-1989630145 None] Creating Keystone auth plugin from conf {{(pid=88613) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 05 10:31:30 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1e35a5ed-55a8-41f0-bdb1-1e6e4a7636a9 tempest-VolumeImageDependencyTests-1989630145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de4eeaf2-98e6-429a-b1c7-c96b9beab9c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f18d494f-ed83-49b0-8a03-088390b1b597', 'volume_name': 'volume-f18d494f-ed83-49b0-8a03-088390b1b597', 'volume_size': 1, 'image_id': 'd464fd4e-368c-48d6-941a-cf4e7c625dec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d464fd4e-368c-48d6-941a-cf4e7c625dec', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '597df38c719d584e3479d7799e504e37', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7ababa473b2949cf83071aced36dd7c0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7efc63b1c9c942a082223d735b27a7fe56806a19a2bf011445e9e7baab6702a473b11358424d98d3bfd5309fcc11a009a147dff1231e2e54d7163d7f162d32c3', 'id': 'd464fd4e-368c-48d6-941a-cf4e7c625dec', 'created_at': datetime.datetime(2026, 8, 5, 8, 31, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 8, 31, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d464fd4e-368c-48d6-941a-cf4e7c625dec/file', 'properties': {}}, 'image_service': }' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:31:30 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1e35a5ed-55a8-41f0-bdb1-1e6e4a7636a9 tempest-VolumeImageDependencyTests-1989630145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d2f240d-8409-46e4-88b0-b3fa53dabe86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:31:30 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1e35a5ed-55a8-41f0-bdb1-1e6e4a7636a9 tempest-VolumeImageDependencyTests-1989630145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d2f240d-8409-46e4-88b0-b3fa53dabe86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:31:30 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1e35a5ed-55a8-41f0-bdb1-1e6e4a7636a9 tempest-VolumeImageDependencyTests-1989630145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e969f1c-d07c-4da7-b00b-eba19ba1af4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:31:30 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-1e35a5ed-55a8-41f0-bdb1-1e6e4a7636a9 tempest-VolumeImageDependencyTests-1989630145 None] Volume f18d494f-ed83-49b0-8a03-088390b1b597: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f18d494f-ed83-49b0-8a03-088390b1b597', 'volume_size': 1, 'image_id': 'd464fd4e-368c-48d6-941a-cf4e7c625dec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d464fd4e-368c-48d6-941a-cf4e7c625dec', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '597df38c719d584e3479d7799e504e37', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7ababa473b2949cf83071aced36dd7c0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7efc63b1c9c942a082223d735b27a7fe56806a19a2bf011445e9e7baab6702a473b11358424d98d3bfd5309fcc11a009a147dff1231e2e54d7163d7f162d32c3', 'id': 'd464fd4e-368c-48d6-941a-cf4e7c625dec', 'created_at': datetime.datetime(2026, 8, 5, 8, 31, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 8, 31, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d464fd4e-368c-48d6-941a-cf4e7c625dec/file', 'properties': {}}, 'image_service': } Aug 05 10:31:30 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e35a5ed-55a8-41f0-bdb1-1e6e4a7636a9 tempest-VolumeImageDependencyTests-1989630145 None] Trying to clone f18d494f-ed83-49b0-8a03-088390b1b597 from image d464fd4e-368c-48d6-941a-cf4e7c625dec at location (None, [{'url': 'file:///opt/stack/data/glance/images/d464fd4e-368c-48d6-941a-cf4e7c625dec', 'metadata': {}}]). {{(pid=88613) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 05 10:31:30 devstack cinder-volume[88613]: DEBUG cinder.image.image_utils [None req-1e35a5ed-55a8-41f0-bdb1-1e6e4a7636a9 tempest-VolumeImageDependencyTests-1989630145 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d464fd4e-368c-48d6-941a-cf4e7c625dec_y_ysimqpdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88613) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 05 10:31:30 devstack cinder-volume[88613]: INFO cinder.image.image_utils [None req-1e35a5ed-55a8-41f0-bdb1-1e6e4a7636a9 tempest-VolumeImageDependencyTests-1989630145 None] Image download 0.00 MB at 0.00 MB/s Aug 05 10:31:30 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[418ab8a7-7e05-44bd-a421-dfceeedbbfa5]: (4, 'raw') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:31:30 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1e35a5ed-55a8-41f0-bdb1-1e6e4a7636a9 tempest-VolumeImageDependencyTests-1989630145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d464fd4e-368c-48d6-941a-cf4e7c625dec_y_ysimqpdevstack@QuobyteHD {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:31 devstack sudo[105848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d464fd4e-368c-48d6-941a-cf4e7c625dec_y_ysimqpdevstack@QuobyteHD Aug 05 10:31:31 devstack sudo[105848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:31 devstack sudo[105848]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:31 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1e35a5ed-55a8-41f0-bdb1-1e6e4a7636a9 tempest-VolumeImageDependencyTests-1989630145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d464fd4e-368c-48d6-941a-cf4e7c625dec_y_ysimqpdevstack@QuobyteHD" returned: 0 in 0.318s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:31 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1e35a5ed-55a8-41f0-bdb1-1e6e4a7636a9 tempest-VolumeImageDependencyTests-1989630145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d464fd4e-368c-48d6-941a-cf4e7c625dec_y_ysimqpdevstack@QuobyteHD {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:31 devstack sudo[105852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d464fd4e-368c-48d6-941a-cf4e7c625dec_y_ysimqpdevstack@QuobyteHD Aug 05 10:31:31 devstack sudo[105852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:31 devstack sudo[105852]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:31 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1e35a5ed-55a8-41f0-bdb1-1e6e4a7636a9 tempest-VolumeImageDependencyTests-1989630145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d464fd4e-368c-48d6-941a-cf4e7c625dec_y_ysimqpdevstack@QuobyteHD" returned: 1 in 0.323s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:31 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1e35a5ed-55a8-41f0-bdb1-1e6e4a7636a9 tempest-VolumeImageDependencyTests-1989630145 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d464fd4e-368c-48d6-941a-cf4e7c625dec_y_ysimqpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 10:31:31 devstack cinder-volume[88613]: DEBUG cinder.image.image_utils [None req-1e35a5ed-55a8-41f0-bdb1-1e6e4a7636a9 tempest-VolumeImageDependencyTests-1989630145 None] Temporary image d464fd4e-368c-48d6-941a-cf4e7c625dec is fetched for user 403497f7c2934489968b1d67a1937e50. {{(pid=88613) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 05 10:31:31 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff3a72c-e786-4177-a92d-f20b942a8241]: (4, 'raw') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:31:31 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1e35a5ed-55a8-41f0-bdb1-1e6e4a7636a9 tempest-VolumeImageDependencyTests-1989630145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d464fd4e-368c-48d6-941a-cf4e7c625dec_y_ysimqpdevstack@QuobyteHD {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:31 devstack sudo[105857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d464fd4e-368c-48d6-941a-cf4e7c625dec_y_ysimqpdevstack@QuobyteHD Aug 05 10:31:31 devstack sudo[105857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:32 devstack sudo[105857]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:32 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1e35a5ed-55a8-41f0-bdb1-1e6e4a7636a9 tempest-VolumeImageDependencyTests-1989630145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d464fd4e-368c-48d6-941a-cf4e7c625dec_y_ysimqpdevstack@QuobyteHD" returned: 0 in 0.319s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:32 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1e35a5ed-55a8-41f0-bdb1-1e6e4a7636a9 tempest-VolumeImageDependencyTests-1989630145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d464fd4e-368c-48d6-941a-cf4e7c625dec_y_ysimqpdevstack@QuobyteHD {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:32 devstack sudo[105861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d464fd4e-368c-48d6-941a-cf4e7c625dec_y_ysimqpdevstack@QuobyteHD Aug 05 10:31:32 devstack sudo[105861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:32 devstack sudo[105861]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:32 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1e35a5ed-55a8-41f0-bdb1-1e6e4a7636a9 tempest-VolumeImageDependencyTests-1989630145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d464fd4e-368c-48d6-941a-cf4e7c625dec_y_ysimqpdevstack@QuobyteHD" returned: 1 in 0.314s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:32 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1e35a5ed-55a8-41f0-bdb1-1e6e4a7636a9 tempest-VolumeImageDependencyTests-1989630145 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d464fd4e-368c-48d6-941a-cf4e7c625dec_y_ysimqpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 10:31:32 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-1e35a5ed-55a8-41f0-bdb1-1e6e4a7636a9 tempest-VolumeImageDependencyTests-1989630145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:31:32 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-1e35a5ed-55a8-41f0-bdb1-1e6e4a7636a9 tempest-VolumeImageDependencyTests-1989630145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:31:32 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-1e35a5ed-55a8-41f0-bdb1-1e6e4a7636a9 tempest-VolumeImageDependencyTests-1989630145 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:31:30Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f18d494f-ed83-49b0-8a03-088390b1b597,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ababa473b2949cf83071aced36dd7c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:31:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:31:31Z,use_quota=True,user_id='403497f7c2934489968b1d67a1937e50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:31:32 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-1e35a5ed-55a8-41f0-bdb1-1e6e4a7636a9 tempest-VolumeImageDependencyTests-1989630145 None] Creating volume f18d494f-ed83-49b0-8a03-088390b1b597 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:31:32 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-1e35a5ed-55a8-41f0-bdb1-1e6e4a7636a9 tempest-VolumeImageDependencyTests-1989630145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:31:32 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-1e35a5ed-55a8-41f0-bdb1-1e6e4a7636a9 tempest-VolumeImageDependencyTests-1989630145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:31:32 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-1e35a5ed-55a8-41f0-bdb1-1e6e4a7636a9 tempest-VolumeImageDependencyTests-1989630145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:31:32 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-1e35a5ed-55a8-41f0-bdb1-1e6e4a7636a9 tempest-VolumeImageDependencyTests-1989630145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:31:32 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-1e35a5ed-55a8-41f0-bdb1-1e6e4a7636a9 tempest-VolumeImageDependencyTests-1989630145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:31:32 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-1e35a5ed-55a8-41f0-bdb1-1e6e4a7636a9 tempest-VolumeImageDependencyTests-1989630145 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:31:32 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-1e35a5ed-55a8-41f0-bdb1-1e6e4a7636a9 tempest-VolumeImageDependencyTests-1989630145 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:31:32 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1e35a5ed-55a8-41f0-bdb1-1e6e4a7636a9 tempest-VolumeImageDependencyTests-1989630145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f18d494f-ed83-49b0-8a03-088390b1b597 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:32 devstack sudo[105866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f18d494f-ed83-49b0-8a03-088390b1b597 1073741824 Aug 05 10:31:32 devstack sudo[105866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:32 devstack sudo[105866]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:32 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1e35a5ed-55a8-41f0-bdb1-1e6e4a7636a9 tempest-VolumeImageDependencyTests-1989630145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f18d494f-ed83-49b0-8a03-088390b1b597 1073741824" returned: 0 in 0.446s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:32 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1e35a5ed-55a8-41f0-bdb1-1e6e4a7636a9 tempest-VolumeImageDependencyTests-1989630145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f18d494f-ed83-49b0-8a03-088390b1b597 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:32 devstack sudo[105872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f18d494f-ed83-49b0-8a03-088390b1b597 Aug 05 10:31:32 devstack sudo[105872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:33 devstack sudo[105872]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:33 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1e35a5ed-55a8-41f0-bdb1-1e6e4a7636a9 tempest-VolumeImageDependencyTests-1989630145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f18d494f-ed83-49b0-8a03-088390b1b597" returned: 0 in 0.250s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:33 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-1e35a5ed-55a8-41f0-bdb1-1e6e4a7636a9 tempest-VolumeImageDependencyTests-1989630145 None] <== create_volume: return (736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:31:33 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-1e35a5ed-55a8-41f0-bdb1-1e6e4a7636a9 tempest-VolumeImageDependencyTests-1989630145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:31:33 devstack cinder-volume[88613]: DEBUG cinder.volume.volume_utils [None req-1e35a5ed-55a8-41f0-bdb1-1e6e4a7636a9 tempest-VolumeImageDependencyTests-1989630145 None] Attempting download of d464fd4e-368c-48d6-941a-cf4e7c625dec ((None, [{'url': 'file:///opt/stack/data/glance/images/d464fd4e-368c-48d6-941a-cf4e7c625dec', 'metadata': {}}])) to volume f18d494f-ed83-49b0-8a03-088390b1b597. {{(pid=88613) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 05 10:31:33 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[157f85a7-4be9-4c08-b7c0-6554eb88aca1]: (4, 'raw') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:31:33 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1e35a5ed-55a8-41f0-bdb1-1e6e4a7636a9 tempest-VolumeImageDependencyTests-1989630145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d464fd4e-368c-48d6-941a-cf4e7c625dec_fmftcuyf {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:33 devstack sudo[105875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d464fd4e-368c-48d6-941a-cf4e7c625dec_fmftcuyf Aug 05 10:31:33 devstack sudo[105875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:33 devstack sudo[105875]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:33 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1e35a5ed-55a8-41f0-bdb1-1e6e4a7636a9 tempest-VolumeImageDependencyTests-1989630145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d464fd4e-368c-48d6-941a-cf4e7c625dec_fmftcuyf" returned: 0 in 0.314s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:33 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1e35a5ed-55a8-41f0-bdb1-1e6e4a7636a9 tempest-VolumeImageDependencyTests-1989630145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d464fd4e-368c-48d6-941a-cf4e7c625dec_fmftcuyf {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:33 devstack sudo[105879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d464fd4e-368c-48d6-941a-cf4e7c625dec_fmftcuyf Aug 05 10:31:33 devstack sudo[105879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:33 devstack sudo[105879]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:33 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1e35a5ed-55a8-41f0-bdb1-1e6e4a7636a9 tempest-VolumeImageDependencyTests-1989630145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d464fd4e-368c-48d6-941a-cf4e7c625dec_fmftcuyf" returned: 1 in 0.317s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:33 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1e35a5ed-55a8-41f0-bdb1-1e6e4a7636a9 tempest-VolumeImageDependencyTests-1989630145 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d464fd4e-368c-48d6-941a-cf4e7c625dec_fmftcuyf' failed. Not Retrying. {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 10:31:33 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[615b80a5-498d-4105-b503-3bd4108abe26]: (4, 'raw') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:31:33 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1e35a5ed-55a8-41f0-bdb1-1e6e4a7636a9 tempest-VolumeImageDependencyTests-1989630145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d464fd4e-368c-48d6-941a-cf4e7c625dec_y_ysimqpdevstack@QuobyteHD {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:33 devstack sudo[105883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d464fd4e-368c-48d6-941a-cf4e7c625dec_y_ysimqpdevstack@QuobyteHD Aug 05 10:31:33 devstack sudo[105883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:34 devstack sudo[105883]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:34 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1e35a5ed-55a8-41f0-bdb1-1e6e4a7636a9 tempest-VolumeImageDependencyTests-1989630145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d464fd4e-368c-48d6-941a-cf4e7c625dec_y_ysimqpdevstack@QuobyteHD" returned: 0 in 0.308s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:34 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1e35a5ed-55a8-41f0-bdb1-1e6e4a7636a9 tempest-VolumeImageDependencyTests-1989630145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d464fd4e-368c-48d6-941a-cf4e7c625dec_y_ysimqpdevstack@QuobyteHD {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:34 devstack sudo[105887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d464fd4e-368c-48d6-941a-cf4e7c625dec_y_ysimqpdevstack@QuobyteHD Aug 05 10:31:34 devstack sudo[105887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:34 devstack sudo[105887]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:34 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1e35a5ed-55a8-41f0-bdb1-1e6e4a7636a9 tempest-VolumeImageDependencyTests-1989630145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d464fd4e-368c-48d6-941a-cf4e7c625dec_y_ysimqpdevstack@QuobyteHD" returned: 1 in 0.310s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:34 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1e35a5ed-55a8-41f0-bdb1-1e6e4a7636a9 tempest-VolumeImageDependencyTests-1989630145 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d464fd4e-368c-48d6-941a-cf4e7c625dec_y_ysimqpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 10:31:34 devstack cinder-volume[88613]: DEBUG cinder.image.image_utils [None req-1e35a5ed-55a8-41f0-bdb1-1e6e4a7636a9 tempest-VolumeImageDependencyTests-1989630145 None] d464fd4e-368c-48d6-941a-cf4e7c625dec was raw, converting to qcow2 {{(pid=88613) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 05 10:31:34 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1e35a5ed-55a8-41f0-bdb1-1e6e4a7636a9 tempest-VolumeImageDependencyTests-1989630145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d464fd4e-368c-48d6-941a-cf4e7c625dec_y_ysimqpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f18d494f-ed83-49b0-8a03-088390b1b597 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:34 devstack sudo[105892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d464fd4e-368c-48d6-941a-cf4e7c625dec_y_ysimqpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f18d494f-ed83-49b0-8a03-088390b1b597 Aug 05 10:31:34 devstack sudo[105892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:34 devstack sudo[105892]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:34 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1e35a5ed-55a8-41f0-bdb1-1e6e4a7636a9 tempest-VolumeImageDependencyTests-1989630145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d464fd4e-368c-48d6-941a-cf4e7c625dec_y_ysimqpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f18d494f-ed83-49b0-8a03-088390b1b597" returned: 0 in 0.426s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:34 devstack cinder-volume[88613]: DEBUG cinder.image.image_utils [None req-1e35a5ed-55a8-41f0-bdb1-1e6e4a7636a9 tempest-VolumeImageDependencyTests-1989630145 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d464fd4e-368c-48d6-941a-cf4e7c625dec_y_ysimqpdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f18d494f-ed83-49b0-8a03-088390b1b597 {{(pid=88613) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 10:31:34 devstack cinder-volume[88613]: INFO cinder.image.image_utils [None req-1e35a5ed-55a8-41f0-bdb1-1e6e4a7636a9 tempest-VolumeImageDependencyTests-1989630145 None] Converted 0.00 MB image at 0.00 MB/s Aug 05 10:31:34 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1e35a5ed-55a8-41f0-bdb1-1e6e4a7636a9 tempest-VolumeImageDependencyTests-1989630145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f18d494f-ed83-49b0-8a03-088390b1b597 1G {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:34 devstack sudo[105898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f18d494f-ed83-49b0-8a03-088390b1b597 1G Aug 05 10:31:34 devstack sudo[105898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:35 devstack sudo[105898]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:35 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1e35a5ed-55a8-41f0-bdb1-1e6e4a7636a9 tempest-VolumeImageDependencyTests-1989630145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f18d494f-ed83-49b0-8a03-088390b1b597 1G" returned: 0 in 0.296s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:35 devstack cinder-volume[88613]: DEBUG cinder.volume.volume_utils [None req-1e35a5ed-55a8-41f0-bdb1-1e6e4a7636a9 tempest-VolumeImageDependencyTests-1989630145 None] Downloaded image d464fd4e-368c-48d6-941a-cf4e7c625dec ((None, [{'url': 'file:///opt/stack/data/glance/images/d464fd4e-368c-48d6-941a-cf4e7c625dec', 'metadata': {}}])) to volume f18d494f-ed83-49b0-8a03-088390b1b597 successfully. {{(pid=88613) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 05 10:31:35 devstack cinder-volume[88613]: DEBUG cinder.image.image_utils [None req-1e35a5ed-55a8-41f0-bdb1-1e6e4a7636a9 tempest-VolumeImageDependencyTests-1989630145 None] Temporary image d464fd4e-368c-48d6-941a-cf4e7c625dec for user 403497f7c2934489968b1d67a1937e50 is deleted. {{(pid=88613) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 05 10:31:35 devstack cinder-volume[88613]: DEBUG cinder.volume.volume_utils [None req-1e35a5ed-55a8-41f0-bdb1-1e6e4a7636a9 tempest-VolumeImageDependencyTests-1989630145 None] Marking volume f18d494f-ed83-49b0-8a03-088390b1b597 as bootable. {{(pid=88613) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 05 10:31:35 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e35a5ed-55a8-41f0-bdb1-1e6e4a7636a9 tempest-VolumeImageDependencyTests-1989630145 None] Copying metadata from image d464fd4e-368c-48d6-941a-cf4e7c625dec to f18d494f-ed83-49b0-8a03-088390b1b597. {{(pid=88613) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 05 10:31:35 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e35a5ed-55a8-41f0-bdb1-1e6e4a7636a9 tempest-VolumeImageDependencyTests-1989630145 None] Creating volume glance metadata for volume f18d494f-ed83-49b0-8a03-088390b1b597 backed by image d464fd4e-368c-48d6-941a-cf4e7c625dec with: {'image_id': 'd464fd4e-368c-48d6-941a-cf4e7c625dec', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '597df38c719d584e3479d7799e504e37', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88613) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 05 10:31:35 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1e35a5ed-55a8-41f0-bdb1-1e6e4a7636a9 tempest-VolumeImageDependencyTests-1989630145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e969f1c-d07c-4da7-b00b-eba19ba1af4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f18d494f-ed83-49b0-8a03-088390b1b597', 'volume_size': 1, 'image_id': 'd464fd4e-368c-48d6-941a-cf4e7c625dec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d464fd4e-368c-48d6-941a-cf4e7c625dec', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '597df38c719d584e3479d7799e504e37', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7ababa473b2949cf83071aced36dd7c0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7efc63b1c9c942a082223d735b27a7fe56806a19a2bf011445e9e7baab6702a473b11358424d98d3bfd5309fcc11a009a147dff1231e2e54d7163d7f162d32c3', 'id': 'd464fd4e-368c-48d6-941a-cf4e7c625dec', 'created_at': datetime.datetime(2026, 8, 5, 8, 31, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 8, 31, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d464fd4e-368c-48d6-941a-cf4e7c625dec/file', 'properties': {}}, 'image_service': }' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:31:35 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1e35a5ed-55a8-41f0-bdb1-1e6e4a7636a9 tempest-VolumeImageDependencyTests-1989630145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8341ca12-d369-426d-aa97-4fb529cf4f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:31:35 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-1e35a5ed-55a8-41f0-bdb1-1e6e4a7636a9 tempest-VolumeImageDependencyTests-1989630145 None] Volume volume-f18d494f-ed83-49b0-8a03-088390b1b597 (f18d494f-ed83-49b0-8a03-088390b1b597): created successfully Aug 05 10:31:35 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1e35a5ed-55a8-41f0-bdb1-1e6e4a7636a9 tempest-VolumeImageDependencyTests-1989630145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8341ca12-d369-426d-aa97-4fb529cf4f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:31:35 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-1e35a5ed-55a8-41f0-bdb1-1e6e4a7636a9 tempest-VolumeImageDependencyTests-1989630145 None] Flow 'volume_create_manager' (c22da288-a8db-4971-92ae-700ec352f734) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:31:35 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-1e35a5ed-55a8-41f0-bdb1-1e6e4a7636a9 tempest-VolumeImageDependencyTests-1989630145 None] Created volume successfully. Aug 05 10:31:35 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-019e8328-ca62-4933-a89b-4fd249213a53 tempest-VolumeImageDependencyTests-1989630145 None] Acquiring lock "cinder-f18d494f-ed83-49b0-8a03-088390b1b597-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:31:35 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-019e8328-ca62-4933-a89b-4fd249213a53 tempest-VolumeImageDependencyTests-1989630145 None] Lock "cinder-f18d494f-ed83-49b0-8a03-088390b1b597-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:31:35 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-019e8328-ca62-4933-a89b-4fd249213a53 tempest-VolumeImageDependencyTests-1989630145 None] Acquiring lock "cinder-quobyte-f18d494f-ed83-49b0-8a03-088390b1b597" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:31:35 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-019e8328-ca62-4933-a89b-4fd249213a53 tempest-VolumeImageDependencyTests-1989630145 None] Lock "cinder-quobyte-f18d494f-ed83-49b0-8a03-088390b1b597" acquired by "delete_volume" :: waited 0.013s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:31:35 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08e3822-6ef8-47e6-a0a7-4a1563648203]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:31:35 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-019e8328-ca62-4933-a89b-4fd249213a53 tempest-VolumeImageDependencyTests-1989630145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f18d494f-ed83-49b0-8a03-088390b1b597 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:36 devstack sudo[105903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f18d494f-ed83-49b0-8a03-088390b1b597 Aug 05 10:31:36 devstack sudo[105903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:36 devstack sudo[105903]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:36 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-019e8328-ca62-4933-a89b-4fd249213a53 tempest-VolumeImageDependencyTests-1989630145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f18d494f-ed83-49b0-8a03-088390b1b597" returned: 0 in 0.341s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:36 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-019e8328-ca62-4933-a89b-4fd249213a53 tempest-VolumeImageDependencyTests-1989630145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f18d494f-ed83-49b0-8a03-088390b1b597 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:36 devstack sudo[105908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f18d494f-ed83-49b0-8a03-088390b1b597 Aug 05 10:31:36 devstack sudo[105908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:36 devstack sudo[105908]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:36 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-019e8328-ca62-4933-a89b-4fd249213a53 tempest-VolumeImageDependencyTests-1989630145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f18d494f-ed83-49b0-8a03-088390b1b597" returned: 0 in 0.244s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:36 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-019e8328-ca62-4933-a89b-4fd249213a53 tempest-VolumeImageDependencyTests-1989630145 None] Lock "cinder-quobyte-f18d494f-ed83-49b0-8a03-088390b1b597" released by "delete_volume" :: held 0.641s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:31:36 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-019e8328-ca62-4933-a89b-4fd249213a53 tempest-VolumeImageDependencyTests-1989630145 None] Created reservations ['a9328a9b-71e5-415f-8338-bf91150b2921', 'b90e4f6c-4ab4-4fdd-a813-a165e4842ef1', 'f8fcc694-cd03-4a0f-858b-d24d4558e339', '6f0a799b-fe22-4dc2-998f-8adac8c9c0fa'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:31:36 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-019e8328-ca62-4933-a89b-4fd249213a53 tempest-VolumeImageDependencyTests-1989630145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:31:36 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-019e8328-ca62-4933-a89b-4fd249213a53 tempest-VolumeImageDependencyTests-1989630145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:31:36 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-019e8328-ca62-4933-a89b-4fd249213a53 tempest-VolumeImageDependencyTests-1989630145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:31:36 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-019e8328-ca62-4933-a89b-4fd249213a53 tempest-VolumeImageDependencyTests-1989630145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:31:36 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-019e8328-ca62-4933-a89b-4fd249213a53 tempest-VolumeImageDependencyTests-1989630145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:31:36 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-019e8328-ca62-4933-a89b-4fd249213a53 tempest-VolumeImageDependencyTests-1989630145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:36 devstack sudo[105913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:31:36 devstack sudo[105913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:36 devstack sudo[105913]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:36 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-019e8328-ca62-4933-a89b-4fd249213a53 tempest-VolumeImageDependencyTests-1989630145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.248s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:36 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-019e8328-ca62-4933-a89b-4fd249213a53 tempest-VolumeImageDependencyTests-1989630145 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:31:36 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-019e8328-ca62-4933-a89b-4fd249213a53 tempest-VolumeImageDependencyTests-1989630145 None] Deleted volume successfully. Aug 05 10:31:37 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-019e8328-ca62-4933-a89b-4fd249213a53 tempest-VolumeImageDependencyTests-1989630145 None] Lock "cinder-f18d494f-ed83-49b0-8a03-088390b1b597-delete_volume" released by "delete_volume" :: held 1.115s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:31:46 devstack cinder-volume[88613]: DEBUG dbcounter [-] [88613] Writing DB stats cinder:SELECT=100,cinder:UPDATE=116,cinder:DELETE=11,cinder:INSERT=27 {{(pid=88613) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:31:47 devstack cinder-volume[88613]: DEBUG dbcounter [-] [88613] Writing DB stats cinder:SELECT=76,cinder:UPDATE=113,cinder:INSERT=37,cinder:DELETE=9 {{(pid=88613) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:32:04 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-67f097e3-7444-4716-abcc-73ca2b3b10ad tempest-SnapshotDependencyTests-968676550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:32:04 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-67f097e3-7444-4716-abcc-73ca2b3b10ad tempest-SnapshotDependencyTests-968676550 None] Flow 'volume_create_manager' (ef2f4d17-97ea-4e7f-9f8a-9a6a942a7a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:32:04 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-67f097e3-7444-4716-abcc-73ca2b3b10ad tempest-SnapshotDependencyTests-968676550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bab8128-f6f8-4bbb-9ca7-75c307ca1cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:04 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-67f097e3-7444-4716-abcc-73ca2b3b10ad tempest-SnapshotDependencyTests-968676550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bab8128-f6f8-4bbb-9ca7-75c307ca1cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:32:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1019470863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d587b479-8064-44cd-8e71-97035738b2b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd1e4702c8114326b2decf0b24e3a59a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:32:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:32:04Z,use_quota=True,user_id='3e6409dc220e4d90afb2706d3634b0cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:04 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-67f097e3-7444-4716-abcc-73ca2b3b10ad tempest-SnapshotDependencyTests-968676550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3feacf40-16e6-4ffc-93a6-f586d7f50298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:04 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-67f097e3-7444-4716-abcc-73ca2b3b10ad tempest-SnapshotDependencyTests-968676550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3feacf40-16e6-4ffc-93a6-f586d7f50298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:04 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-67f097e3-7444-4716-abcc-73ca2b3b10ad tempest-SnapshotDependencyTests-968676550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9f1db2a-1b20-44e8-b786-4e7c819ecafb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:04 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-67f097e3-7444-4716-abcc-73ca2b3b10ad tempest-SnapshotDependencyTests-968676550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9f1db2a-1b20-44e8-b786-4e7c819ecafb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd587b479-8064-44cd-8e71-97035738b2b3', 'volume_name': 'volume-d587b479-8064-44cd-8e71-97035738b2b3', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:04 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-67f097e3-7444-4716-abcc-73ca2b3b10ad tempest-SnapshotDependencyTests-968676550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf82c539-ddbb-4787-b955-390c701b6d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:04 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-67f097e3-7444-4716-abcc-73ca2b3b10ad tempest-SnapshotDependencyTests-968676550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf82c539-ddbb-4787-b955-390c701b6d4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:04 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-67f097e3-7444-4716-abcc-73ca2b3b10ad tempest-SnapshotDependencyTests-968676550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25ab628d-b0da-4ec1-bcf1-7d0d52d6ff1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:04 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-67f097e3-7444-4716-abcc-73ca2b3b10ad tempest-SnapshotDependencyTests-968676550 None] Volume d587b479-8064-44cd-8e71-97035738b2b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d587b479-8064-44cd-8e71-97035738b2b3', 'volume_size': 1} Aug 05 10:32:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-67f097e3-7444-4716-abcc-73ca2b3b10ad tempest-SnapshotDependencyTests-968676550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:32:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-67f097e3-7444-4716-abcc-73ca2b3b10ad tempest-SnapshotDependencyTests-968676550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:32:04 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-67f097e3-7444-4716-abcc-73ca2b3b10ad tempest-SnapshotDependencyTests-968676550 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:32:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1019470863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d587b479-8064-44cd-8e71-97035738b2b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd1e4702c8114326b2decf0b24e3a59a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:32:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:32:04Z,use_quota=True,user_id='3e6409dc220e4d90afb2706d3634b0cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:32:04 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-67f097e3-7444-4716-abcc-73ca2b3b10ad tempest-SnapshotDependencyTests-968676550 None] Creating volume d587b479-8064-44cd-8e71-97035738b2b3 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:32:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-67f097e3-7444-4716-abcc-73ca2b3b10ad tempest-SnapshotDependencyTests-968676550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:32:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-67f097e3-7444-4716-abcc-73ca2b3b10ad tempest-SnapshotDependencyTests-968676550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:32:04 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-67f097e3-7444-4716-abcc-73ca2b3b10ad tempest-SnapshotDependencyTests-968676550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:32:04 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-67f097e3-7444-4716-abcc-73ca2b3b10ad tempest-SnapshotDependencyTests-968676550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:32:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-67f097e3-7444-4716-abcc-73ca2b3b10ad tempest-SnapshotDependencyTests-968676550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:32:04 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-67f097e3-7444-4716-abcc-73ca2b3b10ad tempest-SnapshotDependencyTests-968676550 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:32:04 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-67f097e3-7444-4716-abcc-73ca2b3b10ad tempest-SnapshotDependencyTests-968676550 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:32:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-67f097e3-7444-4716-abcc-73ca2b3b10ad tempest-SnapshotDependencyTests-968676550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d587b479-8064-44cd-8e71-97035738b2b3 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:04 devstack sudo[105958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d587b479-8064-44cd-8e71-97035738b2b3 1073741824 Aug 05 10:32:04 devstack sudo[105958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:04 devstack sudo[105958]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-67f097e3-7444-4716-abcc-73ca2b3b10ad tempest-SnapshotDependencyTests-968676550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d587b479-8064-44cd-8e71-97035738b2b3 1073741824" returned: 0 in 0.389s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-67f097e3-7444-4716-abcc-73ca2b3b10ad tempest-SnapshotDependencyTests-968676550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d587b479-8064-44cd-8e71-97035738b2b3 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:04 devstack sudo[105964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d587b479-8064-44cd-8e71-97035738b2b3 Aug 05 10:32:04 devstack sudo[105964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:04 devstack sudo[105964]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-67f097e3-7444-4716-abcc-73ca2b3b10ad tempest-SnapshotDependencyTests-968676550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d587b479-8064-44cd-8e71-97035738b2b3" returned: 0 in 0.240s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:04 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-67f097e3-7444-4716-abcc-73ca2b3b10ad tempest-SnapshotDependencyTests-968676550 None] <== create_volume: return (667ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:32:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-67f097e3-7444-4716-abcc-73ca2b3b10ad tempest-SnapshotDependencyTests-968676550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.670s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:32:04 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-67f097e3-7444-4716-abcc-73ca2b3b10ad tempest-SnapshotDependencyTests-968676550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25ab628d-b0da-4ec1-bcf1-7d0d52d6ff1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d587b479-8064-44cd-8e71-97035738b2b3', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:04 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-67f097e3-7444-4716-abcc-73ca2b3b10ad tempest-SnapshotDependencyTests-968676550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5624e53f-c2bc-4cdb-92a7-745f895bdb51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:04 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-67f097e3-7444-4716-abcc-73ca2b3b10ad tempest-SnapshotDependencyTests-968676550 None] Volume volume-d587b479-8064-44cd-8e71-97035738b2b3 (d587b479-8064-44cd-8e71-97035738b2b3): created successfully Aug 05 10:32:04 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-67f097e3-7444-4716-abcc-73ca2b3b10ad tempest-SnapshotDependencyTests-968676550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5624e53f-c2bc-4cdb-92a7-745f895bdb51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:04 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-67f097e3-7444-4716-abcc-73ca2b3b10ad tempest-SnapshotDependencyTests-968676550 None] Flow 'volume_create_manager' (ef2f4d17-97ea-4e7f-9f8a-9a6a942a7a2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:32:04 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-67f097e3-7444-4716-abcc-73ca2b3b10ad tempest-SnapshotDependencyTests-968676550 None] Created volume successfully. Aug 05 10:32:05 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-e4b36a2a-59d8-4b03-8b64-ef91cf054a71 tempest-SnapshotDependencyTests-968676550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:32:05 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-e4b36a2a-59d8-4b03-8b64-ef91cf054a71 tempest-SnapshotDependencyTests-968676550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:32:05 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-e4b36a2a-59d8-4b03-8b64-ef91cf054a71 tempest-SnapshotDependencyTests-968676550 None] Creating offline snapshot 2cffc165-fe77-4c6f-819c-cab954ecc504 of volume d587b479-8064-44cd-8e71-97035738b2b3 {{(pid=88613) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:32:05 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d0142e-e6f6-401b-b183-afedfcf513aa]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:32:05 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e4b36a2a-59d8-4b03-8b64-ef91cf054a71 tempest-SnapshotDependencyTests-968676550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d587b479-8064-44cd-8e71-97035738b2b3 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:05 devstack sudo[105968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d587b479-8064-44cd-8e71-97035738b2b3 Aug 05 10:32:05 devstack sudo[105968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:05 devstack sudo[105968]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:05 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e4b36a2a-59d8-4b03-8b64-ef91cf054a71 tempest-SnapshotDependencyTests-968676550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d587b479-8064-44cd-8e71-97035738b2b3" returned: 0 in 0.342s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:05 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e4b36a2a-59d8-4b03-8b64-ef91cf054a71 tempest-SnapshotDependencyTests-968676550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d587b479-8064-44cd-8e71-97035738b2b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d587b479-8064-44cd-8e71-97035738b2b3.2cffc165-fe77-4c6f-819c-cab954ecc504 1G {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:05 devstack sudo[105973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d587b479-8064-44cd-8e71-97035738b2b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d587b479-8064-44cd-8e71-97035738b2b3.2cffc165-fe77-4c6f-819c-cab954ecc504 1G Aug 05 10:32:05 devstack sudo[105973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:06 devstack sudo[105973]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e4b36a2a-59d8-4b03-8b64-ef91cf054a71 tempest-SnapshotDependencyTests-968676550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d587b479-8064-44cd-8e71-97035738b2b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d587b479-8064-44cd-8e71-97035738b2b3.2cffc165-fe77-4c6f-819c-cab954ecc504 1G" returned: 0 in 0.381s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e4b36a2a-59d8-4b03-8b64-ef91cf054a71 tempest-SnapshotDependencyTests-968676550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d587b479-8064-44cd-8e71-97035738b2b3 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d587b479-8064-44cd-8e71-97035738b2b3.2cffc165-fe77-4c6f-819c-cab954ecc504 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:06 devstack sudo[105978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d587b479-8064-44cd-8e71-97035738b2b3 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d587b479-8064-44cd-8e71-97035738b2b3.2cffc165-fe77-4c6f-819c-cab954ecc504 Aug 05 10:32:06 devstack sudo[105978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:06 devstack sudo[105978]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e4b36a2a-59d8-4b03-8b64-ef91cf054a71 tempest-SnapshotDependencyTests-968676550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d587b479-8064-44cd-8e71-97035738b2b3 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d587b479-8064-44cd-8e71-97035738b2b3.2cffc165-fe77-4c6f-819c-cab954ecc504" returned: 0 in 0.291s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:06 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-e4b36a2a-59d8-4b03-8b64-ef91cf054a71 tempest-SnapshotDependencyTests-968676550 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d587b479-8064-44cd-8e71-97035738b2b3.2cffc165-fe77-4c6f-819c-cab954ecc504 is being set with open permissions: ugo+rw Aug 05 10:32:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e4b36a2a-59d8-4b03-8b64-ef91cf054a71 tempest-SnapshotDependencyTests-968676550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d587b479-8064-44cd-8e71-97035738b2b3.2cffc165-fe77-4c6f-819c-cab954ecc504 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:06 devstack sudo[105984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d587b479-8064-44cd-8e71-97035738b2b3.2cffc165-fe77-4c6f-819c-cab954ecc504 Aug 05 10:32:06 devstack sudo[105984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:06 devstack sudo[105984]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e4b36a2a-59d8-4b03-8b64-ef91cf054a71 tempest-SnapshotDependencyTests-968676550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d587b479-8064-44cd-8e71-97035738b2b3.2cffc165-fe77-4c6f-819c-cab954ecc504" returned: 0 in 0.231s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e4b36a2a-59d8-4b03-8b64-ef91cf054a71 tempest-SnapshotDependencyTests-968676550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d587b479-8064-44cd-8e71-97035738b2b3.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:06 devstack sudo[105987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d587b479-8064-44cd-8e71-97035738b2b3.info Aug 05 10:32:06 devstack sudo[105987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:06 devstack sudo[105987]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e4b36a2a-59d8-4b03-8b64-ef91cf054a71 tempest-SnapshotDependencyTests-968676550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d587b479-8064-44cd-8e71-97035738b2b3.info" returned: 0 in 0.254s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:06 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-e4b36a2a-59d8-4b03-8b64-ef91cf054a71 tempest-SnapshotDependencyTests-968676550 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d587b479-8064-44cd-8e71-97035738b2b3.info is being set with open permissions: ugo+rw Aug 05 10:32:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e4b36a2a-59d8-4b03-8b64-ef91cf054a71 tempest-SnapshotDependencyTests-968676550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d587b479-8064-44cd-8e71-97035738b2b3.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:06 devstack sudo[105990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d587b479-8064-44cd-8e71-97035738b2b3.info Aug 05 10:32:06 devstack sudo[105990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:07 devstack sudo[105990]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e4b36a2a-59d8-4b03-8b64-ef91cf054a71 tempest-SnapshotDependencyTests-968676550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d587b479-8064-44cd-8e71-97035738b2b3.info" returned: 0 in 0.231s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-e4b36a2a-59d8-4b03-8b64-ef91cf054a71 tempest-SnapshotDependencyTests-968676550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.809s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:32:07 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-e4b36a2a-59d8-4b03-8b64-ef91cf054a71 tempest-SnapshotDependencyTests-968676550 None] Create snapshot completed successfully Aug 05 10:32:07 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-df8ffd40-e0a7-4754-b182-cf687e989145 tempest-SnapshotDependencyTests-968676550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:32:07 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-df8ffd40-e0a7-4754-b182-cf687e989145 tempest-SnapshotDependencyTests-968676550 None] Flow 'volume_create_manager' (ecdd97f5-19f6-44df-8165-1e3082e25a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:32:07 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-df8ffd40-e0a7-4754-b182-cf687e989145 tempest-SnapshotDependencyTests-968676550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46e7fc97-6ccc-4171-a5e1-152d0144185b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:07 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-df8ffd40-e0a7-4754-b182-cf687e989145 tempest-SnapshotDependencyTests-968676550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46e7fc97-6ccc-4171-a5e1-152d0144185b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:32:08Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0341d8b2-605e-4776-a18c-03ae8b955208,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd1e4702c8114326b2decf0b24e3a59a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:32:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2cffc165-fe77-4c6f-819c-cab954ecc504,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:32:08Z,use_quota=True,user_id='3e6409dc220e4d90afb2706d3634b0cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:07 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-df8ffd40-e0a7-4754-b182-cf687e989145 tempest-SnapshotDependencyTests-968676550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c83856b-fc18-46f6-9e5e-4718af600a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:07 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-df8ffd40-e0a7-4754-b182-cf687e989145 tempest-SnapshotDependencyTests-968676550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c83856b-fc18-46f6-9e5e-4718af600a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:08 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-df8ffd40-e0a7-4754-b182-cf687e989145 tempest-SnapshotDependencyTests-968676550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb454d5e-edd0-4f55-b1ad-11d5faf9e33e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:08 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-df8ffd40-e0a7-4754-b182-cf687e989145 tempest-SnapshotDependencyTests-968676550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb454d5e-edd0-4f55-b1ad-11d5faf9e33e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0341d8b2-605e-4776-a18c-03ae8b955208', 'volume_name': 'volume-0341d8b2-605e-4776-a18c-03ae8b955208', 'volume_size': 1, 'snapshot_id': '2cffc165-fe77-4c6f-819c-cab954ecc504'}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:08 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-df8ffd40-e0a7-4754-b182-cf687e989145 tempest-SnapshotDependencyTests-968676550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76dbccc9-8fc0-4855-a698-4c885183165e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:08 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-df8ffd40-e0a7-4754-b182-cf687e989145 tempest-SnapshotDependencyTests-968676550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76dbccc9-8fc0-4855-a698-4c885183165e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:08 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-df8ffd40-e0a7-4754-b182-cf687e989145 tempest-SnapshotDependencyTests-968676550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eebd7e47-890b-4553-91a4-4e227ea6b500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:08 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-df8ffd40-e0a7-4754-b182-cf687e989145 tempest-SnapshotDependencyTests-968676550 None] Volume 0341d8b2-605e-4776-a18c-03ae8b955208: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0341d8b2-605e-4776-a18c-03ae8b955208', 'volume_size': 1, 'snapshot_id': '2cffc165-fe77-4c6f-819c-cab954ecc504'} Aug 05 10:32:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-df8ffd40-e0a7-4754-b182-cf687e989145 tempest-SnapshotDependencyTests-968676550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:32:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-df8ffd40-e0a7-4754-b182-cf687e989145 tempest-SnapshotDependencyTests-968676550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:32:08 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-df8ffd40-e0a7-4754-b182-cf687e989145 tempest-SnapshotDependencyTests-968676550 None] Acquiring lock "cinder-quobyte-2cffc165-fe77-4c6f-819c-cab954ecc504-0341d8b2-605e-4776-a18c-03ae8b955208" by "_create_volume_from_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:32:08 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-df8ffd40-e0a7-4754-b182-cf687e989145 tempest-SnapshotDependencyTests-968676550 None] Lock "cinder-quobyte-2cffc165-fe77-4c6f-819c-cab954ecc504-0341d8b2-605e-4776-a18c-03ae8b955208" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:32:08 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-df8ffd40-e0a7-4754-b182-cf687e989145 tempest-SnapshotDependencyTests-968676550 None] Creating volume 0341d8b2-605e-4776-a18c-03ae8b955208 from snapshot 2cffc165-fe77-4c6f-819c-cab954ecc504 {{(pid=88613) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 05 10:32:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-df8ffd40-e0a7-4754-b182-cf687e989145 tempest-SnapshotDependencyTests-968676550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:32:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-df8ffd40-e0a7-4754-b182-cf687e989145 tempest-SnapshotDependencyTests-968676550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:32:08 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-df8ffd40-e0a7-4754-b182-cf687e989145 tempest-SnapshotDependencyTests-968676550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:32:08 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-df8ffd40-e0a7-4754-b182-cf687e989145 tempest-SnapshotDependencyTests-968676550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:32:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-df8ffd40-e0a7-4754-b182-cf687e989145 tempest-SnapshotDependencyTests-968676550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:32:08 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-df8ffd40-e0a7-4754-b182-cf687e989145 tempest-SnapshotDependencyTests-968676550 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:32:08 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-df8ffd40-e0a7-4754-b182-cf687e989145 tempest-SnapshotDependencyTests-968676550 None] Acquiring lock "cinder-quobyte-0341d8b2-605e-4776-a18c-03ae8b955208" by "_copy_volume_from_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:32:08 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-df8ffd40-e0a7-4754-b182-cf687e989145 tempest-SnapshotDependencyTests-968676550 None] Lock "cinder-quobyte-0341d8b2-605e-4776-a18c-03ae8b955208" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:32:08 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-df8ffd40-e0a7-4754-b182-cf687e989145 tempest-SnapshotDependencyTests-968676550 None] snapshot: 2cffc165-fe77-4c6f-819c-cab954ecc504, volume: 0341d8b2-605e-4776-a18c-03ae8b955208, {{(pid=88613) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 05 10:32:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-df8ffd40-e0a7-4754-b182-cf687e989145 tempest-SnapshotDependencyTests-968676550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:32:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-df8ffd40-e0a7-4754-b182-cf687e989145 tempest-SnapshotDependencyTests-968676550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:32:08 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-df8ffd40-e0a7-4754-b182-cf687e989145 tempest-SnapshotDependencyTests-968676550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:32:08 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-df8ffd40-e0a7-4754-b182-cf687e989145 tempest-SnapshotDependencyTests-968676550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:32:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-df8ffd40-e0a7-4754-b182-cf687e989145 tempest-SnapshotDependencyTests-968676550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:32:08 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d9c14d-9460-42f1-82c0-858a7a893896]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:32:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-df8ffd40-e0a7-4754-b182-cf687e989145 tempest-SnapshotDependencyTests-968676550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d587b479-8064-44cd-8e71-97035738b2b3.2cffc165-fe77-4c6f-819c-cab954ecc504 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:08 devstack sudo[105993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d587b479-8064-44cd-8e71-97035738b2b3.2cffc165-fe77-4c6f-819c-cab954ecc504 Aug 05 10:32:08 devstack sudo[105993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:08 devstack sudo[105993]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-df8ffd40-e0a7-4754-b182-cf687e989145 tempest-SnapshotDependencyTests-968676550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d587b479-8064-44cd-8e71-97035738b2b3.2cffc165-fe77-4c6f-819c-cab954ecc504" returned: 0 in 0.353s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:08 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-df8ffd40-e0a7-4754-b182-cf687e989145 tempest-SnapshotDependencyTests-968676550 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d587b479-8064-44cd-8e71-97035738b2b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88613) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:32:08 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[da7d7de8-4597-481b-a461-59fe8fbebf1f]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:32:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-df8ffd40-e0a7-4754-b182-cf687e989145 tempest-SnapshotDependencyTests-968676550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d587b479-8064-44cd-8e71-97035738b2b3 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:08 devstack sudo[106001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d587b479-8064-44cd-8e71-97035738b2b3 Aug 05 10:32:08 devstack sudo[106001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:08 devstack sudo[106001]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-df8ffd40-e0a7-4754-b182-cf687e989145 tempest-SnapshotDependencyTests-968676550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d587b479-8064-44cd-8e71-97035738b2b3" returned: 0 in 0.355s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:08 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-df8ffd40-e0a7-4754-b182-cf687e989145 tempest-SnapshotDependencyTests-968676550 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d587b479-8064-44cd-8e71-97035738b2b3 {{(pid=88613) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 05 10:32:08 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-df8ffd40-e0a7-4754-b182-cf687e989145 tempest-SnapshotDependencyTests-968676550 None] Creating direct copy from snapshot {{(pid=88613) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 05 10:32:08 devstack cinder-volume[88613]: DEBUG cinder.utils [None req-df8ffd40-e0a7-4754-b182-cf687e989145 tempest-SnapshotDependencyTests-968676550 None] Path /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0341d8b2-605e-4776-a18c-03ae8b955208 not found in is_blk_device check {{(pid=88613) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 05 10:32:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-df8ffd40-e0a7-4754-b182-cf687e989145 tempest-SnapshotDependencyTests-968676550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d587b479-8064-44cd-8e71-97035738b2b3 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0341d8b2-605e-4776-a18c-03ae8b955208 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:08 devstack sudo[106009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d587b479-8064-44cd-8e71-97035738b2b3 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0341d8b2-605e-4776-a18c-03ae8b955208 Aug 05 10:32:08 devstack sudo[106009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:12 devstack sudo[106009]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:12 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-df8ffd40-e0a7-4754-b182-cf687e989145 tempest-SnapshotDependencyTests-968676550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d587b479-8064-44cd-8e71-97035738b2b3 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0341d8b2-605e-4776-a18c-03ae8b955208" returned: 0 in 4.115s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:12 devstack cinder-volume[88613]: DEBUG cinder.image.image_utils [None req-df8ffd40-e0a7-4754-b182-cf687e989145 tempest-SnapshotDependencyTests-968676550 None] Image conversion details: src /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d587b479-8064-44cd-8e71-97035738b2b3, size 1024.00 MB, duration 4.12 sec, destination /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0341d8b2-605e-4776-a18c-03ae8b955208 {{(pid=88613) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 10:32:12 devstack cinder-volume[88613]: INFO cinder.image.image_utils [None req-df8ffd40-e0a7-4754-b182-cf687e989145 tempest-SnapshotDependencyTests-968676550 None] Converted 1024.00 MB image at 248.77 MB/s Aug 05 10:32:12 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-df8ffd40-e0a7-4754-b182-cf687e989145 tempest-SnapshotDependencyTests-968676550 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0341d8b2-605e-4776-a18c-03ae8b955208 is being set with open permissions: ugo+rw Aug 05 10:32:12 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-df8ffd40-e0a7-4754-b182-cf687e989145 tempest-SnapshotDependencyTests-968676550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0341d8b2-605e-4776-a18c-03ae8b955208 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:12 devstack sudo[106022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0341d8b2-605e-4776-a18c-03ae8b955208 Aug 05 10:32:12 devstack sudo[106022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:13 devstack sudo[106022]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:13 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-df8ffd40-e0a7-4754-b182-cf687e989145 tempest-SnapshotDependencyTests-968676550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0341d8b2-605e-4776-a18c-03ae8b955208" returned: 0 in 0.253s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:13 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-df8ffd40-e0a7-4754-b182-cf687e989145 tempest-SnapshotDependencyTests-968676550 None] Lock "cinder-quobyte-0341d8b2-605e-4776-a18c-03ae8b955208" released by "_copy_volume_from_snapshot" :: held 5.152s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:32:13 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-df8ffd40-e0a7-4754-b182-cf687e989145 tempest-SnapshotDependencyTests-968676550 None] Lock "cinder-quobyte-2cffc165-fe77-4c6f-819c-cab954ecc504-0341d8b2-605e-4776-a18c-03ae8b955208" released by "_create_volume_from_snapshot" :: held 5.226s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:32:13 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-df8ffd40-e0a7-4754-b182-cf687e989145 tempest-SnapshotDependencyTests-968676550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.242s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:32:13 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-df8ffd40-e0a7-4754-b182-cf687e989145 tempest-SnapshotDependencyTests-968676550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eebd7e47-890b-4553-91a4-4e227ea6b500) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0341d8b2-605e-4776-a18c-03ae8b955208', 'volume_size': 1, 'snapshot_id': '2cffc165-fe77-4c6f-819c-cab954ecc504'}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:13 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-df8ffd40-e0a7-4754-b182-cf687e989145 tempest-SnapshotDependencyTests-968676550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d1fb0fc-67dc-4b41-a70f-043a76fb7eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:13 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-df8ffd40-e0a7-4754-b182-cf687e989145 tempest-SnapshotDependencyTests-968676550 None] Volume volume-0341d8b2-605e-4776-a18c-03ae8b955208 (0341d8b2-605e-4776-a18c-03ae8b955208): created successfully Aug 05 10:32:13 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-df8ffd40-e0a7-4754-b182-cf687e989145 tempest-SnapshotDependencyTests-968676550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d1fb0fc-67dc-4b41-a70f-043a76fb7eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:13 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-df8ffd40-e0a7-4754-b182-cf687e989145 tempest-SnapshotDependencyTests-968676550 None] Flow 'volume_create_manager' (ecdd97f5-19f6-44df-8165-1e3082e25a76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:32:13 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-df8ffd40-e0a7-4754-b182-cf687e989145 tempest-SnapshotDependencyTests-968676550 None] Created volume successfully. Aug 05 10:32:14 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-aa5d4fbb-db4f-4e6d-8999-e8c8886fc524 tempest-SnapshotDependencyTests-968676550 None] Acquiring lock "cinder-2cffc165-fe77-4c6f-819c-cab954ecc504-delete_snapshot" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:32:14 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-aa5d4fbb-db4f-4e6d-8999-e8c8886fc524 tempest-SnapshotDependencyTests-968676550 None] Lock "cinder-2cffc165-fe77-4c6f-819c-cab954ecc504-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:32:14 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-aa5d4fbb-db4f-4e6d-8999-e8c8886fc524 tempest-SnapshotDependencyTests-968676550 None] Acquiring lock "cinder-quobyte-d587b479-8064-44cd-8e71-97035738b2b3" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:32:14 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-aa5d4fbb-db4f-4e6d-8999-e8c8886fc524 tempest-SnapshotDependencyTests-968676550 None] Lock "cinder-quobyte-d587b479-8064-44cd-8e71-97035738b2b3" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:32:14 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-aa5d4fbb-db4f-4e6d-8999-e8c8886fc524 tempest-SnapshotDependencyTests-968676550 None] Acquiring lock "cinder-quobyte-2cffc165-fe77-4c6f-819c-cab954ecc504" by "_delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:32:14 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-aa5d4fbb-db4f-4e6d-8999-e8c8886fc524 tempest-SnapshotDependencyTests-968676550 None] Lock "cinder-quobyte-2cffc165-fe77-4c6f-819c-cab954ecc504" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:32:14 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-aa5d4fbb-db4f-4e6d-8999-e8c8886fc524 tempest-SnapshotDependencyTests-968676550 None] Deleting offline snapshot 2cffc165-fe77-4c6f-819c-cab954ecc504 of volume d587b479-8064-44cd-8e71-97035738b2b3 {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:32:14 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-aa5d4fbb-db4f-4e6d-8999-e8c8886fc524 tempest-SnapshotDependencyTests-968676550 None] snapshot_file for this snap is: volume-d587b479-8064-44cd-8e71-97035738b2b3.2cffc165-fe77-4c6f-819c-cab954ecc504 {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:32:14 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d4036e-0ac5-40e2-a287-86dd07180c7e]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:32:14 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-aa5d4fbb-db4f-4e6d-8999-e8c8886fc524 tempest-SnapshotDependencyTests-968676550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d587b479-8064-44cd-8e71-97035738b2b3.2cffc165-fe77-4c6f-819c-cab954ecc504 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:14 devstack sudo[106026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d587b479-8064-44cd-8e71-97035738b2b3.2cffc165-fe77-4c6f-819c-cab954ecc504 Aug 05 10:32:14 devstack sudo[106026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:14 devstack sudo[106026]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:14 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-aa5d4fbb-db4f-4e6d-8999-e8c8886fc524 tempest-SnapshotDependencyTests-968676550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d587b479-8064-44cd-8e71-97035738b2b3.2cffc165-fe77-4c6f-819c-cab954ecc504" returned: 0 in 0.354s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:14 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-aa5d4fbb-db4f-4e6d-8999-e8c8886fc524 tempest-SnapshotDependencyTests-968676550 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d587b479-8064-44cd-8e71-97035738b2b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88613) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:32:14 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6deffb4-140a-4cc9-ba2a-260a505a0dd1]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:32:14 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-aa5d4fbb-db4f-4e6d-8999-e8c8886fc524 tempest-SnapshotDependencyTests-968676550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d587b479-8064-44cd-8e71-97035738b2b3 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:15 devstack sudo[106032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d587b479-8064-44cd-8e71-97035738b2b3 Aug 05 10:32:15 devstack sudo[106032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:15 devstack sudo[106032]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:15 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-aa5d4fbb-db4f-4e6d-8999-e8c8886fc524 tempest-SnapshotDependencyTests-968676550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d587b479-8064-44cd-8e71-97035738b2b3" returned: 0 in 0.528s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:15 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-aa5d4fbb-db4f-4e6d-8999-e8c8886fc524 tempest-SnapshotDependencyTests-968676550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d587b479-8064-44cd-8e71-97035738b2b3.2cffc165-fe77-4c6f-819c-cab954ecc504 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:15 devstack sudo[106037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d587b479-8064-44cd-8e71-97035738b2b3.2cffc165-fe77-4c6f-819c-cab954ecc504 Aug 05 10:32:15 devstack sudo[106037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:15 devstack sudo[106037]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:15 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-aa5d4fbb-db4f-4e6d-8999-e8c8886fc524 tempest-SnapshotDependencyTests-968676550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d587b479-8064-44cd-8e71-97035738b2b3.2cffc165-fe77-4c6f-819c-cab954ecc504" returned: 0 in 0.332s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:15 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-aa5d4fbb-db4f-4e6d-8999-e8c8886fc524 tempest-SnapshotDependencyTests-968676550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d587b479-8064-44cd-8e71-97035738b2b3.2cffc165-fe77-4c6f-819c-cab954ecc504 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:15 devstack sudo[106042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d587b479-8064-44cd-8e71-97035738b2b3.2cffc165-fe77-4c6f-819c-cab954ecc504 Aug 05 10:32:15 devstack sudo[106042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:16 devstack sudo[106042]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:16 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-aa5d4fbb-db4f-4e6d-8999-e8c8886fc524 tempest-SnapshotDependencyTests-968676550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d587b479-8064-44cd-8e71-97035738b2b3.2cffc165-fe77-4c6f-819c-cab954ecc504" returned: 0 in 0.241s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:16 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-aa5d4fbb-db4f-4e6d-8999-e8c8886fc524 tempest-SnapshotDependencyTests-968676550 None] Lock "cinder-quobyte-2cffc165-fe77-4c6f-819c-cab954ecc504" released by "_delete_snapshot" :: held 1.549s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:32:16 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-aa5d4fbb-db4f-4e6d-8999-e8c8886fc524 tempest-SnapshotDependencyTests-968676550 None] Lock "cinder-quobyte-d587b479-8064-44cd-8e71-97035738b2b3" released by "delete_snapshot" :: held 1.571s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:32:16 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-aa5d4fbb-db4f-4e6d-8999-e8c8886fc524 tempest-SnapshotDependencyTests-968676550 None] Created reservations ['b732e206-aca7-429f-9eeb-ba23a52d6d62', '9f69dc30-fa73-49d9-a8dc-ae9d5a6c5678', 'a8d16f6f-2ef2-4474-be5e-0f27791393d7', '30cb33b7-d4e4-4a4e-a950-ae5703f418c5'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:32:16 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-aa5d4fbb-db4f-4e6d-8999-e8c8886fc524 tempest-SnapshotDependencyTests-968676550 None] Delete snapshot completed successfully. Aug 05 10:32:16 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-aa5d4fbb-db4f-4e6d-8999-e8c8886fc524 tempest-SnapshotDependencyTests-968676550 None] Lock "cinder-2cffc165-fe77-4c6f-819c-cab954ecc504-delete_snapshot" released by "delete_snapshot" :: held 1.709s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:32:16 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-be619651-e4ac-402b-bd85-1f5914a2b469 tempest-SnapshotDependencyTests-968676550 None] Acquiring lock "cinder-d587b479-8064-44cd-8e71-97035738b2b3-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:32:16 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-be619651-e4ac-402b-bd85-1f5914a2b469 tempest-SnapshotDependencyTests-968676550 None] Lock "cinder-d587b479-8064-44cd-8e71-97035738b2b3-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:32:16 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-be619651-e4ac-402b-bd85-1f5914a2b469 tempest-SnapshotDependencyTests-968676550 None] Acquiring lock "cinder-quobyte-d587b479-8064-44cd-8e71-97035738b2b3" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:32:16 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-be619651-e4ac-402b-bd85-1f5914a2b469 tempest-SnapshotDependencyTests-968676550 None] Lock "cinder-quobyte-d587b479-8064-44cd-8e71-97035738b2b3" acquired by "delete_volume" :: waited 0.020s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:32:16 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c5910ec-814d-4c8e-9cf3-3154eca6048e]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:32:16 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-be619651-e4ac-402b-bd85-1f5914a2b469 tempest-SnapshotDependencyTests-968676550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d587b479-8064-44cd-8e71-97035738b2b3 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:16 devstack sudo[106047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d587b479-8064-44cd-8e71-97035738b2b3 Aug 05 10:32:16 devstack sudo[106047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:17 devstack sudo[106047]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-be619651-e4ac-402b-bd85-1f5914a2b469 tempest-SnapshotDependencyTests-968676550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d587b479-8064-44cd-8e71-97035738b2b3" returned: 0 in 0.359s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-be619651-e4ac-402b-bd85-1f5914a2b469 tempest-SnapshotDependencyTests-968676550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d587b479-8064-44cd-8e71-97035738b2b3 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:17 devstack sudo[106052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d587b479-8064-44cd-8e71-97035738b2b3 Aug 05 10:32:17 devstack sudo[106052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:17 devstack sudo[106052]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-be619651-e4ac-402b-bd85-1f5914a2b469 tempest-SnapshotDependencyTests-968676550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d587b479-8064-44cd-8e71-97035738b2b3" returned: 0 in 0.240s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:17 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-be619651-e4ac-402b-bd85-1f5914a2b469 tempest-SnapshotDependencyTests-968676550 None] Lock "cinder-quobyte-d587b479-8064-44cd-8e71-97035738b2b3" released by "delete_volume" :: held 0.658s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:32:17 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-be619651-e4ac-402b-bd85-1f5914a2b469 tempest-SnapshotDependencyTests-968676550 None] Created reservations ['4e2b4d8d-b19d-4da4-a910-f81862b9015b', '70275b1b-e63f-42cd-93eb-cafa5cf643ff', '723b26f9-e085-4d64-800d-2653db23000b', '37e65ca8-b8b9-40a3-81bd-fa49533692cf'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:32:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-be619651-e4ac-402b-bd85-1f5914a2b469 tempest-SnapshotDependencyTests-968676550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:32:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-be619651-e4ac-402b-bd85-1f5914a2b469 tempest-SnapshotDependencyTests-968676550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:32:17 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-be619651-e4ac-402b-bd85-1f5914a2b469 tempest-SnapshotDependencyTests-968676550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:32:17 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-be619651-e4ac-402b-bd85-1f5914a2b469 tempest-SnapshotDependencyTests-968676550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:32:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-be619651-e4ac-402b-bd85-1f5914a2b469 tempest-SnapshotDependencyTests-968676550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:32:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-be619651-e4ac-402b-bd85-1f5914a2b469 tempest-SnapshotDependencyTests-968676550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:17 devstack sudo[106055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:32:17 devstack sudo[106055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:17 devstack sudo[106055]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-be619651-e4ac-402b-bd85-1f5914a2b469 tempest-SnapshotDependencyTests-968676550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.245s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:17 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-be619651-e4ac-402b-bd85-1f5914a2b469 tempest-SnapshotDependencyTests-968676550 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:32:17 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-be619651-e4ac-402b-bd85-1f5914a2b469 tempest-SnapshotDependencyTests-968676550 None] Deleted volume successfully. Aug 05 10:32:17 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-be619651-e4ac-402b-bd85-1f5914a2b469 tempest-SnapshotDependencyTests-968676550 None] Lock "cinder-d587b479-8064-44cd-8e71-97035738b2b3-delete_volume" released by "delete_volume" :: held 1.093s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:32:17 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-a4cde34b-4fe0-4ddb-9316-b8ed6496982e tempest-SnapshotDependencyTests-968676550 None] Acquiring lock "cinder-0341d8b2-605e-4776-a18c-03ae8b955208-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:32:17 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-a4cde34b-4fe0-4ddb-9316-b8ed6496982e tempest-SnapshotDependencyTests-968676550 None] Lock "cinder-0341d8b2-605e-4776-a18c-03ae8b955208-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:32:17 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-a4cde34b-4fe0-4ddb-9316-b8ed6496982e tempest-SnapshotDependencyTests-968676550 None] Acquiring lock "cinder-quobyte-0341d8b2-605e-4776-a18c-03ae8b955208" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:32:17 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-a4cde34b-4fe0-4ddb-9316-b8ed6496982e tempest-SnapshotDependencyTests-968676550 None] Lock "cinder-quobyte-0341d8b2-605e-4776-a18c-03ae8b955208" acquired by "delete_volume" :: waited 0.015s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:32:17 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c4f6185-5d08-4532-9172-784fb563442f]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:32:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a4cde34b-4fe0-4ddb-9316-b8ed6496982e tempest-SnapshotDependencyTests-968676550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0341d8b2-605e-4776-a18c-03ae8b955208 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:18 devstack sudo[106058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0341d8b2-605e-4776-a18c-03ae8b955208 Aug 05 10:32:18 devstack sudo[106058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:18 devstack sudo[106058]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a4cde34b-4fe0-4ddb-9316-b8ed6496982e tempest-SnapshotDependencyTests-968676550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0341d8b2-605e-4776-a18c-03ae8b955208" returned: 0 in 0.353s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a4cde34b-4fe0-4ddb-9316-b8ed6496982e tempest-SnapshotDependencyTests-968676550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0341d8b2-605e-4776-a18c-03ae8b955208 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:18 devstack sudo[106063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0341d8b2-605e-4776-a18c-03ae8b955208 Aug 05 10:32:18 devstack sudo[106063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:18 devstack sudo[106063]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a4cde34b-4fe0-4ddb-9316-b8ed6496982e tempest-SnapshotDependencyTests-968676550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0341d8b2-605e-4776-a18c-03ae8b955208" returned: 0 in 0.239s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:18 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-a4cde34b-4fe0-4ddb-9316-b8ed6496982e tempest-SnapshotDependencyTests-968676550 None] Lock "cinder-quobyte-0341d8b2-605e-4776-a18c-03ae8b955208" released by "delete_volume" :: held 0.631s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:32:18 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-a4cde34b-4fe0-4ddb-9316-b8ed6496982e tempest-SnapshotDependencyTests-968676550 None] Created reservations ['54302b99-8648-4d4e-a74d-54ede5342691', '2851ccd4-8159-4004-8da0-a24f685ac394', '31bf8637-1ee8-437e-ac32-51c9556fb5fa', '47b4f353-8618-495d-9304-03a214d816c6'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:32:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a4cde34b-4fe0-4ddb-9316-b8ed6496982e tempest-SnapshotDependencyTests-968676550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:32:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a4cde34b-4fe0-4ddb-9316-b8ed6496982e tempest-SnapshotDependencyTests-968676550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:32:18 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-a4cde34b-4fe0-4ddb-9316-b8ed6496982e tempest-SnapshotDependencyTests-968676550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:32:18 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-a4cde34b-4fe0-4ddb-9316-b8ed6496982e tempest-SnapshotDependencyTests-968676550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:32:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a4cde34b-4fe0-4ddb-9316-b8ed6496982e tempest-SnapshotDependencyTests-968676550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:32:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a4cde34b-4fe0-4ddb-9316-b8ed6496982e tempest-SnapshotDependencyTests-968676550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:18 devstack sudo[106066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:32:18 devstack sudo[106066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:18 devstack sudo[106066]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a4cde34b-4fe0-4ddb-9316-b8ed6496982e tempest-SnapshotDependencyTests-968676550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.243s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:18 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-a4cde34b-4fe0-4ddb-9316-b8ed6496982e tempest-SnapshotDependencyTests-968676550 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:32:18 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-a4cde34b-4fe0-4ddb-9316-b8ed6496982e tempest-SnapshotDependencyTests-968676550 None] Deleted volume successfully. Aug 05 10:32:18 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-a4cde34b-4fe0-4ddb-9316-b8ed6496982e tempest-SnapshotDependencyTests-968676550 None] Lock "cinder-0341d8b2-605e-4776-a18c-03ae8b955208-delete_volume" released by "delete_volume" :: held 1.065s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:32:21 devstack cinder-volume[88613]: DEBUG oslo_service.periodic_task [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88613) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:32:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:32:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:32:21 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:32:21 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:32:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:32:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:21 devstack sudo[106070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:32:21 devstack sudo[106070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:22 devstack sudo[106070]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.271s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:22 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:32:22 devstack cinder-volume[88613]: DEBUG oslo_service.periodic_task [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Running periodic task VolumeManager._thread_info {{(pid=88613) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:32:22 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] thread count: 29 {{(pid=88613) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 10:32:22 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] thread info: [<_MainThread(MainThread, started 126173666128000)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88613) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 10:32:28 devstack cinder-volume[88613]: DEBUG dbcounter [-] [88613] Writing DB stats cinder:UPDATE=29,cinder:SELECT=27,cinder:DELETE=1,cinder:INSERT=9 {{(pid=88613) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:32:37 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4eefcbc-1c1e-4685-9600-4f1de6ec3531 tempest-CreateVolumesFromSnapshotTest-428000733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:32:37 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d4eefcbc-1c1e-4685-9600-4f1de6ec3531 tempest-CreateVolumesFromSnapshotTest-428000733 None] Flow 'volume_create_manager' (25df64f5-fc75-48f8-8af5-d37d99f7137a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:32:37 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d4eefcbc-1c1e-4685-9600-4f1de6ec3531 tempest-CreateVolumesFromSnapshotTest-428000733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f47f75b-355b-45e7-867b-9a911aa0e0a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:37 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d4eefcbc-1c1e-4685-9600-4f1de6ec3531 tempest-CreateVolumesFromSnapshotTest-428000733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f47f75b-355b-45e7-867b-9a911aa0e0a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:32:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1829521481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b5984b3-aa0a-46f3-b6dd-18026e655ac9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='247e12218ea4474e9ce4fca42a428274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:32:37Z,use_quota=True,user_id='b6ba55c537f94c5db6de4e02dea1ffa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:37 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d4eefcbc-1c1e-4685-9600-4f1de6ec3531 tempest-CreateVolumesFromSnapshotTest-428000733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea3c2825-2464-47f2-811f-e31ed99be252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:37 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d4eefcbc-1c1e-4685-9600-4f1de6ec3531 tempest-CreateVolumesFromSnapshotTest-428000733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea3c2825-2464-47f2-811f-e31ed99be252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:37 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d4eefcbc-1c1e-4685-9600-4f1de6ec3531 tempest-CreateVolumesFromSnapshotTest-428000733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb927dc7-6464-4246-8e24-9ecdfa379193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:37 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d4eefcbc-1c1e-4685-9600-4f1de6ec3531 tempest-CreateVolumesFromSnapshotTest-428000733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb927dc7-6464-4246-8e24-9ecdfa379193) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b5984b3-aa0a-46f3-b6dd-18026e655ac9', 'volume_name': 'volume-0b5984b3-aa0a-46f3-b6dd-18026e655ac9', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:37 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d4eefcbc-1c1e-4685-9600-4f1de6ec3531 tempest-CreateVolumesFromSnapshotTest-428000733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7f40af0-1983-444c-a58b-62d694c44eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:37 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d4eefcbc-1c1e-4685-9600-4f1de6ec3531 tempest-CreateVolumesFromSnapshotTest-428000733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7f40af0-1983-444c-a58b-62d694c44eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:37 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d4eefcbc-1c1e-4685-9600-4f1de6ec3531 tempest-CreateVolumesFromSnapshotTest-428000733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34d0279f-a8d2-45c0-aca9-154495755cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:37 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-d4eefcbc-1c1e-4685-9600-4f1de6ec3531 tempest-CreateVolumesFromSnapshotTest-428000733 None] Volume 0b5984b3-aa0a-46f3-b6dd-18026e655ac9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b5984b3-aa0a-46f3-b6dd-18026e655ac9', 'volume_size': 1} Aug 05 10:32:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-d4eefcbc-1c1e-4685-9600-4f1de6ec3531 tempest-CreateVolumesFromSnapshotTest-428000733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:32:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-d4eefcbc-1c1e-4685-9600-4f1de6ec3531 tempest-CreateVolumesFromSnapshotTest-428000733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:32:37 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-d4eefcbc-1c1e-4685-9600-4f1de6ec3531 tempest-CreateVolumesFromSnapshotTest-428000733 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:32:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1829521481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b5984b3-aa0a-46f3-b6dd-18026e655ac9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='247e12218ea4474e9ce4fca42a428274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:32:37Z,use_quota=True,user_id='b6ba55c537f94c5db6de4e02dea1ffa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:32:37 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-d4eefcbc-1c1e-4685-9600-4f1de6ec3531 tempest-CreateVolumesFromSnapshotTest-428000733 None] Creating volume 0b5984b3-aa0a-46f3-b6dd-18026e655ac9 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:32:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-d4eefcbc-1c1e-4685-9600-4f1de6ec3531 tempest-CreateVolumesFromSnapshotTest-428000733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:32:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-d4eefcbc-1c1e-4685-9600-4f1de6ec3531 tempest-CreateVolumesFromSnapshotTest-428000733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:32:37 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-d4eefcbc-1c1e-4685-9600-4f1de6ec3531 tempest-CreateVolumesFromSnapshotTest-428000733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:32:37 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-d4eefcbc-1c1e-4685-9600-4f1de6ec3531 tempest-CreateVolumesFromSnapshotTest-428000733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:32:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-d4eefcbc-1c1e-4685-9600-4f1de6ec3531 tempest-CreateVolumesFromSnapshotTest-428000733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:32:37 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-d4eefcbc-1c1e-4685-9600-4f1de6ec3531 tempest-CreateVolumesFromSnapshotTest-428000733 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:32:37 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-d4eefcbc-1c1e-4685-9600-4f1de6ec3531 tempest-CreateVolumesFromSnapshotTest-428000733 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:32:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d4eefcbc-1c1e-4685-9600-4f1de6ec3531 tempest-CreateVolumesFromSnapshotTest-428000733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0b5984b3-aa0a-46f3-b6dd-18026e655ac9 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:37 devstack sudo[106114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0b5984b3-aa0a-46f3-b6dd-18026e655ac9 1073741824 Aug 05 10:32:37 devstack sudo[106114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:38 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-33609172-a8b1-4f70-a6d4-a1d8564525a6 tempest-CreateVolumesFromImageTest-627372874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:32:38 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-33609172-a8b1-4f70-a6d4-a1d8564525a6 tempest-CreateVolumesFromImageTest-627372874 None] Flow 'volume_create_manager' (6923ddbf-0afe-4600-88c5-13329ce1a188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:32:38 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-33609172-a8b1-4f70-a6d4-a1d8564525a6 tempest-CreateVolumesFromImageTest-627372874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22cdbff5-a678-4103-a695-0ef785b8a295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:38 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-33609172-a8b1-4f70-a6d4-a1d8564525a6 tempest-CreateVolumesFromImageTest-627372874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22cdbff5-a678-4103-a695-0ef785b8a295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:32:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-939844136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e16bb5ef-309d-459e-99ef-ee7501bcf069,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58f53362f6654d1f946783eca6a580d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:32:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:32:38Z,use_quota=True,user_id='014b32adecf74bcfacace72f997f03c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:38 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-33609172-a8b1-4f70-a6d4-a1d8564525a6 tempest-CreateVolumesFromImageTest-627372874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d396e3b6-269d-4d6a-8a95-216a2fdec0eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:38 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-33609172-a8b1-4f70-a6d4-a1d8564525a6 tempest-CreateVolumesFromImageTest-627372874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d396e3b6-269d-4d6a-8a95-216a2fdec0eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:38 devstack sudo[106114]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:38 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-33609172-a8b1-4f70-a6d4-a1d8564525a6 tempest-CreateVolumesFromImageTest-627372874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46c7fb8d-f39e-4c55-b1e1-da15c9ba6e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:38 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-33609172-a8b1-4f70-a6d4-a1d8564525a6 tempest-CreateVolumesFromImageTest-627372874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46c7fb8d-f39e-4c55-b1e1-da15c9ba6e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e16bb5ef-309d-459e-99ef-ee7501bcf069', 'volume_name': 'volume-e16bb5ef-309d-459e-99ef-ee7501bcf069', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:38 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-33609172-a8b1-4f70-a6d4-a1d8564525a6 tempest-CreateVolumesFromImageTest-627372874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7c004ec-8e85-4e14-a60f-2d2bfd8e2cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:38 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-33609172-a8b1-4f70-a6d4-a1d8564525a6 tempest-CreateVolumesFromImageTest-627372874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7c004ec-8e85-4e14-a60f-2d2bfd8e2cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:38 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-33609172-a8b1-4f70-a6d4-a1d8564525a6 tempest-CreateVolumesFromImageTest-627372874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63e13035-2431-45cc-b435-39d788c6c37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:38 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-33609172-a8b1-4f70-a6d4-a1d8564525a6 tempest-CreateVolumesFromImageTest-627372874 None] Volume e16bb5ef-309d-459e-99ef-ee7501bcf069: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e16bb5ef-309d-459e-99ef-ee7501bcf069', 'volume_size': 1} Aug 05 10:32:38 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-33609172-a8b1-4f70-a6d4-a1d8564525a6 tempest-CreateVolumesFromImageTest-627372874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:32:38 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-2faba5a5-eff7-4d3f-9469-513544b0cfea tempest-CreateVolumesFromImageTest-627372874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:32:38 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2faba5a5-eff7-4d3f-9469-513544b0cfea tempest-CreateVolumesFromImageTest-627372874 None] Flow 'volume_create_manager' (ddad029a-0657-4736-aa02-7964363aaa43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:32:38 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2faba5a5-eff7-4d3f-9469-513544b0cfea tempest-CreateVolumesFromImageTest-627372874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16a51c2e-86cc-43c3-8585-a8418de4e180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:38 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d4eefcbc-1c1e-4685-9600-4f1de6ec3531 tempest-CreateVolumesFromSnapshotTest-428000733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0b5984b3-aa0a-46f3-b6dd-18026e655ac9 1073741824" returned: 0 in 0.732s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:38 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2faba5a5-eff7-4d3f-9469-513544b0cfea tempest-CreateVolumesFromImageTest-627372874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16a51c2e-86cc-43c3-8585-a8418de4e180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:32:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1159672873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e817bfd-08a8-47e9-a14d-215f4045b468,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58f53362f6654d1f946783eca6a580d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:32:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:32:38Z,use_quota=True,user_id='014b32adecf74bcfacace72f997f03c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:38 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2faba5a5-eff7-4d3f-9469-513544b0cfea tempest-CreateVolumesFromImageTest-627372874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (863a948c-5f95-4f90-8639-b2699bec8713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:38 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2faba5a5-eff7-4d3f-9469-513544b0cfea tempest-CreateVolumesFromImageTest-627372874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (863a948c-5f95-4f90-8639-b2699bec8713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:38 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2faba5a5-eff7-4d3f-9469-513544b0cfea tempest-CreateVolumesFromImageTest-627372874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd311f17-a6f4-4d0e-a0ff-d26dffbcbd17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:38 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2faba5a5-eff7-4d3f-9469-513544b0cfea tempest-CreateVolumesFromImageTest-627372874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd311f17-a6f4-4d0e-a0ff-d26dffbcbd17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e817bfd-08a8-47e9-a14d-215f4045b468', 'volume_name': 'volume-8e817bfd-08a8-47e9-a14d-215f4045b468', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:38 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2faba5a5-eff7-4d3f-9469-513544b0cfea tempest-CreateVolumesFromImageTest-627372874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (247acba4-5568-432b-986f-9451245e104f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:38 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2faba5a5-eff7-4d3f-9469-513544b0cfea tempest-CreateVolumesFromImageTest-627372874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (247acba4-5568-432b-986f-9451245e104f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:38 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2faba5a5-eff7-4d3f-9469-513544b0cfea tempest-CreateVolumesFromImageTest-627372874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cec9e352-bc84-4fad-82d0-c26ff7464c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:38 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-2faba5a5-eff7-4d3f-9469-513544b0cfea tempest-CreateVolumesFromImageTest-627372874 None] Volume 8e817bfd-08a8-47e9-a14d-215f4045b468: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e817bfd-08a8-47e9-a14d-215f4045b468', 'volume_size': 1} Aug 05 10:32:38 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2faba5a5-eff7-4d3f-9469-513544b0cfea tempest-CreateVolumesFromImageTest-627372874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:32:38 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d4eefcbc-1c1e-4685-9600-4f1de6ec3531 tempest-CreateVolumesFromSnapshotTest-428000733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0b5984b3-aa0a-46f3-b6dd-18026e655ac9 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:38 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b997abb-a18d-4309-8efc-3ad89ec58186 tempest-CreateVolumesFromImageTest-627372874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:32:38 devstack sudo[106122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0b5984b3-aa0a-46f3-b6dd-18026e655ac9 Aug 05 10:32:38 devstack sudo[106122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:38 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0b997abb-a18d-4309-8efc-3ad89ec58186 tempest-CreateVolumesFromImageTest-627372874 None] Flow 'volume_create_manager' (4c29bbcf-9b7f-4f9f-a266-7cf81fd79c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:32:38 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0b997abb-a18d-4309-8efc-3ad89ec58186 tempest-CreateVolumesFromImageTest-627372874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63453b65-65d1-4f87-841c-47d8803c3108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:38 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0b997abb-a18d-4309-8efc-3ad89ec58186 tempest-CreateVolumesFromImageTest-627372874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63453b65-65d1-4f87-841c-47d8803c3108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:32:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1813201463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a8122a2-73ab-493a-b3f4-b35414e39b2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58f53362f6654d1f946783eca6a580d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:32:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:32:38Z,use_quota=True,user_id='014b32adecf74bcfacace72f997f03c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:38 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0b997abb-a18d-4309-8efc-3ad89ec58186 tempest-CreateVolumesFromImageTest-627372874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f650723-62b5-4368-9466-c61bc4719b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:38 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0b997abb-a18d-4309-8efc-3ad89ec58186 tempest-CreateVolumesFromImageTest-627372874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f650723-62b5-4368-9466-c61bc4719b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:38 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0b997abb-a18d-4309-8efc-3ad89ec58186 tempest-CreateVolumesFromImageTest-627372874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc51c950-bbc0-4cd7-914f-b05c497d1941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:38 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0b997abb-a18d-4309-8efc-3ad89ec58186 tempest-CreateVolumesFromImageTest-627372874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc51c950-bbc0-4cd7-914f-b05c497d1941) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a8122a2-73ab-493a-b3f4-b35414e39b2f', 'volume_name': 'volume-2a8122a2-73ab-493a-b3f4-b35414e39b2f', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:38 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0b997abb-a18d-4309-8efc-3ad89ec58186 tempest-CreateVolumesFromImageTest-627372874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad942378-171d-4027-85ee-00caafd70243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:38 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0b997abb-a18d-4309-8efc-3ad89ec58186 tempest-CreateVolumesFromImageTest-627372874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad942378-171d-4027-85ee-00caafd70243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:38 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0b997abb-a18d-4309-8efc-3ad89ec58186 tempest-CreateVolumesFromImageTest-627372874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1fb192a-73fa-4319-adbf-94b8e00a1964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:38 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-0b997abb-a18d-4309-8efc-3ad89ec58186 tempest-CreateVolumesFromImageTest-627372874 None] Volume 2a8122a2-73ab-493a-b3f4-b35414e39b2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a8122a2-73ab-493a-b3f4-b35414e39b2f', 'volume_size': 1} Aug 05 10:32:38 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-0b997abb-a18d-4309-8efc-3ad89ec58186 tempest-CreateVolumesFromImageTest-627372874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:32:38 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2b1d569-d7cc-4e27-a47b-4e660a2eae5e tempest-CreateVolumesFromImageTest-627372874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:32:38 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a2b1d569-d7cc-4e27-a47b-4e660a2eae5e tempest-CreateVolumesFromImageTest-627372874 None] Flow 'volume_create_manager' (ddd9ad24-215b-4125-ad9a-d4934bc655cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:32:38 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a2b1d569-d7cc-4e27-a47b-4e660a2eae5e tempest-CreateVolumesFromImageTest-627372874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e5f4c27-d7b0-44e4-b983-e1bd38545439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:38 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a2b1d569-d7cc-4e27-a47b-4e660a2eae5e tempest-CreateVolumesFromImageTest-627372874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e5f4c27-d7b0-44e4-b983-e1bd38545439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:32:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-53188744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eb504e2-e750-4c98-9fab-4856b7acbe21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58f53362f6654d1f946783eca6a580d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:32:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:32:39Z,use_quota=True,user_id='014b32adecf74bcfacace72f997f03c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:39 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a2b1d569-d7cc-4e27-a47b-4e660a2eae5e tempest-CreateVolumesFromImageTest-627372874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5831eeb8-5416-40c8-89ec-23572afdf29f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:39 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a2b1d569-d7cc-4e27-a47b-4e660a2eae5e tempest-CreateVolumesFromImageTest-627372874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5831eeb8-5416-40c8-89ec-23572afdf29f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:39 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a2b1d569-d7cc-4e27-a47b-4e660a2eae5e tempest-CreateVolumesFromImageTest-627372874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae043ddb-9eb1-4638-a32a-508c7fd001cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:39 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a2b1d569-d7cc-4e27-a47b-4e660a2eae5e tempest-CreateVolumesFromImageTest-627372874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae043ddb-9eb1-4638-a32a-508c7fd001cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2eb504e2-e750-4c98-9fab-4856b7acbe21', 'volume_name': 'volume-2eb504e2-e750-4c98-9fab-4856b7acbe21', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:39 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a2b1d569-d7cc-4e27-a47b-4e660a2eae5e tempest-CreateVolumesFromImageTest-627372874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4696a75f-a21b-4503-bd57-b78dcef79bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:39 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a2b1d569-d7cc-4e27-a47b-4e660a2eae5e tempest-CreateVolumesFromImageTest-627372874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4696a75f-a21b-4503-bd57-b78dcef79bf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:39 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a2b1d569-d7cc-4e27-a47b-4e660a2eae5e tempest-CreateVolumesFromImageTest-627372874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87efb88b-5dfb-4e29-92b0-9af1c3f12cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:39 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-a2b1d569-d7cc-4e27-a47b-4e660a2eae5e tempest-CreateVolumesFromImageTest-627372874 None] Volume 2eb504e2-e750-4c98-9fab-4856b7acbe21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2eb504e2-e750-4c98-9fab-4856b7acbe21', 'volume_size': 1} Aug 05 10:32:39 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a2b1d569-d7cc-4e27-a47b-4e660a2eae5e tempest-CreateVolumesFromImageTest-627372874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:32:39 devstack sudo[106122]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:39 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d4eefcbc-1c1e-4685-9600-4f1de6ec3531 tempest-CreateVolumesFromSnapshotTest-428000733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0b5984b3-aa0a-46f3-b6dd-18026e655ac9" returned: 0 in 0.422s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:39 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-d4eefcbc-1c1e-4685-9600-4f1de6ec3531 tempest-CreateVolumesFromSnapshotTest-428000733 None] <== create_volume: return (1293ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:32:39 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-d4eefcbc-1c1e-4685-9600-4f1de6ec3531 tempest-CreateVolumesFromSnapshotTest-428000733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.298s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:32:39 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-33609172-a8b1-4f70-a6d4-a1d8564525a6 tempest-CreateVolumesFromImageTest-627372874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.585s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:32:39 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-33609172-a8b1-4f70-a6d4-a1d8564525a6 tempest-CreateVolumesFromImageTest-627372874 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:32:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-939844136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e16bb5ef-309d-459e-99ef-ee7501bcf069,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58f53362f6654d1f946783eca6a580d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:32:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:32:38Z,use_quota=True,user_id='014b32adecf74bcfacace72f997f03c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:32:39 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-33609172-a8b1-4f70-a6d4-a1d8564525a6 tempest-CreateVolumesFromImageTest-627372874 None] Creating volume e16bb5ef-309d-459e-99ef-ee7501bcf069 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:32:39 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-33609172-a8b1-4f70-a6d4-a1d8564525a6 tempest-CreateVolumesFromImageTest-627372874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:32:39 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-33609172-a8b1-4f70-a6d4-a1d8564525a6 tempest-CreateVolumesFromImageTest-627372874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:32:39 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-33609172-a8b1-4f70-a6d4-a1d8564525a6 tempest-CreateVolumesFromImageTest-627372874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:32:39 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-33609172-a8b1-4f70-a6d4-a1d8564525a6 tempest-CreateVolumesFromImageTest-627372874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:32:39 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-33609172-a8b1-4f70-a6d4-a1d8564525a6 tempest-CreateVolumesFromImageTest-627372874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:32:39 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-33609172-a8b1-4f70-a6d4-a1d8564525a6 tempest-CreateVolumesFromImageTest-627372874 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:32:39 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-33609172-a8b1-4f70-a6d4-a1d8564525a6 tempest-CreateVolumesFromImageTest-627372874 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:32:39 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-33609172-a8b1-4f70-a6d4-a1d8564525a6 tempest-CreateVolumesFromImageTest-627372874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e16bb5ef-309d-459e-99ef-ee7501bcf069 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:39 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d4eefcbc-1c1e-4685-9600-4f1de6ec3531 tempest-CreateVolumesFromSnapshotTest-428000733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34d0279f-a8d2-45c0-aca9-154495755cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b5984b3-aa0a-46f3-b6dd-18026e655ac9', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:39 devstack sudo[106125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e16bb5ef-309d-459e-99ef-ee7501bcf069 1073741824 Aug 05 10:32:39 devstack sudo[106125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:39 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d4eefcbc-1c1e-4685-9600-4f1de6ec3531 tempest-CreateVolumesFromSnapshotTest-428000733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7554ee4-f42c-4502-998f-47b035934fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:39 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-d4eefcbc-1c1e-4685-9600-4f1de6ec3531 tempest-CreateVolumesFromSnapshotTest-428000733 None] Volume volume-0b5984b3-aa0a-46f3-b6dd-18026e655ac9 (0b5984b3-aa0a-46f3-b6dd-18026e655ac9): created successfully Aug 05 10:32:39 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d4eefcbc-1c1e-4685-9600-4f1de6ec3531 tempest-CreateVolumesFromSnapshotTest-428000733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7554ee4-f42c-4502-998f-47b035934fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:39 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d4eefcbc-1c1e-4685-9600-4f1de6ec3531 tempest-CreateVolumesFromSnapshotTest-428000733 None] Flow 'volume_create_manager' (25df64f5-fc75-48f8-8af5-d37d99f7137a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:32:39 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-d4eefcbc-1c1e-4685-9600-4f1de6ec3531 tempest-CreateVolumesFromSnapshotTest-428000733 None] Created volume successfully. Aug 05 10:32:39 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-edd0524c-cf99-430b-b809-6cbf2273c944 tempest-CreateVolumesFromImageTest-627372874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:32:39 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-edd0524c-cf99-430b-b809-6cbf2273c944 tempest-CreateVolumesFromImageTest-627372874 None] Flow 'volume_create_manager' (9a76fdcd-6471-4741-ab94-ed3721455eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:32:39 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-edd0524c-cf99-430b-b809-6cbf2273c944 tempest-CreateVolumesFromImageTest-627372874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5d87b0c-0ef9-42ec-a89a-c5c19f8b5c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:39 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-edd0524c-cf99-430b-b809-6cbf2273c944 tempest-CreateVolumesFromImageTest-627372874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5d87b0c-0ef9-42ec-a89a-c5c19f8b5c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:32:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1212604022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab89372c-07b4-460a-bf0e-02159e59ff0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58f53362f6654d1f946783eca6a580d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:32:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:32:39Z,use_quota=True,user_id='014b32adecf74bcfacace72f997f03c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:39 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-edd0524c-cf99-430b-b809-6cbf2273c944 tempest-CreateVolumesFromImageTest-627372874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffffbabc-0f18-4aea-8605-590e580772aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:39 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-edd0524c-cf99-430b-b809-6cbf2273c944 tempest-CreateVolumesFromImageTest-627372874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffffbabc-0f18-4aea-8605-590e580772aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:39 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-edd0524c-cf99-430b-b809-6cbf2273c944 tempest-CreateVolumesFromImageTest-627372874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36eb2ba0-8a48-49f5-8652-a20e2560e4e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:39 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-edd0524c-cf99-430b-b809-6cbf2273c944 tempest-CreateVolumesFromImageTest-627372874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36eb2ba0-8a48-49f5-8652-a20e2560e4e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab89372c-07b4-460a-bf0e-02159e59ff0c', 'volume_name': 'volume-ab89372c-07b4-460a-bf0e-02159e59ff0c', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:39 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-edd0524c-cf99-430b-b809-6cbf2273c944 tempest-CreateVolumesFromImageTest-627372874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ba24d6c-6dae-4d38-9b61-ecae7f06f2c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:39 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-edd0524c-cf99-430b-b809-6cbf2273c944 tempest-CreateVolumesFromImageTest-627372874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ba24d6c-6dae-4d38-9b61-ecae7f06f2c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:39 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-edd0524c-cf99-430b-b809-6cbf2273c944 tempest-CreateVolumesFromImageTest-627372874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58ce1622-29d3-46c5-9856-106a9851ec19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:39 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-edd0524c-cf99-430b-b809-6cbf2273c944 tempest-CreateVolumesFromImageTest-627372874 None] Volume ab89372c-07b4-460a-bf0e-02159e59ff0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab89372c-07b4-460a-bf0e-02159e59ff0c', 'volume_size': 1} Aug 05 10:32:39 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-edd0524c-cf99-430b-b809-6cbf2273c944 tempest-CreateVolumesFromImageTest-627372874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:32:39 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-33609172-a8b1-4f70-a6d4-a1d8564525a6 tempest-CreateVolumesFromImageTest-627372874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e16bb5ef-309d-459e-99ef-ee7501bcf069 1073741824" returned: 0 in 0.640s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:39 devstack sudo[106125]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:39 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-e8c525e0-d378-40bc-9b46-0b4683a9a5fa tempest-CreateVolumesFromSnapshotTest-428000733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:32:39 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-33609172-a8b1-4f70-a6d4-a1d8564525a6 tempest-CreateVolumesFromImageTest-627372874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e16bb5ef-309d-459e-99ef-ee7501bcf069 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:39 devstack sudo[106131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e16bb5ef-309d-459e-99ef-ee7501bcf069 Aug 05 10:32:39 devstack sudo[106131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:40 devstack sudo[106131]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:40 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-33609172-a8b1-4f70-a6d4-a1d8564525a6 tempest-CreateVolumesFromImageTest-627372874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e16bb5ef-309d-459e-99ef-ee7501bcf069" returned: 0 in 0.290s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:40 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-33609172-a8b1-4f70-a6d4-a1d8564525a6 tempest-CreateVolumesFromImageTest-627372874 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:32:40 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-33609172-a8b1-4f70-a6d4-a1d8564525a6 tempest-CreateVolumesFromImageTest-627372874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:32:40 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2faba5a5-eff7-4d3f-9469-513544b0cfea tempest-CreateVolumesFromImageTest-627372874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.476s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:32:40 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-2faba5a5-eff7-4d3f-9469-513544b0cfea tempest-CreateVolumesFromImageTest-627372874 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:32:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1159672873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e817bfd-08a8-47e9-a14d-215f4045b468,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58f53362f6654d1f946783eca6a580d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:32:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:32:38Z,use_quota=True,user_id='014b32adecf74bcfacace72f997f03c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:32:40 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-2faba5a5-eff7-4d3f-9469-513544b0cfea tempest-CreateVolumesFromImageTest-627372874 None] Creating volume 8e817bfd-08a8-47e9-a14d-215f4045b468 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:32:40 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2faba5a5-eff7-4d3f-9469-513544b0cfea tempest-CreateVolumesFromImageTest-627372874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:32:40 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2faba5a5-eff7-4d3f-9469-513544b0cfea tempest-CreateVolumesFromImageTest-627372874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:32:40 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-2faba5a5-eff7-4d3f-9469-513544b0cfea tempest-CreateVolumesFromImageTest-627372874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:32:40 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-2faba5a5-eff7-4d3f-9469-513544b0cfea tempest-CreateVolumesFromImageTest-627372874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:32:40 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2faba5a5-eff7-4d3f-9469-513544b0cfea tempest-CreateVolumesFromImageTest-627372874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:32:40 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-2faba5a5-eff7-4d3f-9469-513544b0cfea tempest-CreateVolumesFromImageTest-627372874 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:32:40 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-2faba5a5-eff7-4d3f-9469-513544b0cfea tempest-CreateVolumesFromImageTest-627372874 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:32:40 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2faba5a5-eff7-4d3f-9469-513544b0cfea tempest-CreateVolumesFromImageTest-627372874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e817bfd-08a8-47e9-a14d-215f4045b468 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:40 devstack sudo[106134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e817bfd-08a8-47e9-a14d-215f4045b468 1073741824 Aug 05 10:32:40 devstack sudo[106134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:40 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-33609172-a8b1-4f70-a6d4-a1d8564525a6 tempest-CreateVolumesFromImageTest-627372874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63e13035-2431-45cc-b435-39d788c6c37c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e16bb5ef-309d-459e-99ef-ee7501bcf069', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:40 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-33609172-a8b1-4f70-a6d4-a1d8564525a6 tempest-CreateVolumesFromImageTest-627372874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b59feecd-990d-4faf-8d1d-5372b8a60b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:40 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-33609172-a8b1-4f70-a6d4-a1d8564525a6 tempest-CreateVolumesFromImageTest-627372874 None] Volume volume-e16bb5ef-309d-459e-99ef-ee7501bcf069 (e16bb5ef-309d-459e-99ef-ee7501bcf069): created successfully Aug 05 10:32:40 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-33609172-a8b1-4f70-a6d4-a1d8564525a6 tempest-CreateVolumesFromImageTest-627372874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b59feecd-990d-4faf-8d1d-5372b8a60b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:40 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-33609172-a8b1-4f70-a6d4-a1d8564525a6 tempest-CreateVolumesFromImageTest-627372874 None] Flow 'volume_create_manager' (6923ddbf-0afe-4600-88c5-13329ce1a188) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:32:40 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-33609172-a8b1-4f70-a6d4-a1d8564525a6 tempest-CreateVolumesFromImageTest-627372874 None] Created volume successfully. Aug 05 10:32:40 devstack sudo[106134]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:40 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2faba5a5-eff7-4d3f-9469-513544b0cfea tempest-CreateVolumesFromImageTest-627372874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e817bfd-08a8-47e9-a14d-215f4045b468 1073741824" returned: 0 in 0.556s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:40 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2faba5a5-eff7-4d3f-9469-513544b0cfea tempest-CreateVolumesFromImageTest-627372874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e817bfd-08a8-47e9-a14d-215f4045b468 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:40 devstack sudo[106140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e817bfd-08a8-47e9-a14d-215f4045b468 Aug 05 10:32:40 devstack sudo[106140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:40 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-70f3456e-b5b4-480a-bc89-bc67166c504d tempest-VolumeImageDependencyTests-105585306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:32:40 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-70f3456e-b5b4-480a-bc89-bc67166c504d tempest-VolumeImageDependencyTests-105585306 None] Flow 'volume_create_manager' (6583c7f0-81af-4a04-9590-2820ec66ea30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:32:40 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-70f3456e-b5b4-480a-bc89-bc67166c504d tempest-VolumeImageDependencyTests-105585306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7650f72-ceb3-4791-8465-7783522cbffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:40 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-70f3456e-b5b4-480a-bc89-bc67166c504d tempest-VolumeImageDependencyTests-105585306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7650f72-ceb3-4791-8465-7783522cbffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:32:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c91bc06-4c6d-497b-8b23-e8354f65fcb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbde55f8138a4c958d29dc90c2ba5f37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:32:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:32:41Z,use_quota=True,user_id='fddf904c8b4648499cd3d4388b5a613c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:40 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-70f3456e-b5b4-480a-bc89-bc67166c504d tempest-VolumeImageDependencyTests-105585306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92748545-b6af-4807-8571-222b7e5009c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:40 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-70f3456e-b5b4-480a-bc89-bc67166c504d tempest-VolumeImageDependencyTests-105585306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92748545-b6af-4807-8571-222b7e5009c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:40 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-70f3456e-b5b4-480a-bc89-bc67166c504d tempest-VolumeImageDependencyTests-105585306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbc908ec-cf54-4578-bb7c-303f80f99a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:40 devstack cinder-volume[88613]: DEBUG cinder.image.glance [None req-70f3456e-b5b4-480a-bc89-bc67166c504d tempest-VolumeImageDependencyTests-105585306 None] Creating Keystone auth plugin from conf {{(pid=88613) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 05 10:32:41 devstack sudo[106140]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:41 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2faba5a5-eff7-4d3f-9469-513544b0cfea tempest-CreateVolumesFromImageTest-627372874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e817bfd-08a8-47e9-a14d-215f4045b468" returned: 0 in 0.275s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:41 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-2faba5a5-eff7-4d3f-9469-513544b0cfea tempest-CreateVolumesFromImageTest-627372874 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:32:41 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2faba5a5-eff7-4d3f-9469-513544b0cfea tempest-CreateVolumesFromImageTest-627372874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:32:41 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-0b997abb-a18d-4309-8efc-3ad89ec58186 tempest-CreateVolumesFromImageTest-627372874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.176s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:32:41 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-0b997abb-a18d-4309-8efc-3ad89ec58186 tempest-CreateVolumesFromImageTest-627372874 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:32:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1813201463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a8122a2-73ab-493a-b3f4-b35414e39b2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58f53362f6654d1f946783eca6a580d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:32:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:32:38Z,use_quota=True,user_id='014b32adecf74bcfacace72f997f03c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:32:41 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-0b997abb-a18d-4309-8efc-3ad89ec58186 tempest-CreateVolumesFromImageTest-627372874 None] Creating volume 2a8122a2-73ab-493a-b3f4-b35414e39b2f {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:32:41 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-0b997abb-a18d-4309-8efc-3ad89ec58186 tempest-CreateVolumesFromImageTest-627372874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:32:41 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-0b997abb-a18d-4309-8efc-3ad89ec58186 tempest-CreateVolumesFromImageTest-627372874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:32:41 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-0b997abb-a18d-4309-8efc-3ad89ec58186 tempest-CreateVolumesFromImageTest-627372874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:32:41 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-0b997abb-a18d-4309-8efc-3ad89ec58186 tempest-CreateVolumesFromImageTest-627372874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:32:41 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-0b997abb-a18d-4309-8efc-3ad89ec58186 tempest-CreateVolumesFromImageTest-627372874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:32:41 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-0b997abb-a18d-4309-8efc-3ad89ec58186 tempest-CreateVolumesFromImageTest-627372874 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:32:41 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-0b997abb-a18d-4309-8efc-3ad89ec58186 tempest-CreateVolumesFromImageTest-627372874 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:32:41 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-0b997abb-a18d-4309-8efc-3ad89ec58186 tempest-CreateVolumesFromImageTest-627372874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2a8122a2-73ab-493a-b3f4-b35414e39b2f 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:41 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2faba5a5-eff7-4d3f-9469-513544b0cfea tempest-CreateVolumesFromImageTest-627372874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cec9e352-bc84-4fad-82d0-c26ff7464c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e817bfd-08a8-47e9-a14d-215f4045b468', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:41 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2faba5a5-eff7-4d3f-9469-513544b0cfea tempest-CreateVolumesFromImageTest-627372874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8435ed5d-66b9-42f4-9fdc-05ffd5f2736f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:41 devstack sudo[106143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2a8122a2-73ab-493a-b3f4-b35414e39b2f 1073741824 Aug 05 10:32:41 devstack sudo[106143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:41 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-2faba5a5-eff7-4d3f-9469-513544b0cfea tempest-CreateVolumesFromImageTest-627372874 None] Volume volume-8e817bfd-08a8-47e9-a14d-215f4045b468 (8e817bfd-08a8-47e9-a14d-215f4045b468): created successfully Aug 05 10:32:41 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2faba5a5-eff7-4d3f-9469-513544b0cfea tempest-CreateVolumesFromImageTest-627372874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8435ed5d-66b9-42f4-9fdc-05ffd5f2736f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:41 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2faba5a5-eff7-4d3f-9469-513544b0cfea tempest-CreateVolumesFromImageTest-627372874 None] Flow 'volume_create_manager' (ddad029a-0657-4736-aa02-7964363aaa43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:32:41 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-2faba5a5-eff7-4d3f-9469-513544b0cfea tempest-CreateVolumesFromImageTest-627372874 None] Created volume successfully. Aug 05 10:32:41 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-70f3456e-b5b4-480a-bc89-bc67166c504d tempest-VolumeImageDependencyTests-105585306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbc908ec-cf54-4578-bb7c-303f80f99a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8c91bc06-4c6d-497b-8b23-e8354f65fcb4', 'volume_name': 'volume-8c91bc06-4c6d-497b-8b23-e8354f65fcb4', 'volume_size': 1, 'image_id': 'e6e4c250-1c96-42e4-a95e-16fad391b5be', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e6e4c250-1c96-42e4-a95e-16fad391b5be', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a78202f6b64dc26f96b8bedd54f1e92a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cbde55f8138a4c958d29dc90c2ba5f37', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ec15b0cb59eb04351e91be84441a5c4b03a238fccb362fe0b399edaefed42f8884b101a4f9b5511c920f2a0d67703191e27db697bd2e2fbfb116a8a2bae610f9', 'id': 'e6e4c250-1c96-42e4-a95e-16fad391b5be', 'created_at': datetime.datetime(2026, 8, 5, 8, 32, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 8, 32, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e6e4c250-1c96-42e4-a95e-16fad391b5be/file', 'properties': {}}, 'image_service': }' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:41 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-70f3456e-b5b4-480a-bc89-bc67166c504d tempest-VolumeImageDependencyTests-105585306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c67e5345-f680-4aee-ad57-dc1640112dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:41 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-70f3456e-b5b4-480a-bc89-bc67166c504d tempest-VolumeImageDependencyTests-105585306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c67e5345-f680-4aee-ad57-dc1640112dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:41 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-70f3456e-b5b4-480a-bc89-bc67166c504d tempest-VolumeImageDependencyTests-105585306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bab12773-263e-42d4-9c17-18b4b99e1bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:41 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-70f3456e-b5b4-480a-bc89-bc67166c504d tempest-VolumeImageDependencyTests-105585306 None] Volume 8c91bc06-4c6d-497b-8b23-e8354f65fcb4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8c91bc06-4c6d-497b-8b23-e8354f65fcb4', 'volume_size': 1, 'image_id': 'e6e4c250-1c96-42e4-a95e-16fad391b5be', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e6e4c250-1c96-42e4-a95e-16fad391b5be', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a78202f6b64dc26f96b8bedd54f1e92a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cbde55f8138a4c958d29dc90c2ba5f37', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ec15b0cb59eb04351e91be84441a5c4b03a238fccb362fe0b399edaefed42f8884b101a4f9b5511c920f2a0d67703191e27db697bd2e2fbfb116a8a2bae610f9', 'id': 'e6e4c250-1c96-42e4-a95e-16fad391b5be', 'created_at': datetime.datetime(2026, 8, 5, 8, 32, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 8, 32, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e6e4c250-1c96-42e4-a95e-16fad391b5be/file', 'properties': {}}, 'image_service': } Aug 05 10:32:41 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-70f3456e-b5b4-480a-bc89-bc67166c504d tempest-VolumeImageDependencyTests-105585306 None] Trying to clone 8c91bc06-4c6d-497b-8b23-e8354f65fcb4 from image e6e4c250-1c96-42e4-a95e-16fad391b5be at location (None, [{'url': 'file:///opt/stack/data/glance/images/e6e4c250-1c96-42e4-a95e-16fad391b5be', 'metadata': {}}]). {{(pid=88613) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 05 10:32:41 devstack cinder-volume[88613]: DEBUG cinder.image.image_utils [None req-70f3456e-b5b4-480a-bc89-bc67166c504d tempest-VolumeImageDependencyTests-105585306 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e6e4c250-1c96-42e4-a95e-16fad391b5be_qmazt7dxdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88613) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 05 10:32:41 devstack cinder-volume[88613]: INFO cinder.image.image_utils [None req-70f3456e-b5b4-480a-bc89-bc67166c504d tempest-VolumeImageDependencyTests-105585306 None] Image download 0.00 MB at 0.00 MB/s Aug 05 10:32:41 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[e25cf744-44a3-49f5-84b7-979d6edd0a27]: (4, 'raw') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:32:41 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-70f3456e-b5b4-480a-bc89-bc67166c504d tempest-VolumeImageDependencyTests-105585306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e6e4c250-1c96-42e4-a95e-16fad391b5be_qmazt7dxdevstack@QuobyteHD {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:41 devstack sudo[106148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e6e4c250-1c96-42e4-a95e-16fad391b5be_qmazt7dxdevstack@QuobyteHD Aug 05 10:32:41 devstack sudo[106148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:41 devstack sudo[106143]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:41 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-0b997abb-a18d-4309-8efc-3ad89ec58186 tempest-CreateVolumesFromImageTest-627372874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2a8122a2-73ab-493a-b3f4-b35414e39b2f 1073741824" returned: 0 in 0.554s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:41 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-0b997abb-a18d-4309-8efc-3ad89ec58186 tempest-CreateVolumesFromImageTest-627372874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2a8122a2-73ab-493a-b3f4-b35414e39b2f {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:41 devstack sudo[106151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2a8122a2-73ab-493a-b3f4-b35414e39b2f Aug 05 10:32:41 devstack sudo[106151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:41 devstack sudo[106148]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:41 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-70f3456e-b5b4-480a-bc89-bc67166c504d tempest-VolumeImageDependencyTests-105585306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e6e4c250-1c96-42e4-a95e-16fad391b5be_qmazt7dxdevstack@QuobyteHD" returned: 0 in 0.385s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:41 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-70f3456e-b5b4-480a-bc89-bc67166c504d tempest-VolumeImageDependencyTests-105585306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e6e4c250-1c96-42e4-a95e-16fad391b5be_qmazt7dxdevstack@QuobyteHD {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:41 devstack sudo[106155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e6e4c250-1c96-42e4-a95e-16fad391b5be_qmazt7dxdevstack@QuobyteHD Aug 05 10:32:41 devstack sudo[106155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:41 devstack sudo[106151]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:41 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-0b997abb-a18d-4309-8efc-3ad89ec58186 tempest-CreateVolumesFromImageTest-627372874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2a8122a2-73ab-493a-b3f4-b35414e39b2f" returned: 0 in 0.294s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:41 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-0b997abb-a18d-4309-8efc-3ad89ec58186 tempest-CreateVolumesFromImageTest-627372874 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:32:41 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-0b997abb-a18d-4309-8efc-3ad89ec58186 tempest-CreateVolumesFromImageTest-627372874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:32:41 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a2b1d569-d7cc-4e27-a47b-4e660a2eae5e tempest-CreateVolumesFromImageTest-627372874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.843s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:32:41 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-a2b1d569-d7cc-4e27-a47b-4e660a2eae5e tempest-CreateVolumesFromImageTest-627372874 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:32:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-53188744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eb504e2-e750-4c98-9fab-4856b7acbe21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58f53362f6654d1f946783eca6a580d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:32:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:32:39Z,use_quota=True,user_id='014b32adecf74bcfacace72f997f03c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:32:41 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-a2b1d569-d7cc-4e27-a47b-4e660a2eae5e tempest-CreateVolumesFromImageTest-627372874 None] Creating volume 2eb504e2-e750-4c98-9fab-4856b7acbe21 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:32:41 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a2b1d569-d7cc-4e27-a47b-4e660a2eae5e tempest-CreateVolumesFromImageTest-627372874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:32:41 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a2b1d569-d7cc-4e27-a47b-4e660a2eae5e tempest-CreateVolumesFromImageTest-627372874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:32:41 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-a2b1d569-d7cc-4e27-a47b-4e660a2eae5e tempest-CreateVolumesFromImageTest-627372874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:32:41 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-a2b1d569-d7cc-4e27-a47b-4e660a2eae5e tempest-CreateVolumesFromImageTest-627372874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:32:41 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a2b1d569-d7cc-4e27-a47b-4e660a2eae5e tempest-CreateVolumesFromImageTest-627372874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:32:41 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-a2b1d569-d7cc-4e27-a47b-4e660a2eae5e tempest-CreateVolumesFromImageTest-627372874 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:32:41 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-a2b1d569-d7cc-4e27-a47b-4e660a2eae5e tempest-CreateVolumesFromImageTest-627372874 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:32:41 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a2b1d569-d7cc-4e27-a47b-4e660a2eae5e tempest-CreateVolumesFromImageTest-627372874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2eb504e2-e750-4c98-9fab-4856b7acbe21 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:41 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0b997abb-a18d-4309-8efc-3ad89ec58186 tempest-CreateVolumesFromImageTest-627372874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1fb192a-73fa-4319-adbf-94b8e00a1964) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a8122a2-73ab-493a-b3f4-b35414e39b2f', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:41 devstack sudo[106158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2eb504e2-e750-4c98-9fab-4856b7acbe21 1073741824 Aug 05 10:32:41 devstack sudo[106158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:41 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0b997abb-a18d-4309-8efc-3ad89ec58186 tempest-CreateVolumesFromImageTest-627372874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49d2b9b1-24a0-4fe5-9d8b-7334f9d72f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:41 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-0b997abb-a18d-4309-8efc-3ad89ec58186 tempest-CreateVolumesFromImageTest-627372874 None] Volume volume-2a8122a2-73ab-493a-b3f4-b35414e39b2f (2a8122a2-73ab-493a-b3f4-b35414e39b2f): created successfully Aug 05 10:32:41 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0b997abb-a18d-4309-8efc-3ad89ec58186 tempest-CreateVolumesFromImageTest-627372874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49d2b9b1-24a0-4fe5-9d8b-7334f9d72f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:42 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0b997abb-a18d-4309-8efc-3ad89ec58186 tempest-CreateVolumesFromImageTest-627372874 None] Flow 'volume_create_manager' (4c29bbcf-9b7f-4f9f-a266-7cf81fd79c4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:32:42 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-0b997abb-a18d-4309-8efc-3ad89ec58186 tempest-CreateVolumesFromImageTest-627372874 None] Created volume successfully. Aug 05 10:32:42 devstack sudo[106155]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:42 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-70f3456e-b5b4-480a-bc89-bc67166c504d tempest-VolumeImageDependencyTests-105585306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e6e4c250-1c96-42e4-a95e-16fad391b5be_qmazt7dxdevstack@QuobyteHD" returned: 1 in 0.374s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:42 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-70f3456e-b5b4-480a-bc89-bc67166c504d tempest-VolumeImageDependencyTests-105585306 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e6e4c250-1c96-42e4-a95e-16fad391b5be_qmazt7dxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 10:32:42 devstack cinder-volume[88613]: DEBUG cinder.image.image_utils [None req-70f3456e-b5b4-480a-bc89-bc67166c504d tempest-VolumeImageDependencyTests-105585306 None] Temporary image e6e4c250-1c96-42e4-a95e-16fad391b5be is fetched for user fddf904c8b4648499cd3d4388b5a613c. {{(pid=88613) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 05 10:32:42 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[3362fadf-14d0-4cc9-8cb0-c294775bfacd]: (4, 'raw') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:32:42 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-70f3456e-b5b4-480a-bc89-bc67166c504d tempest-VolumeImageDependencyTests-105585306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e6e4c250-1c96-42e4-a95e-16fad391b5be_qmazt7dxdevstack@QuobyteHD {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:42 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-cca08c3a-a99c-4431-b6ee-b01bb70ab728 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:32:42 devstack sudo[106165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e6e4c250-1c96-42e4-a95e-16fad391b5be_qmazt7dxdevstack@QuobyteHD Aug 05 10:32:42 devstack sudo[106165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:42 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-cca08c3a-a99c-4431-b6ee-b01bb70ab728 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] Flow 'volume_create_manager' (62c465b2-6f35-4310-9322-2f5d36a88765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:32:42 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-cca08c3a-a99c-4431-b6ee-b01bb70ab728 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa255e9f-e10c-45a5-b1dd-5c976efac563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:42 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-cca08c3a-a99c-4431-b6ee-b01bb70ab728 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa255e9f-e10c-45a5-b1dd-5c976efac563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:32:42Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09df092a-5782-4416-b213-8f2075a71202,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52afa1542f404bb0b6a4c43b65921877',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:32:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:32:42Z,use_quota=True,user_id='53691a18f16944fb92f3bad8a7725bf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dfc35f9b-11b3-44d1-9db4-0796d1d3540e),volume_type_id=dfc35f9b-11b3-44d1-9db4-0796d1d3540e)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:42 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-cca08c3a-a99c-4431-b6ee-b01bb70ab728 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8841fb43-5c0c-4d28-b87f-9248c11f4050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:42 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-cca08c3a-a99c-4431-b6ee-b01bb70ab728 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8841fb43-5c0c-4d28-b87f-9248c11f4050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:42 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-cca08c3a-a99c-4431-b6ee-b01bb70ab728 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f58b1eef-0c07-4ed3-a1db-d604fd30d3db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:42 devstack cinder-volume[88613]: DEBUG cinder.image.glance [None req-cca08c3a-a99c-4431-b6ee-b01bb70ab728 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] Creating Keystone auth plugin from conf {{(pid=88613) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 05 10:32:42 devstack sudo[106158]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:42 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a2b1d569-d7cc-4e27-a47b-4e660a2eae5e tempest-CreateVolumesFromImageTest-627372874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2eb504e2-e750-4c98-9fab-4856b7acbe21 1073741824" returned: 0 in 0.626s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:42 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a2b1d569-d7cc-4e27-a47b-4e660a2eae5e tempest-CreateVolumesFromImageTest-627372874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2eb504e2-e750-4c98-9fab-4856b7acbe21 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:42 devstack sudo[106165]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:42 devstack sudo[106172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2eb504e2-e750-4c98-9fab-4856b7acbe21 Aug 05 10:32:42 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-70f3456e-b5b4-480a-bc89-bc67166c504d tempest-VolumeImageDependencyTests-105585306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e6e4c250-1c96-42e4-a95e-16fad391b5be_qmazt7dxdevstack@QuobyteHD" returned: 0 in 0.438s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:42 devstack sudo[106172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:42 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-70f3456e-b5b4-480a-bc89-bc67166c504d tempest-VolumeImageDependencyTests-105585306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e6e4c250-1c96-42e4-a95e-16fad391b5be_qmazt7dxdevstack@QuobyteHD {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:42 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-cca08c3a-a99c-4431-b6ee-b01bb70ab728 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f58b1eef-0c07-4ed3-a1db-d604fd30d3db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '09df092a-5782-4416-b213-8f2075a71202', 'volume_name': 'volume-09df092a-5782-4416-b213-8f2075a71202', 'volume_size': 1, 'image_id': 'b517e5f6-c4b4-4637-a1d5-f184ed429b6d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b517e5f6-c4b4-4637-a1d5-f184ed429b6d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f03a584ab56a4fb2e539cb0f394a6db7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '52afa1542f404bb0b6a4c43b65921877', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '01b614a40cb3c7413a196aee0a27c8da3e760e1d16db2825bdecaf1a03c8f15d649a64383b28795ff4219a8305a7a42627bcd110a0bfc58cd35c10b2fe175f05', 'id': 'b517e5f6-c4b4-4637-a1d5-f184ed429b6d', 'created_at': datetime.datetime(2026, 8, 5, 8, 32, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 8, 32, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b517e5f6-c4b4-4637-a1d5-f184ed429b6d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:42 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-cca08c3a-a99c-4431-b6ee-b01bb70ab728 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a57f7e81-aafb-4e28-a8d3-cb1107038954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:42 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-cca08c3a-a99c-4431-b6ee-b01bb70ab728 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a57f7e81-aafb-4e28-a8d3-cb1107038954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:42 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-cca08c3a-a99c-4431-b6ee-b01bb70ab728 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (625a32eb-cf09-4949-aecf-1cf511c4c3e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:42 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-cca08c3a-a99c-4431-b6ee-b01bb70ab728 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] Volume 09df092a-5782-4416-b213-8f2075a71202: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-09df092a-5782-4416-b213-8f2075a71202', 'volume_size': 1, 'image_id': 'b517e5f6-c4b4-4637-a1d5-f184ed429b6d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b517e5f6-c4b4-4637-a1d5-f184ed429b6d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f03a584ab56a4fb2e539cb0f394a6db7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '52afa1542f404bb0b6a4c43b65921877', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '01b614a40cb3c7413a196aee0a27c8da3e760e1d16db2825bdecaf1a03c8f15d649a64383b28795ff4219a8305a7a42627bcd110a0bfc58cd35c10b2fe175f05', 'id': 'b517e5f6-c4b4-4637-a1d5-f184ed429b6d', 'created_at': datetime.datetime(2026, 8, 5, 8, 32, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 8, 32, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b517e5f6-c4b4-4637-a1d5-f184ed429b6d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Aug 05 10:32:42 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-cca08c3a-a99c-4431-b6ee-b01bb70ab728 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] Trying to clone 09df092a-5782-4416-b213-8f2075a71202 from image b517e5f6-c4b4-4637-a1d5-f184ed429b6d at location (None, [{'url': 'file:///opt/stack/data/glance/images/b517e5f6-c4b4-4637-a1d5-f184ed429b6d', 'metadata': {}}]). {{(pid=88613) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 05 10:32:42 devstack sudo[106174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e6e4c250-1c96-42e4-a95e-16fad391b5be_qmazt7dxdevstack@QuobyteHD Aug 05 10:32:42 devstack sudo[106174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:42 devstack cinder-volume[88613]: DEBUG cinder.image.image_utils [None req-cca08c3a-a99c-4431-b6ee-b01bb70ab728 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b517e5f6-c4b4-4637-a1d5-f184ed429b6d_0xjg64n7devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88613) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 05 10:32:42 devstack cinder-volume[88613]: INFO cinder.image.image_utils [None req-cca08c3a-a99c-4431-b6ee-b01bb70ab728 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] Image download 0.00 MB at 0.00 MB/s Aug 05 10:32:43 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee47e07e-6054-4060-8bda-4dfd16e28b75]: (4, 'raw') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:32:43 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-cca08c3a-a99c-4431-b6ee-b01bb70ab728 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b517e5f6-c4b4-4637-a1d5-f184ed429b6d_0xjg64n7devstack@QuobyteHD {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:43 devstack sudo[106172]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:43 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a2b1d569-d7cc-4e27-a47b-4e660a2eae5e tempest-CreateVolumesFromImageTest-627372874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2eb504e2-e750-4c98-9fab-4856b7acbe21" returned: 0 in 0.430s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:43 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-a2b1d569-d7cc-4e27-a47b-4e660a2eae5e tempest-CreateVolumesFromImageTest-627372874 None] <== create_volume: return (1118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:32:43 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a2b1d569-d7cc-4e27-a47b-4e660a2eae5e tempest-CreateVolumesFromImageTest-627372874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:32:43 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-edd0524c-cf99-430b-b809-6cbf2273c944 tempest-CreateVolumesFromImageTest-627372874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.616s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:32:43 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-edd0524c-cf99-430b-b809-6cbf2273c944 tempest-CreateVolumesFromImageTest-627372874 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:32:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1212604022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab89372c-07b4-460a-bf0e-02159e59ff0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58f53362f6654d1f946783eca6a580d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:32:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:32:39Z,use_quota=True,user_id='014b32adecf74bcfacace72f997f03c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:32:43 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-edd0524c-cf99-430b-b809-6cbf2273c944 tempest-CreateVolumesFromImageTest-627372874 None] Creating volume ab89372c-07b4-460a-bf0e-02159e59ff0c {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:32:43 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-edd0524c-cf99-430b-b809-6cbf2273c944 tempest-CreateVolumesFromImageTest-627372874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:32:43 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-edd0524c-cf99-430b-b809-6cbf2273c944 tempest-CreateVolumesFromImageTest-627372874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:32:43 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-edd0524c-cf99-430b-b809-6cbf2273c944 tempest-CreateVolumesFromImageTest-627372874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:32:43 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-edd0524c-cf99-430b-b809-6cbf2273c944 tempest-CreateVolumesFromImageTest-627372874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:32:43 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-edd0524c-cf99-430b-b809-6cbf2273c944 tempest-CreateVolumesFromImageTest-627372874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:32:43 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-edd0524c-cf99-430b-b809-6cbf2273c944 tempest-CreateVolumesFromImageTest-627372874 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:32:43 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-edd0524c-cf99-430b-b809-6cbf2273c944 tempest-CreateVolumesFromImageTest-627372874 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:32:43 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-edd0524c-cf99-430b-b809-6cbf2273c944 tempest-CreateVolumesFromImageTest-627372874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ab89372c-07b4-460a-bf0e-02159e59ff0c 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:43 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a2b1d569-d7cc-4e27-a47b-4e660a2eae5e tempest-CreateVolumesFromImageTest-627372874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87efb88b-5dfb-4e29-92b0-9af1c3f12cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2eb504e2-e750-4c98-9fab-4856b7acbe21', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:43 devstack sudo[106174]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:43 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a2b1d569-d7cc-4e27-a47b-4e660a2eae5e tempest-CreateVolumesFromImageTest-627372874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7982f6f6-a34a-4b13-99d6-217a1c316953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:43 devstack sudo[106181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ab89372c-07b4-460a-bf0e-02159e59ff0c 1073741824 Aug 05 10:32:43 devstack sudo[106181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:43 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-70f3456e-b5b4-480a-bc89-bc67166c504d tempest-VolumeImageDependencyTests-105585306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e6e4c250-1c96-42e4-a95e-16fad391b5be_qmazt7dxdevstack@QuobyteHD" returned: 1 in 0.455s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:43 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-70f3456e-b5b4-480a-bc89-bc67166c504d tempest-VolumeImageDependencyTests-105585306 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e6e4c250-1c96-42e4-a95e-16fad391b5be_qmazt7dxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 10:32:43 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-70f3456e-b5b4-480a-bc89-bc67166c504d tempest-VolumeImageDependencyTests-105585306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:32:43 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-a2b1d569-d7cc-4e27-a47b-4e660a2eae5e tempest-CreateVolumesFromImageTest-627372874 None] Volume volume-2eb504e2-e750-4c98-9fab-4856b7acbe21 (2eb504e2-e750-4c98-9fab-4856b7acbe21): created successfully Aug 05 10:32:43 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a2b1d569-d7cc-4e27-a47b-4e660a2eae5e tempest-CreateVolumesFromImageTest-627372874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7982f6f6-a34a-4b13-99d6-217a1c316953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:43 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a2b1d569-d7cc-4e27-a47b-4e660a2eae5e tempest-CreateVolumesFromImageTest-627372874 None] Flow 'volume_create_manager' (ddd9ad24-215b-4125-ad9a-d4934bc655cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:32:43 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-a2b1d569-d7cc-4e27-a47b-4e660a2eae5e tempest-CreateVolumesFromImageTest-627372874 None] Created volume successfully. Aug 05 10:32:43 devstack sudo[106177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b517e5f6-c4b4-4637-a1d5-f184ed429b6d_0xjg64n7devstack@QuobyteHD Aug 05 10:32:43 devstack sudo[106177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:43 devstack sudo[106177]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:43 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-cca08c3a-a99c-4431-b6ee-b01bb70ab728 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b517e5f6-c4b4-4637-a1d5-f184ed429b6d_0xjg64n7devstack@QuobyteHD" returned: 0 in 0.357s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:43 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-cca08c3a-a99c-4431-b6ee-b01bb70ab728 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b517e5f6-c4b4-4637-a1d5-f184ed429b6d_0xjg64n7devstack@QuobyteHD {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:43 devstack sudo[106181]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:43 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-edd0524c-cf99-430b-b809-6cbf2273c944 tempest-CreateVolumesFromImageTest-627372874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ab89372c-07b4-460a-bf0e-02159e59ff0c 1073741824" returned: 0 in 0.426s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:43 devstack sudo[106189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b517e5f6-c4b4-4637-a1d5-f184ed429b6d_0xjg64n7devstack@QuobyteHD Aug 05 10:32:43 devstack sudo[106189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:43 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-edd0524c-cf99-430b-b809-6cbf2273c944 tempest-CreateVolumesFromImageTest-627372874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ab89372c-07b4-460a-bf0e-02159e59ff0c {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:43 devstack sudo[106192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ab89372c-07b4-460a-bf0e-02159e59ff0c Aug 05 10:32:43 devstack sudo[106192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:43 devstack sudo[106189]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:43 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-cca08c3a-a99c-4431-b6ee-b01bb70ab728 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b517e5f6-c4b4-4637-a1d5-f184ed429b6d_0xjg64n7devstack@QuobyteHD" returned: 1 in 0.338s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:43 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-cca08c3a-a99c-4431-b6ee-b01bb70ab728 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b517e5f6-c4b4-4637-a1d5-f184ed429b6d_0xjg64n7devstack@QuobyteHD' failed. Not Retrying. {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 10:32:43 devstack cinder-volume[88613]: DEBUG cinder.image.image_utils [None req-cca08c3a-a99c-4431-b6ee-b01bb70ab728 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] Temporary image b517e5f6-c4b4-4637-a1d5-f184ed429b6d is fetched for user 53691a18f16944fb92f3bad8a7725bf2. {{(pid=88613) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 05 10:32:43 devstack sudo[106192]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:43 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-edd0524c-cf99-430b-b809-6cbf2273c944 tempest-CreateVolumesFromImageTest-627372874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ab89372c-07b4-460a-bf0e-02159e59ff0c" returned: 0 in 0.254s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:43 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-edd0524c-cf99-430b-b809-6cbf2273c944 tempest-CreateVolumesFromImageTest-627372874 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:32:43 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-edd0524c-cf99-430b-b809-6cbf2273c944 tempest-CreateVolumesFromImageTest-627372874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:32:43 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-e8c525e0-d378-40bc-9b46-0b4683a9a5fa tempest-CreateVolumesFromSnapshotTest-428000733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.988s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:32:43 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-e8c525e0-d378-40bc-9b46-0b4683a9a5fa tempest-CreateVolumesFromSnapshotTest-428000733 None] Creating offline snapshot c906fd9f-3bae-4634-a209-6a2ed2596ae4 of volume 0b5984b3-aa0a-46f3-b6dd-18026e655ac9 {{(pid=88613) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:32:43 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-edd0524c-cf99-430b-b809-6cbf2273c944 tempest-CreateVolumesFromImageTest-627372874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58ce1622-29d3-46c5-9856-106a9851ec19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab89372c-07b4-460a-bf0e-02159e59ff0c', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:43 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-edd0524c-cf99-430b-b809-6cbf2273c944 tempest-CreateVolumesFromImageTest-627372874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (255300a0-b03c-4e42-b250-1badcc994a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:43 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d1dc01c-6fe5-45d1-af7f-e7ba2face225]: (4, 'raw') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:32:43 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcfbbb9d-5564-469c-ac94-bfa46e433859]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:32:43 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-cca08c3a-a99c-4431-b6ee-b01bb70ab728 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b517e5f6-c4b4-4637-a1d5-f184ed429b6d_0xjg64n7devstack@QuobyteHD {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:43 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e8c525e0-d378-40bc-9b46-0b4683a9a5fa tempest-CreateVolumesFromSnapshotTest-428000733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0b5984b3-aa0a-46f3-b6dd-18026e655ac9 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:43 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-edd0524c-cf99-430b-b809-6cbf2273c944 tempest-CreateVolumesFromImageTest-627372874 None] Volume volume-ab89372c-07b4-460a-bf0e-02159e59ff0c (ab89372c-07b4-460a-bf0e-02159e59ff0c): created successfully Aug 05 10:32:43 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-edd0524c-cf99-430b-b809-6cbf2273c944 tempest-CreateVolumesFromImageTest-627372874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (255300a0-b03c-4e42-b250-1badcc994a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:43 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-edd0524c-cf99-430b-b809-6cbf2273c944 tempest-CreateVolumesFromImageTest-627372874 None] Flow 'volume_create_manager' (9a76fdcd-6471-4741-ab94-ed3721455eb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:32:43 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-edd0524c-cf99-430b-b809-6cbf2273c944 tempest-CreateVolumesFromImageTest-627372874 None] Created volume successfully. Aug 05 10:32:43 devstack sudo[106199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b517e5f6-c4b4-4637-a1d5-f184ed429b6d_0xjg64n7devstack@QuobyteHD Aug 05 10:32:43 devstack sudo[106199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:43 devstack sudo[106200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0b5984b3-aa0a-46f3-b6dd-18026e655ac9 Aug 05 10:32:43 devstack sudo[106200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:44 devstack sudo[106199]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-cca08c3a-a99c-4431-b6ee-b01bb70ab728 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b517e5f6-c4b4-4637-a1d5-f184ed429b6d_0xjg64n7devstack@QuobyteHD" returned: 0 in 0.320s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-cca08c3a-a99c-4431-b6ee-b01bb70ab728 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b517e5f6-c4b4-4637-a1d5-f184ed429b6d_0xjg64n7devstack@QuobyteHD {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:44 devstack sudo[106200]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e8c525e0-d378-40bc-9b46-0b4683a9a5fa tempest-CreateVolumesFromSnapshotTest-428000733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0b5984b3-aa0a-46f3-b6dd-18026e655ac9" returned: 0 in 0.369s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e8c525e0-d378-40bc-9b46-0b4683a9a5fa tempest-CreateVolumesFromSnapshotTest-428000733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0b5984b3-aa0a-46f3-b6dd-18026e655ac9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0b5984b3-aa0a-46f3-b6dd-18026e655ac9.c906fd9f-3bae-4634-a209-6a2ed2596ae4 1G {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:44 devstack sudo[106209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0b5984b3-aa0a-46f3-b6dd-18026e655ac9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0b5984b3-aa0a-46f3-b6dd-18026e655ac9.c906fd9f-3bae-4634-a209-6a2ed2596ae4 1G Aug 05 10:32:44 devstack sudo[106209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:44 devstack sudo[106207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b517e5f6-c4b4-4637-a1d5-f184ed429b6d_0xjg64n7devstack@QuobyteHD Aug 05 10:32:44 devstack sudo[106207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:44 devstack sudo[106207]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-cca08c3a-a99c-4431-b6ee-b01bb70ab728 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b517e5f6-c4b4-4637-a1d5-f184ed429b6d_0xjg64n7devstack@QuobyteHD" returned: 1 in 0.348s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-cca08c3a-a99c-4431-b6ee-b01bb70ab728 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b517e5f6-c4b4-4637-a1d5-f184ed429b6d_0xjg64n7devstack@QuobyteHD' failed. Not Retrying. {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 10:32:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-cca08c3a-a99c-4431-b6ee-b01bb70ab728 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:32:44 devstack sudo[106209]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e8c525e0-d378-40bc-9b46-0b4683a9a5fa tempest-CreateVolumesFromSnapshotTest-428000733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0b5984b3-aa0a-46f3-b6dd-18026e655ac9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0b5984b3-aa0a-46f3-b6dd-18026e655ac9.c906fd9f-3bae-4634-a209-6a2ed2596ae4 1G" returned: 0 in 0.407s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e8c525e0-d378-40bc-9b46-0b4683a9a5fa tempest-CreateVolumesFromSnapshotTest-428000733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b5984b3-aa0a-46f3-b6dd-18026e655ac9 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0b5984b3-aa0a-46f3-b6dd-18026e655ac9.c906fd9f-3bae-4634-a209-6a2ed2596ae4 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:44 devstack sudo[106219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b5984b3-aa0a-46f3-b6dd-18026e655ac9 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0b5984b3-aa0a-46f3-b6dd-18026e655ac9.c906fd9f-3bae-4634-a209-6a2ed2596ae4 Aug 05 10:32:44 devstack sudo[106219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:44 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-0ef96a29-4a8f-4425-a006-642fdb9da3fd tempest-CreateVolumesFromImageTest-627372874 None] Acquiring lock "cinder-ab89372c-07b4-460a-bf0e-02159e59ff0c-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:32:44 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-0ef96a29-4a8f-4425-a006-642fdb9da3fd tempest-CreateVolumesFromImageTest-627372874 None] Lock "cinder-ab89372c-07b4-460a-bf0e-02159e59ff0c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:32:44 devstack sudo[106219]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e8c525e0-d378-40bc-9b46-0b4683a9a5fa tempest-CreateVolumesFromSnapshotTest-428000733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b5984b3-aa0a-46f3-b6dd-18026e655ac9 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0b5984b3-aa0a-46f3-b6dd-18026e655ac9.c906fd9f-3bae-4634-a209-6a2ed2596ae4" returned: 0 in 0.307s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:44 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-e8c525e0-d378-40bc-9b46-0b4683a9a5fa tempest-CreateVolumesFromSnapshotTest-428000733 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0b5984b3-aa0a-46f3-b6dd-18026e655ac9.c906fd9f-3bae-4634-a209-6a2ed2596ae4 is being set with open permissions: ugo+rw Aug 05 10:32:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e8c525e0-d378-40bc-9b46-0b4683a9a5fa tempest-CreateVolumesFromSnapshotTest-428000733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0b5984b3-aa0a-46f3-b6dd-18026e655ac9.c906fd9f-3bae-4634-a209-6a2ed2596ae4 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:44 devstack sudo[106226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0b5984b3-aa0a-46f3-b6dd-18026e655ac9.c906fd9f-3bae-4634-a209-6a2ed2596ae4 Aug 05 10:32:44 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-0ef96a29-4a8f-4425-a006-642fdb9da3fd tempest-CreateVolumesFromImageTest-627372874 None] Acquiring lock "cinder-quobyte-ab89372c-07b4-460a-bf0e-02159e59ff0c" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:32:44 devstack sudo[106226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:44 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-0ef96a29-4a8f-4425-a006-642fdb9da3fd tempest-CreateVolumesFromImageTest-627372874 None] Lock "cinder-quobyte-ab89372c-07b4-460a-bf0e-02159e59ff0c" acquired by "delete_volume" :: waited 0.016s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:32:45 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a77735b-60a6-4ccd-8a64-9ec193197dce]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:32:45 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-0ef96a29-4a8f-4425-a006-642fdb9da3fd tempest-CreateVolumesFromImageTest-627372874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ab89372c-07b4-460a-bf0e-02159e59ff0c {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:45 devstack sudo[106228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ab89372c-07b4-460a-bf0e-02159e59ff0c Aug 05 10:32:45 devstack sudo[106228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:45 devstack sudo[106226]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:45 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e8c525e0-d378-40bc-9b46-0b4683a9a5fa tempest-CreateVolumesFromSnapshotTest-428000733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0b5984b3-aa0a-46f3-b6dd-18026e655ac9.c906fd9f-3bae-4634-a209-6a2ed2596ae4" returned: 0 in 0.278s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:45 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e8c525e0-d378-40bc-9b46-0b4683a9a5fa tempest-CreateVolumesFromSnapshotTest-428000733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0b5984b3-aa0a-46f3-b6dd-18026e655ac9.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:45 devstack sudo[106231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0b5984b3-aa0a-46f3-b6dd-18026e655ac9.info Aug 05 10:32:45 devstack sudo[106231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:45 devstack sudo[106228]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:45 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-0ef96a29-4a8f-4425-a006-642fdb9da3fd tempest-CreateVolumesFromImageTest-627372874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ab89372c-07b4-460a-bf0e-02159e59ff0c" returned: 0 in 0.370s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:45 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-0ef96a29-4a8f-4425-a006-642fdb9da3fd tempest-CreateVolumesFromImageTest-627372874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ab89372c-07b4-460a-bf0e-02159e59ff0c {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:45 devstack sudo[106236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ab89372c-07b4-460a-bf0e-02159e59ff0c Aug 05 10:32:45 devstack sudo[106236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:45 devstack sudo[106231]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:45 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e8c525e0-d378-40bc-9b46-0b4683a9a5fa tempest-CreateVolumesFromSnapshotTest-428000733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0b5984b3-aa0a-46f3-b6dd-18026e655ac9.info" returned: 0 in 0.264s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:45 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-e8c525e0-d378-40bc-9b46-0b4683a9a5fa tempest-CreateVolumesFromSnapshotTest-428000733 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0b5984b3-aa0a-46f3-b6dd-18026e655ac9.info is being set with open permissions: ugo+rw Aug 05 10:32:45 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e8c525e0-d378-40bc-9b46-0b4683a9a5fa tempest-CreateVolumesFromSnapshotTest-428000733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0b5984b3-aa0a-46f3-b6dd-18026e655ac9.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:45 devstack sudo[106239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0b5984b3-aa0a-46f3-b6dd-18026e655ac9.info Aug 05 10:32:45 devstack sudo[106239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:45 devstack sudo[106236]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:45 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-0ef96a29-4a8f-4425-a006-642fdb9da3fd tempest-CreateVolumesFromImageTest-627372874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ab89372c-07b4-460a-bf0e-02159e59ff0c" returned: 0 in 0.244s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:45 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-0ef96a29-4a8f-4425-a006-642fdb9da3fd tempest-CreateVolumesFromImageTest-627372874 None] Lock "cinder-quobyte-ab89372c-07b4-460a-bf0e-02159e59ff0c" released by "delete_volume" :: held 0.667s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:32:45 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-0ef96a29-4a8f-4425-a006-642fdb9da3fd tempest-CreateVolumesFromImageTest-627372874 None] Created reservations ['33c217fb-0505-427a-a8b7-7e0a5e20f442', 'f8516528-feef-4a86-b2cd-c88b05c0b530', '442d7fd4-7d69-4e91-a61f-65bf5698b3a7', '05a9c1e8-1a1d-4a0b-b019-10d064e138ad'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:32:45 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-0ef96a29-4a8f-4425-a006-642fdb9da3fd tempest-CreateVolumesFromImageTest-627372874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:32:45 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-0ef96a29-4a8f-4425-a006-642fdb9da3fd tempest-CreateVolumesFromImageTest-627372874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:32:45 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-0ef96a29-4a8f-4425-a006-642fdb9da3fd tempest-CreateVolumesFromImageTest-627372874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:32:45 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-0ef96a29-4a8f-4425-a006-642fdb9da3fd tempest-CreateVolumesFromImageTest-627372874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:32:45 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-0ef96a29-4a8f-4425-a006-642fdb9da3fd tempest-CreateVolumesFromImageTest-627372874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:32:45 devstack sudo[106239]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:45 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-0ef96a29-4a8f-4425-a006-642fdb9da3fd tempest-CreateVolumesFromImageTest-627372874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:45 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e8c525e0-d378-40bc-9b46-0b4683a9a5fa tempest-CreateVolumesFromSnapshotTest-428000733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0b5984b3-aa0a-46f3-b6dd-18026e655ac9.info" returned: 0 in 0.273s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:45 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-e8c525e0-d378-40bc-9b46-0b4683a9a5fa tempest-CreateVolumesFromSnapshotTest-428000733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.997s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:32:45 devstack sudo[106243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:32:45 devstack sudo[106243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:45 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-70f3456e-b5b4-480a-bc89-bc67166c504d tempest-VolumeImageDependencyTests-105585306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.676s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:32:45 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-70f3456e-b5b4-480a-bc89-bc67166c504d tempest-VolumeImageDependencyTests-105585306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:32:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c91bc06-4c6d-497b-8b23-e8354f65fcb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbde55f8138a4c958d29dc90c2ba5f37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:32:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:32:41Z,use_quota=True,user_id='fddf904c8b4648499cd3d4388b5a613c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:32:45 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-70f3456e-b5b4-480a-bc89-bc67166c504d tempest-VolumeImageDependencyTests-105585306 None] Creating volume 8c91bc06-4c6d-497b-8b23-e8354f65fcb4 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:32:45 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-70f3456e-b5b4-480a-bc89-bc67166c504d tempest-VolumeImageDependencyTests-105585306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:32:45 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-70f3456e-b5b4-480a-bc89-bc67166c504d tempest-VolumeImageDependencyTests-105585306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:32:45 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-70f3456e-b5b4-480a-bc89-bc67166c504d tempest-VolumeImageDependencyTests-105585306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:32:45 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-70f3456e-b5b4-480a-bc89-bc67166c504d tempest-VolumeImageDependencyTests-105585306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:32:45 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-70f3456e-b5b4-480a-bc89-bc67166c504d tempest-VolumeImageDependencyTests-105585306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:32:45 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-70f3456e-b5b4-480a-bc89-bc67166c504d tempest-VolumeImageDependencyTests-105585306 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:32:45 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-70f3456e-b5b4-480a-bc89-bc67166c504d tempest-VolumeImageDependencyTests-105585306 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:32:45 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-70f3456e-b5b4-480a-bc89-bc67166c504d tempest-VolumeImageDependencyTests-105585306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8c91bc06-4c6d-497b-8b23-e8354f65fcb4 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:45 devstack sudo[106245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8c91bc06-4c6d-497b-8b23-e8354f65fcb4 1073741824 Aug 05 10:32:45 devstack sudo[106245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:45 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-e8c525e0-d378-40bc-9b46-0b4683a9a5fa tempest-CreateVolumesFromSnapshotTest-428000733 None] Create snapshot completed successfully Aug 05 10:32:46 devstack sudo[106243]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-0ef96a29-4a8f-4425-a006-642fdb9da3fd tempest-CreateVolumesFromImageTest-627372874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.263s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:46 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-0ef96a29-4a8f-4425-a006-642fdb9da3fd tempest-CreateVolumesFromImageTest-627372874 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:32:46 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-0ef96a29-4a8f-4425-a006-642fdb9da3fd tempest-CreateVolumesFromImageTest-627372874 None] Deleted volume successfully. Aug 05 10:32:46 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e8e10daf-cddc-471b-ba65-5ee1fd9856bf tempest-CreateVolumesFromImageTest-627372874 None] Acquiring lock "cinder-2eb504e2-e750-4c98-9fab-4856b7acbe21-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:32:46 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e8e10daf-cddc-471b-ba65-5ee1fd9856bf tempest-CreateVolumesFromImageTest-627372874 None] Lock "cinder-2eb504e2-e750-4c98-9fab-4856b7acbe21-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:32:46 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-0ef96a29-4a8f-4425-a006-642fdb9da3fd tempest-CreateVolumesFromImageTest-627372874 None] Lock "cinder-ab89372c-07b4-460a-bf0e-02159e59ff0c-delete_volume" released by "delete_volume" :: held 1.177s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:32:46 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e8e10daf-cddc-471b-ba65-5ee1fd9856bf tempest-CreateVolumesFromImageTest-627372874 None] Acquiring lock "cinder-quobyte-2eb504e2-e750-4c98-9fab-4856b7acbe21" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:32:46 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e8e10daf-cddc-471b-ba65-5ee1fd9856bf tempest-CreateVolumesFromImageTest-627372874 None] Lock "cinder-quobyte-2eb504e2-e750-4c98-9fab-4856b7acbe21" acquired by "delete_volume" :: waited 0.016s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:32:46 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a226ab-ba8d-4f2c-a16e-948ae58f4cbd]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:32:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e8e10daf-cddc-471b-ba65-5ee1fd9856bf tempest-CreateVolumesFromImageTest-627372874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2eb504e2-e750-4c98-9fab-4856b7acbe21 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:46 devstack sudo[106251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2eb504e2-e750-4c98-9fab-4856b7acbe21 Aug 05 10:32:46 devstack sudo[106251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:46 devstack sudo[106245]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-70f3456e-b5b4-480a-bc89-bc67166c504d tempest-VolumeImageDependencyTests-105585306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8c91bc06-4c6d-497b-8b23-e8354f65fcb4 1073741824" returned: 0 in 0.502s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-70f3456e-b5b4-480a-bc89-bc67166c504d tempest-VolumeImageDependencyTests-105585306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8c91bc06-4c6d-497b-8b23-e8354f65fcb4 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:46 devstack sudo[106254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8c91bc06-4c6d-497b-8b23-e8354f65fcb4 Aug 05 10:32:46 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:46 devstack sudo[106251]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e8e10daf-cddc-471b-ba65-5ee1fd9856bf tempest-CreateVolumesFromImageTest-627372874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2eb504e2-e750-4c98-9fab-4856b7acbe21" returned: 0 in 0.498s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e8e10daf-cddc-471b-ba65-5ee1fd9856bf tempest-CreateVolumesFromImageTest-627372874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2eb504e2-e750-4c98-9fab-4856b7acbe21 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:46 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-70f3456e-b5b4-480a-bc89-bc67166c504d tempest-VolumeImageDependencyTests-105585306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8c91bc06-4c6d-497b-8b23-e8354f65fcb4" returned: 0 in 0.335s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:46 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-70f3456e-b5b4-480a-bc89-bc67166c504d tempest-VolumeImageDependencyTests-105585306 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:32:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-70f3456e-b5b4-480a-bc89-bc67166c504d tempest-VolumeImageDependencyTests-105585306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:32:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-cca08c3a-a99c-4431-b6ee-b01bb70ab728 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.188s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:32:46 devstack sudo[106260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2eb504e2-e750-4c98-9fab-4856b7acbe21 Aug 05 10:32:46 devstack sudo[106260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:46 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-cca08c3a-a99c-4431-b6ee-b01bb70ab728 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:32:42Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09df092a-5782-4416-b213-8f2075a71202,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52afa1542f404bb0b6a4c43b65921877',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:32:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:32:42Z,use_quota=True,user_id='53691a18f16944fb92f3bad8a7725bf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dfc35f9b-11b3-44d1-9db4-0796d1d3540e),volume_type_id=dfc35f9b-11b3-44d1-9db4-0796d1d3540e)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:32:46 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-cca08c3a-a99c-4431-b6ee-b01bb70ab728 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] Creating volume 09df092a-5782-4416-b213-8f2075a71202 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:32:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-cca08c3a-a99c-4431-b6ee-b01bb70ab728 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:32:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-cca08c3a-a99c-4431-b6ee-b01bb70ab728 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:32:46 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-cca08c3a-a99c-4431-b6ee-b01bb70ab728 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:32:46 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-cca08c3a-a99c-4431-b6ee-b01bb70ab728 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:32:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-cca08c3a-a99c-4431-b6ee-b01bb70ab728 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:32:46 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-cca08c3a-a99c-4431-b6ee-b01bb70ab728 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:32:46 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-cca08c3a-a99c-4431-b6ee-b01bb70ab728 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:32:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-cca08c3a-a99c-4431-b6ee-b01bb70ab728 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-09df092a-5782-4416-b213-8f2075a71202 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:46 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd8109b9-ef40-4358-936c-e7fa3ffb770f tempest-CreateVolumesFromSnapshotTest-428000733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:32:46 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-cd8109b9-ef40-4358-936c-e7fa3ffb770f tempest-CreateVolumesFromSnapshotTest-428000733 None] Flow 'volume_create_manager' (05703d43-45fb-4591-9ac2-32e3c052daf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:32:46 devstack sudo[106262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-09df092a-5782-4416-b213-8f2075a71202 1073741824 Aug 05 10:32:46 devstack sudo[106262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:46 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-cd8109b9-ef40-4358-936c-e7fa3ffb770f tempest-CreateVolumesFromSnapshotTest-428000733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ff107bc-7876-4b50-be10-f67c591ad8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:46 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-cd8109b9-ef40-4358-936c-e7fa3ffb770f tempest-CreateVolumesFromSnapshotTest-428000733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ff107bc-7876-4b50-be10-f67c591ad8db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:32:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1070743642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4821834-840b-45f6-8574-24200d4fd73b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='247e12218ea4474e9ce4fca42a428274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:32:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:32:47Z,use_quota=True,user_id='b6ba55c537f94c5db6de4e02dea1ffa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:46 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-cd8109b9-ef40-4358-936c-e7fa3ffb770f tempest-CreateVolumesFromSnapshotTest-428000733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80632015-0175-4047-b7c0-dfab6db766fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:46 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-cd8109b9-ef40-4358-936c-e7fa3ffb770f tempest-CreateVolumesFromSnapshotTest-428000733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80632015-0175-4047-b7c0-dfab6db766fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:46 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-cd8109b9-ef40-4358-936c-e7fa3ffb770f tempest-CreateVolumesFromSnapshotTest-428000733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4783f083-d3a3-4898-90ed-4827e0d7deda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:46 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-cd8109b9-ef40-4358-936c-e7fa3ffb770f tempest-CreateVolumesFromSnapshotTest-428000733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4783f083-d3a3-4898-90ed-4827e0d7deda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4821834-840b-45f6-8574-24200d4fd73b', 'volume_name': 'volume-e4821834-840b-45f6-8574-24200d4fd73b', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:46 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-cd8109b9-ef40-4358-936c-e7fa3ffb770f tempest-CreateVolumesFromSnapshotTest-428000733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92a3db57-97ae-48ce-935f-d3a69668c572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:46 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-cd8109b9-ef40-4358-936c-e7fa3ffb770f tempest-CreateVolumesFromSnapshotTest-428000733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92a3db57-97ae-48ce-935f-d3a69668c572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:46 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-cd8109b9-ef40-4358-936c-e7fa3ffb770f tempest-CreateVolumesFromSnapshotTest-428000733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b396c795-7c3f-496e-8b62-4dd4f63e4f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:46 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-cd8109b9-ef40-4358-936c-e7fa3ffb770f tempest-CreateVolumesFromSnapshotTest-428000733 None] Volume e4821834-840b-45f6-8574-24200d4fd73b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4821834-840b-45f6-8574-24200d4fd73b', 'volume_size': 1} Aug 05 10:32:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-cd8109b9-ef40-4358-936c-e7fa3ffb770f tempest-CreateVolumesFromSnapshotTest-428000733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:32:46 devstack cinder-volume[88613]: DEBUG cinder.volume.volume_utils [None req-70f3456e-b5b4-480a-bc89-bc67166c504d tempest-VolumeImageDependencyTests-105585306 None] Attempting download of e6e4c250-1c96-42e4-a95e-16fad391b5be ((None, [{'url': 'file:///opt/stack/data/glance/images/e6e4c250-1c96-42e4-a95e-16fad391b5be', 'metadata': {}}])) to volume 8c91bc06-4c6d-497b-8b23-e8354f65fcb4. {{(pid=88613) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 05 10:32:46 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[07864952-7a66-44ed-a614-f393f7d8fdbc]: (4, 'raw') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:32:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-70f3456e-b5b4-480a-bc89-bc67166c504d tempest-VolumeImageDependencyTests-105585306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e6e4c250-1c96-42e4-a95e-16fad391b5be_vai_f5h9 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:46 devstack sudo[106260]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e8e10daf-cddc-471b-ba65-5ee1fd9856bf tempest-CreateVolumesFromImageTest-627372874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2eb504e2-e750-4c98-9fab-4856b7acbe21" returned: 0 in 0.336s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:47 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e8e10daf-cddc-471b-ba65-5ee1fd9856bf tempest-CreateVolumesFromImageTest-627372874 None] Lock "cinder-quobyte-2eb504e2-e750-4c98-9fab-4856b7acbe21" released by "delete_volume" :: held 0.889s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:32:47 devstack sudo[106264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e6e4c250-1c96-42e4-a95e-16fad391b5be_vai_f5h9 Aug 05 10:32:47 devstack sudo[106264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:47 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-e8e10daf-cddc-471b-ba65-5ee1fd9856bf tempest-CreateVolumesFromImageTest-627372874 None] Created reservations ['0ba95726-a807-4c1a-9b93-bef2dc26c89f', '818f2b23-6e76-4d78-9a1d-f1d449de4128', 'dfd5ed8c-2271-44c6-87bc-d1b6c24129cc', '7eecaeef-ccdd-4d7b-8831-ebfe96abb019'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:32:47 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-faf31e79-3163-48ec-aa62-9a8c50cf373c tempest-CreateVolumesFromSnapshotTest-428000733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:32:47 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-faf31e79-3163-48ec-aa62-9a8c50cf373c tempest-CreateVolumesFromSnapshotTest-428000733 None] Flow 'volume_create_manager' (5b41c6dc-e1e1-4121-a7fb-fb4fc1f2161f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:32:47 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-faf31e79-3163-48ec-aa62-9a8c50cf373c tempest-CreateVolumesFromSnapshotTest-428000733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5878e76-0045-4303-b2ca-7e0298cb6d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:47 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-faf31e79-3163-48ec-aa62-9a8c50cf373c tempest-CreateVolumesFromSnapshotTest-428000733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5878e76-0045-4303-b2ca-7e0298cb6d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:32:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-365626522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1406e22-a3f6-433d-9e63-6b1492c706a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='247e12218ea4474e9ce4fca42a428274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:32:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:32:47Z,use_quota=True,user_id='b6ba55c537f94c5db6de4e02dea1ffa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:47 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-faf31e79-3163-48ec-aa62-9a8c50cf373c tempest-CreateVolumesFromSnapshotTest-428000733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (776a22cc-a30b-4863-996c-196f8f82094e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:47 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-faf31e79-3163-48ec-aa62-9a8c50cf373c tempest-CreateVolumesFromSnapshotTest-428000733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (776a22cc-a30b-4863-996c-196f8f82094e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:47 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-faf31e79-3163-48ec-aa62-9a8c50cf373c tempest-CreateVolumesFromSnapshotTest-428000733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e41088b-3a2f-4d01-848e-764d7b5a4a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:47 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-faf31e79-3163-48ec-aa62-9a8c50cf373c tempest-CreateVolumesFromSnapshotTest-428000733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e41088b-3a2f-4d01-848e-764d7b5a4a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1406e22-a3f6-433d-9e63-6b1492c706a1', 'volume_name': 'volume-a1406e22-a3f6-433d-9e63-6b1492c706a1', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:47 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-faf31e79-3163-48ec-aa62-9a8c50cf373c tempest-CreateVolumesFromSnapshotTest-428000733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cc23693-2512-4231-8191-194685f382d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:47 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-faf31e79-3163-48ec-aa62-9a8c50cf373c tempest-CreateVolumesFromSnapshotTest-428000733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cc23693-2512-4231-8191-194685f382d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:47 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-faf31e79-3163-48ec-aa62-9a8c50cf373c tempest-CreateVolumesFromSnapshotTest-428000733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00f9f3c5-38f4-45e0-9281-cdbc4fb50e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:47 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-faf31e79-3163-48ec-aa62-9a8c50cf373c tempest-CreateVolumesFromSnapshotTest-428000733 None] Volume a1406e22-a3f6-433d-9e63-6b1492c706a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1406e22-a3f6-433d-9e63-6b1492c706a1', 'volume_size': 1} Aug 05 10:32:47 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-faf31e79-3163-48ec-aa62-9a8c50cf373c tempest-CreateVolumesFromSnapshotTest-428000733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:32:47 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-e8e10daf-cddc-471b-ba65-5ee1fd9856bf tempest-CreateVolumesFromImageTest-627372874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:32:47 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-e8e10daf-cddc-471b-ba65-5ee1fd9856bf tempest-CreateVolumesFromImageTest-627372874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:32:47 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-e8e10daf-cddc-471b-ba65-5ee1fd9856bf tempest-CreateVolumesFromImageTest-627372874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:32:47 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-e8e10daf-cddc-471b-ba65-5ee1fd9856bf tempest-CreateVolumesFromImageTest-627372874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:32:47 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-e8e10daf-cddc-471b-ba65-5ee1fd9856bf tempest-CreateVolumesFromImageTest-627372874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:32:47 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e8e10daf-cddc-471b-ba65-5ee1fd9856bf tempest-CreateVolumesFromImageTest-627372874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:47 devstack sudo[106262]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:47 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-cca08c3a-a99c-4431-b6ee-b01bb70ab728 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-09df092a-5782-4416-b213-8f2075a71202 1073741824" returned: 0 in 0.622s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:47 devstack sudo[106271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:32:47 devstack sudo[106271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:47 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-81ddf749-4271-49b5-b973-a185b547612b tempest-CreateVolumesFromImageTest-627372874 None] Acquiring lock "cinder-2a8122a2-73ab-493a-b3f4-b35414e39b2f-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:32:47 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-81ddf749-4271-49b5-b973-a185b547612b tempest-CreateVolumesFromImageTest-627372874 None] Lock "cinder-2a8122a2-73ab-493a-b3f4-b35414e39b2f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:32:47 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-cca08c3a-a99c-4431-b6ee-b01bb70ab728 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-09df092a-5782-4416-b213-8f2075a71202 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:47 devstack sudo[106264]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:47 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-70f3456e-b5b4-480a-bc89-bc67166c504d tempest-VolumeImageDependencyTests-105585306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e6e4c250-1c96-42e4-a95e-16fad391b5be_vai_f5h9" returned: 0 in 0.547s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:47 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-70f3456e-b5b4-480a-bc89-bc67166c504d tempest-VolumeImageDependencyTests-105585306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e6e4c250-1c96-42e4-a95e-16fad391b5be_vai_f5h9 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:47 devstack sudo[106275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-09df092a-5782-4416-b213-8f2075a71202 Aug 05 10:32:47 devstack sudo[106275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:47 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-81ddf749-4271-49b5-b973-a185b547612b tempest-CreateVolumesFromImageTest-627372874 None] Acquiring lock "cinder-quobyte-2a8122a2-73ab-493a-b3f4-b35414e39b2f" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:32:47 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-81ddf749-4271-49b5-b973-a185b547612b tempest-CreateVolumesFromImageTest-627372874 None] Lock "cinder-quobyte-2a8122a2-73ab-493a-b3f4-b35414e39b2f" acquired by "delete_volume" :: waited 0.033s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:32:47 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[d523c572-5b03-4166-ba9c-728e5b36729f]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:32:47 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-81ddf749-4271-49b5-b973-a185b547612b tempest-CreateVolumesFromImageTest-627372874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2a8122a2-73ab-493a-b3f4-b35414e39b2f {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:47 devstack sudo[106271]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:47 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e8e10daf-cddc-471b-ba65-5ee1fd9856bf tempest-CreateVolumesFromImageTest-627372874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.355s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:47 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-e8e10daf-cddc-471b-ba65-5ee1fd9856bf tempest-CreateVolumesFromImageTest-627372874 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:32:47 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-e8e10daf-cddc-471b-ba65-5ee1fd9856bf tempest-CreateVolumesFromImageTest-627372874 None] Deleted volume successfully. Aug 05 10:32:47 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e8e10daf-cddc-471b-ba65-5ee1fd9856bf tempest-CreateVolumesFromImageTest-627372874 None] Lock "cinder-2eb504e2-e750-4c98-9fab-4856b7acbe21-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:32:47 devstack sudo[106277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e6e4c250-1c96-42e4-a95e-16fad391b5be_vai_f5h9 Aug 05 10:32:47 devstack sudo[106277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:47 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dd04534-5d2f-43fd-8b58-c6e8793ce74b tempest-CreateVolumesFromSnapshotTest-428000733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:32:47 devstack sudo[106275]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:47 devstack sudo[106279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2a8122a2-73ab-493a-b3f4-b35414e39b2f Aug 05 10:32:47 devstack sudo[106279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:47 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-7dd04534-5d2f-43fd-8b58-c6e8793ce74b tempest-CreateVolumesFromSnapshotTest-428000733 None] Flow 'volume_create_manager' (1f7cc2a9-cd48-46e2-ae53-4784a9e2fb54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:32:47 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-7dd04534-5d2f-43fd-8b58-c6e8793ce74b tempest-CreateVolumesFromSnapshotTest-428000733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (478b5ec6-8ba6-498b-b413-a514e47fa2f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:47 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-cca08c3a-a99c-4431-b6ee-b01bb70ab728 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-09df092a-5782-4416-b213-8f2075a71202" returned: 0 in 0.409s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:47 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-cca08c3a-a99c-4431-b6ee-b01bb70ab728 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] <== create_volume: return (1124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:32:47 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-cca08c3a-a99c-4431-b6ee-b01bb70ab728 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:32:47 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-cd8109b9-ef40-4358-936c-e7fa3ffb770f tempest-CreateVolumesFromSnapshotTest-428000733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.998s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:32:47 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-cd8109b9-ef40-4358-936c-e7fa3ffb770f tempest-CreateVolumesFromSnapshotTest-428000733 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:32:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1070743642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4821834-840b-45f6-8574-24200d4fd73b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='247e12218ea4474e9ce4fca42a428274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:32:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:32:47Z,use_quota=True,user_id='b6ba55c537f94c5db6de4e02dea1ffa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:32:47 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-cd8109b9-ef40-4358-936c-e7fa3ffb770f tempest-CreateVolumesFromSnapshotTest-428000733 None] Creating volume e4821834-840b-45f6-8574-24200d4fd73b {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:32:47 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-cd8109b9-ef40-4358-936c-e7fa3ffb770f tempest-CreateVolumesFromSnapshotTest-428000733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:32:47 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-cd8109b9-ef40-4358-936c-e7fa3ffb770f tempest-CreateVolumesFromSnapshotTest-428000733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:32:47 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-cd8109b9-ef40-4358-936c-e7fa3ffb770f tempest-CreateVolumesFromSnapshotTest-428000733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:32:47 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-cd8109b9-ef40-4358-936c-e7fa3ffb770f tempest-CreateVolumesFromSnapshotTest-428000733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:32:47 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-cd8109b9-ef40-4358-936c-e7fa3ffb770f tempest-CreateVolumesFromSnapshotTest-428000733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:32:47 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-cd8109b9-ef40-4358-936c-e7fa3ffb770f tempest-CreateVolumesFromSnapshotTest-428000733 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:32:47 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-cd8109b9-ef40-4358-936c-e7fa3ffb770f tempest-CreateVolumesFromSnapshotTest-428000733 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:32:47 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-cd8109b9-ef40-4358-936c-e7fa3ffb770f tempest-CreateVolumesFromSnapshotTest-428000733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e4821834-840b-45f6-8574-24200d4fd73b 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:47 devstack sudo[106283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e4821834-840b-45f6-8574-24200d4fd73b 1073741824 Aug 05 10:32:47 devstack sudo[106283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:47 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-7dd04534-5d2f-43fd-8b58-c6e8793ce74b tempest-CreateVolumesFromSnapshotTest-428000733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (478b5ec6-8ba6-498b-b413-a514e47fa2f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:32:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-891324869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08b633af-3ea1-48c4-bcbf-8bb5dab38ed1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='247e12218ea4474e9ce4fca42a428274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:32:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:32:48Z,use_quota=True,user_id='b6ba55c537f94c5db6de4e02dea1ffa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:47 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-7dd04534-5d2f-43fd-8b58-c6e8793ce74b tempest-CreateVolumesFromSnapshotTest-428000733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (718caf34-7d68-40e5-81c3-18c4080dfc36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:47 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-7dd04534-5d2f-43fd-8b58-c6e8793ce74b tempest-CreateVolumesFromSnapshotTest-428000733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (718caf34-7d68-40e5-81c3-18c4080dfc36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:47 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-7dd04534-5d2f-43fd-8b58-c6e8793ce74b tempest-CreateVolumesFromSnapshotTest-428000733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5645334f-8328-41d9-a7e9-661804d3cbb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:47 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-7dd04534-5d2f-43fd-8b58-c6e8793ce74b tempest-CreateVolumesFromSnapshotTest-428000733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5645334f-8328-41d9-a7e9-661804d3cbb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08b633af-3ea1-48c4-bcbf-8bb5dab38ed1', 'volume_name': 'volume-08b633af-3ea1-48c4-bcbf-8bb5dab38ed1', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:47 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-7dd04534-5d2f-43fd-8b58-c6e8793ce74b tempest-CreateVolumesFromSnapshotTest-428000733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35725a83-7c22-437c-b413-3174f54eafaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:47 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-7dd04534-5d2f-43fd-8b58-c6e8793ce74b tempest-CreateVolumesFromSnapshotTest-428000733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35725a83-7c22-437c-b413-3174f54eafaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:47 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-7dd04534-5d2f-43fd-8b58-c6e8793ce74b tempest-CreateVolumesFromSnapshotTest-428000733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd08d998-decc-457b-8565-41766a616ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:47 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-7dd04534-5d2f-43fd-8b58-c6e8793ce74b tempest-CreateVolumesFromSnapshotTest-428000733 None] Volume 08b633af-3ea1-48c4-bcbf-8bb5dab38ed1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08b633af-3ea1-48c4-bcbf-8bb5dab38ed1', 'volume_size': 1} Aug 05 10:32:47 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-7dd04534-5d2f-43fd-8b58-c6e8793ce74b tempest-CreateVolumesFromSnapshotTest-428000733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:32:47 devstack cinder-volume[88613]: DEBUG cinder.volume.volume_utils [None req-cca08c3a-a99c-4431-b6ee-b01bb70ab728 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] Attempting download of b517e5f6-c4b4-4637-a1d5-f184ed429b6d ((None, [{'url': 'file:///opt/stack/data/glance/images/b517e5f6-c4b4-4637-a1d5-f184ed429b6d', 'metadata': {}}])) to volume 09df092a-5782-4416-b213-8f2075a71202. {{(pid=88613) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 05 10:32:47 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc9eb56-f890-4c60-8c6e-3643e2ea25da]: (4, 'raw') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:32:47 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-cca08c3a-a99c-4431-b6ee-b01bb70ab728 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b517e5f6-c4b4-4637-a1d5-f184ed429b6d_6neov3yz {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:48 devstack sudo[106285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b517e5f6-c4b4-4637-a1d5-f184ed429b6d_6neov3yz Aug 05 10:32:48 devstack sudo[106285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:48 devstack sudo[106277]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:48 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-70f3456e-b5b4-480a-bc89-bc67166c504d tempest-VolumeImageDependencyTests-105585306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e6e4c250-1c96-42e4-a95e-16fad391b5be_vai_f5h9" returned: 1 in 0.668s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:48 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-70f3456e-b5b4-480a-bc89-bc67166c504d tempest-VolumeImageDependencyTests-105585306 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e6e4c250-1c96-42e4-a95e-16fad391b5be_vai_f5h9' failed. Not Retrying. {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 10:32:48 devstack sudo[106279]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:48 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7e194e-0c1a-4dab-862c-42ea0eb42d8e]: (4, 'raw') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:32:48 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-70f3456e-b5b4-480a-bc89-bc67166c504d tempest-VolumeImageDependencyTests-105585306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e6e4c250-1c96-42e4-a95e-16fad391b5be_qmazt7dxdevstack@QuobyteHD {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:48 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-81ddf749-4271-49b5-b973-a185b547612b tempest-CreateVolumesFromImageTest-627372874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2a8122a2-73ab-493a-b3f4-b35414e39b2f" returned: 0 in 0.498s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:48 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-81ddf749-4271-49b5-b973-a185b547612b tempest-CreateVolumesFromImageTest-627372874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2a8122a2-73ab-493a-b3f4-b35414e39b2f {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:48 devstack sudo[106293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2a8122a2-73ab-493a-b3f4-b35414e39b2f Aug 05 10:32:48 devstack sudo[106293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:48 devstack sudo[106292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e6e4c250-1c96-42e4-a95e-16fad391b5be_qmazt7dxdevstack@QuobyteHD Aug 05 10:32:48 devstack sudo[106292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:48 devstack sudo[106285]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:48 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-cca08c3a-a99c-4431-b6ee-b01bb70ab728 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b517e5f6-c4b4-4637-a1d5-f184ed429b6d_6neov3yz" returned: 0 in 0.475s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:48 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-cca08c3a-a99c-4431-b6ee-b01bb70ab728 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b517e5f6-c4b4-4637-a1d5-f184ed429b6d_6neov3yz {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:48 devstack sudo[106292]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:48 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-70f3456e-b5b4-480a-bc89-bc67166c504d tempest-VolumeImageDependencyTests-105585306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e6e4c250-1c96-42e4-a95e-16fad391b5be_qmazt7dxdevstack@QuobyteHD" returned: 0 in 0.441s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:48 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-70f3456e-b5b4-480a-bc89-bc67166c504d tempest-VolumeImageDependencyTests-105585306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e6e4c250-1c96-42e4-a95e-16fad391b5be_qmazt7dxdevstack@QuobyteHD {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:48 devstack sudo[106283]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:48 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-cd8109b9-ef40-4358-936c-e7fa3ffb770f tempest-CreateVolumesFromSnapshotTest-428000733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e4821834-840b-45f6-8574-24200d4fd73b 1073741824" returned: 0 in 0.771s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:48 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-cd8109b9-ef40-4358-936c-e7fa3ffb770f tempest-CreateVolumesFromSnapshotTest-428000733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e4821834-840b-45f6-8574-24200d4fd73b {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:48 devstack sudo[106293]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:48 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-81ddf749-4271-49b5-b973-a185b547612b tempest-CreateVolumesFromImageTest-627372874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-2a8122a2-73ab-493a-b3f4-b35414e39b2f" returned: 0 in 0.565s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:48 devstack sudo[106305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e6e4c250-1c96-42e4-a95e-16fad391b5be_qmazt7dxdevstack@QuobyteHD Aug 05 10:32:48 devstack sudo[106305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:48 devstack sudo[106306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e4821834-840b-45f6-8574-24200d4fd73b Aug 05 10:32:48 devstack sudo[106306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:48 devstack sudo[106301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b517e5f6-c4b4-4637-a1d5-f184ed429b6d_6neov3yz Aug 05 10:32:48 devstack sudo[106301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:48 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-81ddf749-4271-49b5-b973-a185b547612b tempest-CreateVolumesFromImageTest-627372874 None] Lock "cinder-quobyte-2a8122a2-73ab-493a-b3f4-b35414e39b2f" released by "delete_volume" :: held 1.181s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:32:48 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-795821ca-1dc9-4b29-9382-ac96f96bb01f tempest-CreateVolumesFromSnapshotTest-428000733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:32:48 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-795821ca-1dc9-4b29-9382-ac96f96bb01f tempest-CreateVolumesFromSnapshotTest-428000733 None] Flow 'volume_create_manager' (c6faa1c8-d03f-429d-9330-d74e4a51c778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:32:48 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-795821ca-1dc9-4b29-9382-ac96f96bb01f tempest-CreateVolumesFromSnapshotTest-428000733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5920679-1853-4a4e-9b58-3269e70eeca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:48 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-795821ca-1dc9-4b29-9382-ac96f96bb01f tempest-CreateVolumesFromSnapshotTest-428000733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5920679-1853-4a4e-9b58-3269e70eeca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:32:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-143079943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62f867d2-3667-4ad2-b6e5-2dc93e699ac1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='247e12218ea4474e9ce4fca42a428274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:32:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:32:49Z,use_quota=True,user_id='b6ba55c537f94c5db6de4e02dea1ffa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:48 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-795821ca-1dc9-4b29-9382-ac96f96bb01f tempest-CreateVolumesFromSnapshotTest-428000733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3367dd0-4002-4c5b-be3a-1db3f148b374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:48 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-795821ca-1dc9-4b29-9382-ac96f96bb01f tempest-CreateVolumesFromSnapshotTest-428000733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3367dd0-4002-4c5b-be3a-1db3f148b374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:48 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-795821ca-1dc9-4b29-9382-ac96f96bb01f tempest-CreateVolumesFromSnapshotTest-428000733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48a93145-ea3f-4d1a-a03f-7015695716b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:48 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-795821ca-1dc9-4b29-9382-ac96f96bb01f tempest-CreateVolumesFromSnapshotTest-428000733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48a93145-ea3f-4d1a-a03f-7015695716b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62f867d2-3667-4ad2-b6e5-2dc93e699ac1', 'volume_name': 'volume-62f867d2-3667-4ad2-b6e5-2dc93e699ac1', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:48 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-795821ca-1dc9-4b29-9382-ac96f96bb01f tempest-CreateVolumesFromSnapshotTest-428000733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12b1c1a1-ecad-4611-97c4-3babeb14d6cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:48 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-795821ca-1dc9-4b29-9382-ac96f96bb01f tempest-CreateVolumesFromSnapshotTest-428000733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12b1c1a1-ecad-4611-97c4-3babeb14d6cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:48 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-795821ca-1dc9-4b29-9382-ac96f96bb01f tempest-CreateVolumesFromSnapshotTest-428000733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbfbb825-0b15-4103-bc66-82d5cfeb7de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:48 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-795821ca-1dc9-4b29-9382-ac96f96bb01f tempest-CreateVolumesFromSnapshotTest-428000733 None] Volume 62f867d2-3667-4ad2-b6e5-2dc93e699ac1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62f867d2-3667-4ad2-b6e5-2dc93e699ac1', 'volume_size': 1} Aug 05 10:32:48 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-795821ca-1dc9-4b29-9382-ac96f96bb01f tempest-CreateVolumesFromSnapshotTest-428000733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:32:49 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-81ddf749-4271-49b5-b973-a185b547612b tempest-CreateVolumesFromImageTest-627372874 None] Created reservations ['df0d2126-5550-44fe-a244-c86dae8d3845', '2252d902-8cc9-45dd-9871-c652abbd1aed', 'c23c361a-8538-4261-92d2-ae7c43eabe51', 'a42c6c9d-df5d-41e8-a081-98a2218edc7c'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:32:49 devstack sudo[106305]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-70f3456e-b5b4-480a-bc89-bc67166c504d tempest-VolumeImageDependencyTests-105585306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e6e4c250-1c96-42e4-a95e-16fad391b5be_qmazt7dxdevstack@QuobyteHD" returned: 1 in 0.535s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-70f3456e-b5b4-480a-bc89-bc67166c504d tempest-VolumeImageDependencyTests-105585306 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e6e4c250-1c96-42e4-a95e-16fad391b5be_qmazt7dxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 10:32:49 devstack cinder-volume[88613]: DEBUG cinder.image.image_utils [None req-70f3456e-b5b4-480a-bc89-bc67166c504d tempest-VolumeImageDependencyTests-105585306 None] e6e4c250-1c96-42e4-a95e-16fad391b5be was raw, converting to qcow2 {{(pid=88613) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 05 10:32:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-70f3456e-b5b4-480a-bc89-bc67166c504d tempest-VolumeImageDependencyTests-105585306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e6e4c250-1c96-42e4-a95e-16fad391b5be_qmazt7dxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8c91bc06-4c6d-497b-8b23-e8354f65fcb4 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:49 devstack sudo[106306]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:49 devstack sudo[106301]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-cca08c3a-a99c-4431-b6ee-b01bb70ab728 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b517e5f6-c4b4-4637-a1d5-f184ed429b6d_6neov3yz" returned: 1 in 0.694s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-cca08c3a-a99c-4431-b6ee-b01bb70ab728 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b517e5f6-c4b4-4637-a1d5-f184ed429b6d_6neov3yz' failed. Not Retrying. {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 10:32:49 devstack sudo[106316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e6e4c250-1c96-42e4-a95e-16fad391b5be_qmazt7dxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8c91bc06-4c6d-497b-8b23-e8354f65fcb4 Aug 05 10:32:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-cd8109b9-ef40-4358-936c-e7fa3ffb770f tempest-CreateVolumesFromSnapshotTest-428000733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e4821834-840b-45f6-8574-24200d4fd73b" returned: 0 in 0.482s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:49 devstack sudo[106316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:49 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-cd8109b9-ef40-4358-936c-e7fa3ffb770f tempest-CreateVolumesFromSnapshotTest-428000733 None] <== create_volume: return (1331ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:32:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-cd8109b9-ef40-4358-936c-e7fa3ffb770f tempest-CreateVolumesFromSnapshotTest-428000733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.333s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:32:49 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2aaf037-140d-4a22-a684-d1a224da2495]: (4, 'raw') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:32:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-faf31e79-3163-48ec-aa62-9a8c50cf373c tempest-CreateVolumesFromSnapshotTest-428000733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.884s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:32:49 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-faf31e79-3163-48ec-aa62-9a8c50cf373c tempest-CreateVolumesFromSnapshotTest-428000733 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:32:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-365626522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1406e22-a3f6-433d-9e63-6b1492c706a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='247e12218ea4474e9ce4fca42a428274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:32:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:32:47Z,use_quota=True,user_id='b6ba55c537f94c5db6de4e02dea1ffa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:32:49 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-faf31e79-3163-48ec-aa62-9a8c50cf373c tempest-CreateVolumesFromSnapshotTest-428000733 None] Creating volume a1406e22-a3f6-433d-9e63-6b1492c706a1 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:32:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-faf31e79-3163-48ec-aa62-9a8c50cf373c tempest-CreateVolumesFromSnapshotTest-428000733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:32:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-faf31e79-3163-48ec-aa62-9a8c50cf373c tempest-CreateVolumesFromSnapshotTest-428000733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:32:49 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-faf31e79-3163-48ec-aa62-9a8c50cf373c tempest-CreateVolumesFromSnapshotTest-428000733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:32:49 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-faf31e79-3163-48ec-aa62-9a8c50cf373c tempest-CreateVolumesFromSnapshotTest-428000733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:32:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-faf31e79-3163-48ec-aa62-9a8c50cf373c tempest-CreateVolumesFromSnapshotTest-428000733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:32:49 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-faf31e79-3163-48ec-aa62-9a8c50cf373c tempest-CreateVolumesFromSnapshotTest-428000733 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:32:49 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-faf31e79-3163-48ec-aa62-9a8c50cf373c tempest-CreateVolumesFromSnapshotTest-428000733 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:32:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-faf31e79-3163-48ec-aa62-9a8c50cf373c tempest-CreateVolumesFromSnapshotTest-428000733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a1406e22-a3f6-433d-9e63-6b1492c706a1 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-cca08c3a-a99c-4431-b6ee-b01bb70ab728 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b517e5f6-c4b4-4637-a1d5-f184ed429b6d_0xjg64n7devstack@QuobyteHD {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:49 devstack sudo[106318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a1406e22-a3f6-433d-9e63-6b1492c706a1 1073741824 Aug 05 10:32:49 devstack sudo[106318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:49 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-cd8109b9-ef40-4358-936c-e7fa3ffb770f tempest-CreateVolumesFromSnapshotTest-428000733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b396c795-7c3f-496e-8b62-4dd4f63e4f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4821834-840b-45f6-8574-24200d4fd73b', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:49 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-cd8109b9-ef40-4358-936c-e7fa3ffb770f tempest-CreateVolumesFromSnapshotTest-428000733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b9c4b95-afed-44f1-85d5-50d3505f1dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-81ddf749-4271-49b5-b973-a185b547612b tempest-CreateVolumesFromImageTest-627372874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:32:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-81ddf749-4271-49b5-b973-a185b547612b tempest-CreateVolumesFromImageTest-627372874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:32:49 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-81ddf749-4271-49b5-b973-a185b547612b tempest-CreateVolumesFromImageTest-627372874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:32:49 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-81ddf749-4271-49b5-b973-a185b547612b tempest-CreateVolumesFromImageTest-627372874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:32:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-81ddf749-4271-49b5-b973-a185b547612b tempest-CreateVolumesFromImageTest-627372874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:32:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-81ddf749-4271-49b5-b973-a185b547612b tempest-CreateVolumesFromImageTest-627372874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:49 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-0257210f-9836-41c8-839c-492131b085b4 tempest-CreateVolumesFromSnapshotTest-428000733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:32:49 devstack sudo[106319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b517e5f6-c4b4-4637-a1d5-f184ed429b6d_0xjg64n7devstack@QuobyteHD Aug 05 10:32:49 devstack sudo[106319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:49 devstack sudo[106321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:32:49 devstack sudo[106321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:49 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0257210f-9836-41c8-839c-492131b085b4 tempest-CreateVolumesFromSnapshotTest-428000733 None] Flow 'volume_create_manager' (e700186c-d418-4f4b-b029-1a847c6a4d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:32:49 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0257210f-9836-41c8-839c-492131b085b4 tempest-CreateVolumesFromSnapshotTest-428000733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2c867f8-8182-4dc5-8b7a-2cb5b4c00cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:49 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-cd8109b9-ef40-4358-936c-e7fa3ffb770f tempest-CreateVolumesFromSnapshotTest-428000733 None] Volume volume-e4821834-840b-45f6-8574-24200d4fd73b (e4821834-840b-45f6-8574-24200d4fd73b): created successfully Aug 05 10:32:49 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-cd8109b9-ef40-4358-936c-e7fa3ffb770f tempest-CreateVolumesFromSnapshotTest-428000733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b9c4b95-afed-44f1-85d5-50d3505f1dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:49 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-cd8109b9-ef40-4358-936c-e7fa3ffb770f tempest-CreateVolumesFromSnapshotTest-428000733 None] Flow 'volume_create_manager' (05703d43-45fb-4591-9ac2-32e3c052daf9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:32:49 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-cd8109b9-ef40-4358-936c-e7fa3ffb770f tempest-CreateVolumesFromSnapshotTest-428000733 None] Created volume successfully. Aug 05 10:32:49 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0257210f-9836-41c8-839c-492131b085b4 tempest-CreateVolumesFromSnapshotTest-428000733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2c867f8-8182-4dc5-8b7a-2cb5b4c00cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:32:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1699817549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0234cae-c056-4ef3-ae6c-8b25aea75468,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='247e12218ea4474e9ce4fca42a428274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:32:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:32:49Z,use_quota=True,user_id='b6ba55c537f94c5db6de4e02dea1ffa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:49 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0257210f-9836-41c8-839c-492131b085b4 tempest-CreateVolumesFromSnapshotTest-428000733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0aade9b7-92b3-4ceb-a44a-469d63e3a7fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:49 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0257210f-9836-41c8-839c-492131b085b4 tempest-CreateVolumesFromSnapshotTest-428000733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0aade9b7-92b3-4ceb-a44a-469d63e3a7fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:49 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0257210f-9836-41c8-839c-492131b085b4 tempest-CreateVolumesFromSnapshotTest-428000733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df770706-ae70-486c-afb4-3480fb020292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:49 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0257210f-9836-41c8-839c-492131b085b4 tempest-CreateVolumesFromSnapshotTest-428000733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df770706-ae70-486c-afb4-3480fb020292) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0234cae-c056-4ef3-ae6c-8b25aea75468', 'volume_name': 'volume-f0234cae-c056-4ef3-ae6c-8b25aea75468', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:49 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0257210f-9836-41c8-839c-492131b085b4 tempest-CreateVolumesFromSnapshotTest-428000733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0c00343-e13e-4f4b-a664-400b498a4a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:49 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0257210f-9836-41c8-839c-492131b085b4 tempest-CreateVolumesFromSnapshotTest-428000733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0c00343-e13e-4f4b-a664-400b498a4a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:49 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0257210f-9836-41c8-839c-492131b085b4 tempest-CreateVolumesFromSnapshotTest-428000733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b108aa56-7d87-47f8-90e9-d293eec836be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:49 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-0257210f-9836-41c8-839c-492131b085b4 tempest-CreateVolumesFromSnapshotTest-428000733 None] Volume f0234cae-c056-4ef3-ae6c-8b25aea75468: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0234cae-c056-4ef3-ae6c-8b25aea75468', 'volume_size': 1} Aug 05 10:32:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-0257210f-9836-41c8-839c-492131b085b4 tempest-CreateVolumesFromSnapshotTest-428000733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:32:49 devstack sudo[106321]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-81ddf749-4271-49b5-b973-a185b547612b tempest-CreateVolumesFromImageTest-627372874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.291s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:49 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-81ddf749-4271-49b5-b973-a185b547612b tempest-CreateVolumesFromImageTest-627372874 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:32:49 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-81ddf749-4271-49b5-b973-a185b547612b tempest-CreateVolumesFromImageTest-627372874 None] Deleted volume successfully. Aug 05 10:32:49 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-81ddf749-4271-49b5-b973-a185b547612b tempest-CreateVolumesFromImageTest-627372874 None] Lock "cinder-2a8122a2-73ab-493a-b3f4-b35414e39b2f-delete_volume" released by "delete_volume" :: held 2.201s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:32:49 devstack sudo[106319]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-cca08c3a-a99c-4431-b6ee-b01bb70ab728 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b517e5f6-c4b4-4637-a1d5-f184ed429b6d_0xjg64n7devstack@QuobyteHD" returned: 0 in 0.423s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-cca08c3a-a99c-4431-b6ee-b01bb70ab728 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b517e5f6-c4b4-4637-a1d5-f184ed429b6d_0xjg64n7devstack@QuobyteHD {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:49 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d811182c-6793-41a6-889d-5885fb5c17f3 tempest-CreateVolumesFromImageTest-627372874 None] Acquiring lock "cinder-8e817bfd-08a8-47e9-a14d-215f4045b468-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:32:49 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d811182c-6793-41a6-889d-5885fb5c17f3 tempest-CreateVolumesFromImageTest-627372874 None] Lock "cinder-8e817bfd-08a8-47e9-a14d-215f4045b468-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:32:49 devstack sudo[106333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b517e5f6-c4b4-4637-a1d5-f184ed429b6d_0xjg64n7devstack@QuobyteHD Aug 05 10:32:49 devstack sudo[106333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:49 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d811182c-6793-41a6-889d-5885fb5c17f3 tempest-CreateVolumesFromImageTest-627372874 None] Acquiring lock "cinder-quobyte-8e817bfd-08a8-47e9-a14d-215f4045b468" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:32:49 devstack sudo[106316]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-70f3456e-b5b4-480a-bc89-bc67166c504d tempest-VolumeImageDependencyTests-105585306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e6e4c250-1c96-42e4-a95e-16fad391b5be_qmazt7dxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8c91bc06-4c6d-497b-8b23-e8354f65fcb4" returned: 0 in 0.691s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:49 devstack cinder-volume[88613]: DEBUG cinder.image.image_utils [None req-70f3456e-b5b4-480a-bc89-bc67166c504d tempest-VolumeImageDependencyTests-105585306 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e6e4c250-1c96-42e4-a95e-16fad391b5be_qmazt7dxdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8c91bc06-4c6d-497b-8b23-e8354f65fcb4 {{(pid=88613) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 10:32:49 devstack cinder-volume[88613]: INFO cinder.image.image_utils [None req-70f3456e-b5b4-480a-bc89-bc67166c504d tempest-VolumeImageDependencyTests-105585306 None] Converted 0.00 MB image at 0.00 MB/s Aug 05 10:32:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-70f3456e-b5b4-480a-bc89-bc67166c504d tempest-VolumeImageDependencyTests-105585306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8c91bc06-4c6d-497b-8b23-e8354f65fcb4 1G {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:49 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d811182c-6793-41a6-889d-5885fb5c17f3 tempest-CreateVolumesFromImageTest-627372874 None] Lock "cinder-quobyte-8e817bfd-08a8-47e9-a14d-215f4045b468" acquired by "delete_volume" :: waited 0.049s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:32:49 devstack sudo[106337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8c91bc06-4c6d-497b-8b23-e8354f65fcb4 1G Aug 05 10:32:49 devstack sudo[106337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:49 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[633ec8b8-9143-459e-8134-2178256dfb7b]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:32:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d811182c-6793-41a6-889d-5885fb5c17f3 tempest-CreateVolumesFromImageTest-627372874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e817bfd-08a8-47e9-a14d-215f4045b468 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:49 devstack sudo[106318]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-faf31e79-3163-48ec-aa62-9a8c50cf373c tempest-CreateVolumesFromSnapshotTest-428000733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a1406e22-a3f6-433d-9e63-6b1492c706a1 1073741824" returned: 0 in 0.723s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-faf31e79-3163-48ec-aa62-9a8c50cf373c tempest-CreateVolumesFromSnapshotTest-428000733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a1406e22-a3f6-433d-9e63-6b1492c706a1 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:49 devstack sudo[106340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a1406e22-a3f6-433d-9e63-6b1492c706a1 Aug 05 10:32:49 devstack sudo[106340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:50 devstack sudo[106339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e817bfd-08a8-47e9-a14d-215f4045b468 Aug 05 10:32:50 devstack sudo[106339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:50 devstack sudo[106333]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-cca08c3a-a99c-4431-b6ee-b01bb70ab728 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b517e5f6-c4b4-4637-a1d5-f184ed429b6d_0xjg64n7devstack@QuobyteHD" returned: 1 in 0.453s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-cca08c3a-a99c-4431-b6ee-b01bb70ab728 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b517e5f6-c4b4-4637-a1d5-f184ed429b6d_0xjg64n7devstack@QuobyteHD' failed. Not Retrying. {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 10:32:50 devstack cinder-volume[88613]: DEBUG cinder.image.image_utils [None req-cca08c3a-a99c-4431-b6ee-b01bb70ab728 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] b517e5f6-c4b4-4637-a1d5-f184ed429b6d was raw, converting to qcow2 {{(pid=88613) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 05 10:32:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-cca08c3a-a99c-4431-b6ee-b01bb70ab728 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b517e5f6-c4b4-4637-a1d5-f184ed429b6d_0xjg64n7devstack@QuobyteHD /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-09df092a-5782-4416-b213-8f2075a71202 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:50 devstack sudo[106347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b517e5f6-c4b4-4637-a1d5-f184ed429b6d_0xjg64n7devstack@QuobyteHD /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-09df092a-5782-4416-b213-8f2075a71202 Aug 05 10:32:50 devstack sudo[106347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:50 devstack sudo[106337]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-70f3456e-b5b4-480a-bc89-bc67166c504d tempest-VolumeImageDependencyTests-105585306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8c91bc06-4c6d-497b-8b23-e8354f65fcb4 1G" returned: 0 in 0.414s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:50 devstack cinder-volume[88613]: DEBUG cinder.volume.volume_utils [None req-70f3456e-b5b4-480a-bc89-bc67166c504d tempest-VolumeImageDependencyTests-105585306 None] Downloaded image e6e4c250-1c96-42e4-a95e-16fad391b5be ((None, [{'url': 'file:///opt/stack/data/glance/images/e6e4c250-1c96-42e4-a95e-16fad391b5be', 'metadata': {}}])) to volume 8c91bc06-4c6d-497b-8b23-e8354f65fcb4 successfully. {{(pid=88613) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 05 10:32:50 devstack cinder-volume[88613]: DEBUG cinder.image.image_utils [None req-70f3456e-b5b4-480a-bc89-bc67166c504d tempest-VolumeImageDependencyTests-105585306 None] Temporary image e6e4c250-1c96-42e4-a95e-16fad391b5be for user fddf904c8b4648499cd3d4388b5a613c is deleted. {{(pid=88613) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 05 10:32:50 devstack cinder-volume[88613]: DEBUG cinder.volume.volume_utils [None req-70f3456e-b5b4-480a-bc89-bc67166c504d tempest-VolumeImageDependencyTests-105585306 None] Marking volume 8c91bc06-4c6d-497b-8b23-e8354f65fcb4 as bootable. {{(pid=88613) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 05 10:32:50 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-70f3456e-b5b4-480a-bc89-bc67166c504d tempest-VolumeImageDependencyTests-105585306 None] Copying metadata from image e6e4c250-1c96-42e4-a95e-16fad391b5be to 8c91bc06-4c6d-497b-8b23-e8354f65fcb4. {{(pid=88613) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 05 10:32:50 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-70f3456e-b5b4-480a-bc89-bc67166c504d tempest-VolumeImageDependencyTests-105585306 None] Creating volume glance metadata for volume 8c91bc06-4c6d-497b-8b23-e8354f65fcb4 backed by image e6e4c250-1c96-42e4-a95e-16fad391b5be with: {'image_id': 'e6e4c250-1c96-42e4-a95e-16fad391b5be', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'a78202f6b64dc26f96b8bedd54f1e92a', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88613) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 05 10:32:50 devstack sudo[106340]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-faf31e79-3163-48ec-aa62-9a8c50cf373c tempest-CreateVolumesFromSnapshotTest-428000733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a1406e22-a3f6-433d-9e63-6b1492c706a1" returned: 0 in 0.320s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:50 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-faf31e79-3163-48ec-aa62-9a8c50cf373c tempest-CreateVolumesFromSnapshotTest-428000733 None] <== create_volume: return (1117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:32:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-faf31e79-3163-48ec-aa62-9a8c50cf373c tempest-CreateVolumesFromSnapshotTest-428000733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.119s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:32:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-7dd04534-5d2f-43fd-8b58-c6e8793ce74b tempest-CreateVolumesFromSnapshotTest-428000733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.373s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:32:50 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-7dd04534-5d2f-43fd-8b58-c6e8793ce74b tempest-CreateVolumesFromSnapshotTest-428000733 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:32:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-891324869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08b633af-3ea1-48c4-bcbf-8bb5dab38ed1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='247e12218ea4474e9ce4fca42a428274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:32:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:32:48Z,use_quota=True,user_id='b6ba55c537f94c5db6de4e02dea1ffa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:32:50 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-7dd04534-5d2f-43fd-8b58-c6e8793ce74b tempest-CreateVolumesFromSnapshotTest-428000733 None] Creating volume 08b633af-3ea1-48c4-bcbf-8bb5dab38ed1 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:32:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-7dd04534-5d2f-43fd-8b58-c6e8793ce74b tempest-CreateVolumesFromSnapshotTest-428000733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:32:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-7dd04534-5d2f-43fd-8b58-c6e8793ce74b tempest-CreateVolumesFromSnapshotTest-428000733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:32:50 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-7dd04534-5d2f-43fd-8b58-c6e8793ce74b tempest-CreateVolumesFromSnapshotTest-428000733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:32:50 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-7dd04534-5d2f-43fd-8b58-c6e8793ce74b tempest-CreateVolumesFromSnapshotTest-428000733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:32:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-7dd04534-5d2f-43fd-8b58-c6e8793ce74b tempest-CreateVolumesFromSnapshotTest-428000733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:32:50 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-7dd04534-5d2f-43fd-8b58-c6e8793ce74b tempest-CreateVolumesFromSnapshotTest-428000733 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:32:50 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-7dd04534-5d2f-43fd-8b58-c6e8793ce74b tempest-CreateVolumesFromSnapshotTest-428000733 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:32:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7dd04534-5d2f-43fd-8b58-c6e8793ce74b tempest-CreateVolumesFromSnapshotTest-428000733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-08b633af-3ea1-48c4-bcbf-8bb5dab38ed1 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:50 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-faf31e79-3163-48ec-aa62-9a8c50cf373c tempest-CreateVolumesFromSnapshotTest-428000733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00f9f3c5-38f4-45e0-9281-cdbc4fb50e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1406e22-a3f6-433d-9e63-6b1492c706a1', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:50 devstack sudo[106355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-08b633af-3ea1-48c4-bcbf-8bb5dab38ed1 1073741824 Aug 05 10:32:50 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-faf31e79-3163-48ec-aa62-9a8c50cf373c tempest-CreateVolumesFromSnapshotTest-428000733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3243a222-8404-4f88-bd0c-1c40cb3b07f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:50 devstack sudo[106355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:50 devstack sudo[106339]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d811182c-6793-41a6-889d-5885fb5c17f3 tempest-CreateVolumesFromImageTest-627372874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e817bfd-08a8-47e9-a14d-215f4045b468" returned: 0 in 0.470s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d811182c-6793-41a6-889d-5885fb5c17f3 tempest-CreateVolumesFromImageTest-627372874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e817bfd-08a8-47e9-a14d-215f4045b468 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:50 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-faf31e79-3163-48ec-aa62-9a8c50cf373c tempest-CreateVolumesFromSnapshotTest-428000733 None] Volume volume-a1406e22-a3f6-433d-9e63-6b1492c706a1 (a1406e22-a3f6-433d-9e63-6b1492c706a1): created successfully Aug 05 10:32:50 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-faf31e79-3163-48ec-aa62-9a8c50cf373c tempest-CreateVolumesFromSnapshotTest-428000733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3243a222-8404-4f88-bd0c-1c40cb3b07f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:50 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-faf31e79-3163-48ec-aa62-9a8c50cf373c tempest-CreateVolumesFromSnapshotTest-428000733 None] Flow 'volume_create_manager' (5b41c6dc-e1e1-4121-a7fb-fb4fc1f2161f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:32:50 devstack sudo[106359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e817bfd-08a8-47e9-a14d-215f4045b468 Aug 05 10:32:50 devstack sudo[106359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:50 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-faf31e79-3163-48ec-aa62-9a8c50cf373c tempest-CreateVolumesFromSnapshotTest-428000733 None] Created volume successfully. Aug 05 10:32:50 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-70f3456e-b5b4-480a-bc89-bc67166c504d tempest-VolumeImageDependencyTests-105585306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bab12773-263e-42d4-9c17-18b4b99e1bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c91bc06-4c6d-497b-8b23-e8354f65fcb4', 'volume_size': 1, 'image_id': 'e6e4c250-1c96-42e4-a95e-16fad391b5be', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e6e4c250-1c96-42e4-a95e-16fad391b5be', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a78202f6b64dc26f96b8bedd54f1e92a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cbde55f8138a4c958d29dc90c2ba5f37', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ec15b0cb59eb04351e91be84441a5c4b03a238fccb362fe0b399edaefed42f8884b101a4f9b5511c920f2a0d67703191e27db697bd2e2fbfb116a8a2bae610f9', 'id': 'e6e4c250-1c96-42e4-a95e-16fad391b5be', 'created_at': datetime.datetime(2026, 8, 5, 8, 32, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 8, 32, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e6e4c250-1c96-42e4-a95e-16fad391b5be/file', 'properties': {}}, 'image_service': }' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:50 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-70f3456e-b5b4-480a-bc89-bc67166c504d tempest-VolumeImageDependencyTests-105585306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfe9767e-c06c-4f77-8a01-e8ffb83c5eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:50 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-70f3456e-b5b4-480a-bc89-bc67166c504d tempest-VolumeImageDependencyTests-105585306 None] Volume volume-8c91bc06-4c6d-497b-8b23-e8354f65fcb4 (8c91bc06-4c6d-497b-8b23-e8354f65fcb4): created successfully Aug 05 10:32:50 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-70f3456e-b5b4-480a-bc89-bc67166c504d tempest-VolumeImageDependencyTests-105585306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfe9767e-c06c-4f77-8a01-e8ffb83c5eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:50 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-70f3456e-b5b4-480a-bc89-bc67166c504d tempest-VolumeImageDependencyTests-105585306 None] Flow 'volume_create_manager' (6583c7f0-81af-4a04-9590-2820ec66ea30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:32:50 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-70f3456e-b5b4-480a-bc89-bc67166c504d tempest-VolumeImageDependencyTests-105585306 None] Created volume successfully. Aug 05 10:32:50 devstack sudo[106347]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-cca08c3a-a99c-4431-b6ee-b01bb70ab728 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b517e5f6-c4b4-4637-a1d5-f184ed429b6d_0xjg64n7devstack@QuobyteHD /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-09df092a-5782-4416-b213-8f2075a71202" returned: 0 in 0.560s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:50 devstack cinder-volume[88613]: DEBUG cinder.image.image_utils [None req-cca08c3a-a99c-4431-b6ee-b01bb70ab728 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b517e5f6-c4b4-4637-a1d5-f184ed429b6d_0xjg64n7devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-09df092a-5782-4416-b213-8f2075a71202 {{(pid=88613) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 10:32:50 devstack cinder-volume[88613]: INFO cinder.image.image_utils [None req-cca08c3a-a99c-4431-b6ee-b01bb70ab728 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] Converted 0.00 MB image at 0.00 MB/s Aug 05 10:32:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-cca08c3a-a99c-4431-b6ee-b01bb70ab728 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-09df092a-5782-4416-b213-8f2075a71202 1G {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:50 devstack sudo[106367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-09df092a-5782-4416-b213-8f2075a71202 1G Aug 05 10:32:50 devstack sudo[106367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:50 devstack sudo[106359]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d811182c-6793-41a6-889d-5885fb5c17f3 tempest-CreateVolumesFromImageTest-627372874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e817bfd-08a8-47e9-a14d-215f4045b468" returned: 0 in 0.336s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:50 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d811182c-6793-41a6-889d-5885fb5c17f3 tempest-CreateVolumesFromImageTest-627372874 None] Lock "cinder-quobyte-8e817bfd-08a8-47e9-a14d-215f4045b468" released by "delete_volume" :: held 0.879s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:32:50 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e7ba631f-c022-431c-9e6a-ad366b51afc5 tempest-VolumeImageDependencyTests-105585306 None] Acquiring lock "cinder-8c91bc06-4c6d-497b-8b23-e8354f65fcb4-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:32:50 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e7ba631f-c022-431c-9e6a-ad366b51afc5 tempest-VolumeImageDependencyTests-105585306 None] Lock "cinder-8c91bc06-4c6d-497b-8b23-e8354f65fcb4-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:32:50 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-d811182c-6793-41a6-889d-5885fb5c17f3 tempest-CreateVolumesFromImageTest-627372874 None] Created reservations ['ec1d0feb-ec6f-41f6-811f-68926a3d3b38', '095cd631-eb24-497a-9dd0-9c8499224846', 'f2eff31e-bf13-4aeb-9410-c89edd89f3fe', '3227b86d-9065-42b2-9942-678d34b4c015'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:32:50 devstack sudo[106355]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7dd04534-5d2f-43fd-8b58-c6e8793ce74b tempest-CreateVolumesFromSnapshotTest-428000733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-08b633af-3ea1-48c4-bcbf-8bb5dab38ed1 1073741824" returned: 0 in 0.577s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:50 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e7ba631f-c022-431c-9e6a-ad366b51afc5 tempest-VolumeImageDependencyTests-105585306 None] Acquiring lock "cinder-quobyte-8c91bc06-4c6d-497b-8b23-e8354f65fcb4" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:32:50 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e7ba631f-c022-431c-9e6a-ad366b51afc5 tempest-VolumeImageDependencyTests-105585306 None] Lock "cinder-quobyte-8c91bc06-4c6d-497b-8b23-e8354f65fcb4" acquired by "delete_volume" :: waited 0.037s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:32:50 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee9dd3b-0bc2-4ed6-9671-ae75c6aa3988]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:32:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e7ba631f-c022-431c-9e6a-ad366b51afc5 tempest-VolumeImageDependencyTests-105585306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8c91bc06-4c6d-497b-8b23-e8354f65fcb4 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7dd04534-5d2f-43fd-8b58-c6e8793ce74b tempest-CreateVolumesFromSnapshotTest-428000733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-08b633af-3ea1-48c4-bcbf-8bb5dab38ed1 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-d811182c-6793-41a6-889d-5885fb5c17f3 tempest-CreateVolumesFromImageTest-627372874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:32:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-d811182c-6793-41a6-889d-5885fb5c17f3 tempest-CreateVolumesFromImageTest-627372874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:32:50 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-d811182c-6793-41a6-889d-5885fb5c17f3 tempest-CreateVolumesFromImageTest-627372874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:32:50 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-d811182c-6793-41a6-889d-5885fb5c17f3 tempest-CreateVolumesFromImageTest-627372874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:32:50 devstack sudo[106375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-08b633af-3ea1-48c4-bcbf-8bb5dab38ed1 Aug 05 10:32:50 devstack sudo[106375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-d811182c-6793-41a6-889d-5885fb5c17f3 tempest-CreateVolumesFromImageTest-627372874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:32:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d811182c-6793-41a6-889d-5885fb5c17f3 tempest-CreateVolumesFromImageTest-627372874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:51 devstack sudo[106377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:32:51 devstack sudo[106377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:51 devstack sudo[106367]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-cca08c3a-a99c-4431-b6ee-b01bb70ab728 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-09df092a-5782-4416-b213-8f2075a71202 1G" returned: 0 in 0.415s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:51 devstack cinder-volume[88613]: DEBUG cinder.volume.volume_utils [None req-cca08c3a-a99c-4431-b6ee-b01bb70ab728 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] Downloaded image b517e5f6-c4b4-4637-a1d5-f184ed429b6d ((None, [{'url': 'file:///opt/stack/data/glance/images/b517e5f6-c4b4-4637-a1d5-f184ed429b6d', 'metadata': {}}])) to volume 09df092a-5782-4416-b213-8f2075a71202 successfully. {{(pid=88613) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 05 10:32:51 devstack cinder-volume[88613]: DEBUG cinder.image.image_utils [None req-cca08c3a-a99c-4431-b6ee-b01bb70ab728 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] Temporary image b517e5f6-c4b4-4637-a1d5-f184ed429b6d for user 53691a18f16944fb92f3bad8a7725bf2 is deleted. {{(pid=88613) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 05 10:32:51 devstack cinder-volume[88613]: DEBUG cinder.volume.volume_utils [None req-cca08c3a-a99c-4431-b6ee-b01bb70ab728 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] Marking volume 09df092a-5782-4416-b213-8f2075a71202 as bootable. {{(pid=88613) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 05 10:32:51 devstack sudo[106373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8c91bc06-4c6d-497b-8b23-e8354f65fcb4 Aug 05 10:32:51 devstack sudo[106373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:51 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-cca08c3a-a99c-4431-b6ee-b01bb70ab728 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] Copying metadata from image b517e5f6-c4b4-4637-a1d5-f184ed429b6d to 09df092a-5782-4416-b213-8f2075a71202. {{(pid=88613) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 05 10:32:51 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-cca08c3a-a99c-4431-b6ee-b01bb70ab728 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] Creating volume glance metadata for volume 09df092a-5782-4416-b213-8f2075a71202 backed by image b517e5f6-c4b4-4637-a1d5-f184ed429b6d with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'b517e5f6-c4b4-4637-a1d5-f184ed429b6d', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'f03a584ab56a4fb2e539cb0f394a6db7', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88613) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 05 10:32:51 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-cca08c3a-a99c-4431-b6ee-b01bb70ab728 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (625a32eb-cf09-4949-aecf-1cf511c4c3e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09df092a-5782-4416-b213-8f2075a71202', 'volume_size': 1, 'image_id': 'b517e5f6-c4b4-4637-a1d5-f184ed429b6d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b517e5f6-c4b4-4637-a1d5-f184ed429b6d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f03a584ab56a4fb2e539cb0f394a6db7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '52afa1542f404bb0b6a4c43b65921877', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '01b614a40cb3c7413a196aee0a27c8da3e760e1d16db2825bdecaf1a03c8f15d649a64383b28795ff4219a8305a7a42627bcd110a0bfc58cd35c10b2fe175f05', 'id': 'b517e5f6-c4b4-4637-a1d5-f184ed429b6d', 'created_at': datetime.datetime(2026, 8, 5, 8, 32, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 8, 32, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b517e5f6-c4b4-4637-a1d5-f184ed429b6d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:51 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-cca08c3a-a99c-4431-b6ee-b01bb70ab728 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82c0e53b-e9c1-491f-8f27-8560a4acb9f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:51 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-cca08c3a-a99c-4431-b6ee-b01bb70ab728 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] Volume volume-09df092a-5782-4416-b213-8f2075a71202 (09df092a-5782-4416-b213-8f2075a71202): created successfully Aug 05 10:32:51 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-cca08c3a-a99c-4431-b6ee-b01bb70ab728 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82c0e53b-e9c1-491f-8f27-8560a4acb9f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:51 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-cca08c3a-a99c-4431-b6ee-b01bb70ab728 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] Flow 'volume_create_manager' (62c465b2-6f35-4310-9322-2f5d36a88765) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:32:51 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-cca08c3a-a99c-4431-b6ee-b01bb70ab728 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] Created volume successfully. Aug 05 10:32:51 devstack sudo[106375]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7dd04534-5d2f-43fd-8b58-c6e8793ce74b tempest-CreateVolumesFromSnapshotTest-428000733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-08b633af-3ea1-48c4-bcbf-8bb5dab38ed1" returned: 0 in 0.290s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:51 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-7dd04534-5d2f-43fd-8b58-c6e8793ce74b tempest-CreateVolumesFromSnapshotTest-428000733 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:32:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-7dd04534-5d2f-43fd-8b58-c6e8793ce74b tempest-CreateVolumesFromSnapshotTest-428000733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:32:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-795821ca-1dc9-4b29-9382-ac96f96bb01f tempest-CreateVolumesFromSnapshotTest-428000733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.317s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:32:51 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-795821ca-1dc9-4b29-9382-ac96f96bb01f tempest-CreateVolumesFromSnapshotTest-428000733 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:32:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-143079943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62f867d2-3667-4ad2-b6e5-2dc93e699ac1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='247e12218ea4474e9ce4fca42a428274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:32:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:32:49Z,use_quota=True,user_id='b6ba55c537f94c5db6de4e02dea1ffa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:32:51 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-795821ca-1dc9-4b29-9382-ac96f96bb01f tempest-CreateVolumesFromSnapshotTest-428000733 None] Creating volume 62f867d2-3667-4ad2-b6e5-2dc93e699ac1 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:32:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-795821ca-1dc9-4b29-9382-ac96f96bb01f tempest-CreateVolumesFromSnapshotTest-428000733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:32:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-795821ca-1dc9-4b29-9382-ac96f96bb01f tempest-CreateVolumesFromSnapshotTest-428000733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:32:51 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-795821ca-1dc9-4b29-9382-ac96f96bb01f tempest-CreateVolumesFromSnapshotTest-428000733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:32:51 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-795821ca-1dc9-4b29-9382-ac96f96bb01f tempest-CreateVolumesFromSnapshotTest-428000733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:32:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-795821ca-1dc9-4b29-9382-ac96f96bb01f tempest-CreateVolumesFromSnapshotTest-428000733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:32:51 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-795821ca-1dc9-4b29-9382-ac96f96bb01f tempest-CreateVolumesFromSnapshotTest-428000733 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:32:51 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-795821ca-1dc9-4b29-9382-ac96f96bb01f tempest-CreateVolumesFromSnapshotTest-428000733 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:32:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-795821ca-1dc9-4b29-9382-ac96f96bb01f tempest-CreateVolumesFromSnapshotTest-428000733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-62f867d2-3667-4ad2-b6e5-2dc93e699ac1 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:51 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-7dd04534-5d2f-43fd-8b58-c6e8793ce74b tempest-CreateVolumesFromSnapshotTest-428000733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd08d998-decc-457b-8565-41766a616ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08b633af-3ea1-48c4-bcbf-8bb5dab38ed1', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:51 devstack sudo[106384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-62f867d2-3667-4ad2-b6e5-2dc93e699ac1 1073741824 Aug 05 10:32:51 devstack sudo[106384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:51 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-7dd04534-5d2f-43fd-8b58-c6e8793ce74b tempest-CreateVolumesFromSnapshotTest-428000733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b355ac35-5986-4f8f-96dc-8c770ef62250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:51 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-7dd04534-5d2f-43fd-8b58-c6e8793ce74b tempest-CreateVolumesFromSnapshotTest-428000733 None] Volume volume-08b633af-3ea1-48c4-bcbf-8bb5dab38ed1 (08b633af-3ea1-48c4-bcbf-8bb5dab38ed1): created successfully Aug 05 10:32:51 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-7dd04534-5d2f-43fd-8b58-c6e8793ce74b tempest-CreateVolumesFromSnapshotTest-428000733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b355ac35-5986-4f8f-96dc-8c770ef62250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:51 devstack sudo[106377]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:51 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-7dd04534-5d2f-43fd-8b58-c6e8793ce74b tempest-CreateVolumesFromSnapshotTest-428000733 None] Flow 'volume_create_manager' (1f7cc2a9-cd48-46e2-ae53-4784a9e2fb54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:32:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d811182c-6793-41a6-889d-5885fb5c17f3 tempest-CreateVolumesFromImageTest-627372874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.349s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:51 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-d811182c-6793-41a6-889d-5885fb5c17f3 tempest-CreateVolumesFromImageTest-627372874 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:32:51 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-d811182c-6793-41a6-889d-5885fb5c17f3 tempest-CreateVolumesFromImageTest-627372874 None] Deleted volume successfully. Aug 05 10:32:51 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-7dd04534-5d2f-43fd-8b58-c6e8793ce74b tempest-CreateVolumesFromSnapshotTest-428000733 None] Created volume successfully. Aug 05 10:32:51 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d811182c-6793-41a6-889d-5885fb5c17f3 tempest-CreateVolumesFromImageTest-627372874 None] Lock "cinder-8e817bfd-08a8-47e9-a14d-215f4045b468-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:32:51 devstack sudo[106373]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e7ba631f-c022-431c-9e6a-ad366b51afc5 tempest-VolumeImageDependencyTests-105585306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8c91bc06-4c6d-497b-8b23-e8354f65fcb4" returned: 0 in 0.449s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e7ba631f-c022-431c-9e6a-ad366b51afc5 tempest-VolumeImageDependencyTests-105585306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8c91bc06-4c6d-497b-8b23-e8354f65fcb4 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:51 devstack sudo[106387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8c91bc06-4c6d-497b-8b23-e8354f65fcb4 Aug 05 10:32:51 devstack sudo[106387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:51 devstack sudo[106387]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e7ba631f-c022-431c-9e6a-ad366b51afc5 tempest-VolumeImageDependencyTests-105585306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8c91bc06-4c6d-497b-8b23-e8354f65fcb4" returned: 0 in 0.254s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:51 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e7ba631f-c022-431c-9e6a-ad366b51afc5 tempest-VolumeImageDependencyTests-105585306 None] Lock "cinder-quobyte-8c91bc06-4c6d-497b-8b23-e8354f65fcb4" released by "delete_volume" :: held 0.743s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:32:51 devstack sudo[106384]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-795821ca-1dc9-4b29-9382-ac96f96bb01f tempest-CreateVolumesFromSnapshotTest-428000733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-62f867d2-3667-4ad2-b6e5-2dc93e699ac1 1073741824" returned: 0 in 0.437s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:51 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-e7ba631f-c022-431c-9e6a-ad366b51afc5 tempest-VolumeImageDependencyTests-105585306 None] Created reservations ['7e65b98c-9e1c-43c5-9482-303efa1e29b2', 'f02aa847-6550-49d1-8d0d-644d31736dba', 'febf04c3-dc15-40c1-9ce0-a2e6dddeb031', '12f43bd6-3961-41f0-81b6-27e27c4cdf9f'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:32:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-795821ca-1dc9-4b29-9382-ac96f96bb01f tempest-CreateVolumesFromSnapshotTest-428000733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-62f867d2-3667-4ad2-b6e5-2dc93e699ac1 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:51 devstack sudo[106394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-62f867d2-3667-4ad2-b6e5-2dc93e699ac1 Aug 05 10:32:51 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-e7ba631f-c022-431c-9e6a-ad366b51afc5 tempest-VolumeImageDependencyTests-105585306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:32:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-e7ba631f-c022-431c-9e6a-ad366b51afc5 tempest-VolumeImageDependencyTests-105585306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:32:51 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-e7ba631f-c022-431c-9e6a-ad366b51afc5 tempest-VolumeImageDependencyTests-105585306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:32:51 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-e7ba631f-c022-431c-9e6a-ad366b51afc5 tempest-VolumeImageDependencyTests-105585306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:32:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-e7ba631f-c022-431c-9e6a-ad366b51afc5 tempest-VolumeImageDependencyTests-105585306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:32:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e7ba631f-c022-431c-9e6a-ad366b51afc5 tempest-VolumeImageDependencyTests-105585306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:51 devstack sudo[106396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:32:51 devstack sudo[106396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:51 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-ba82c1bf-4fa3-45fa-91b8-926f50eada02 tempest-CreateVolumesFromImageTest-627372874 None] Acquiring lock "cinder-e16bb5ef-309d-459e-99ef-ee7501bcf069-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:32:52 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-ba82c1bf-4fa3-45fa-91b8-926f50eada02 tempest-CreateVolumesFromImageTest-627372874 None] Lock "cinder-e16bb5ef-309d-459e-99ef-ee7501bcf069-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:32:52 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-795821ca-1dc9-4b29-9382-ac96f96bb01f tempest-CreateVolumesFromSnapshotTest-428000733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-62f867d2-3667-4ad2-b6e5-2dc93e699ac1" returned: 0 in 0.351s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:52 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-795821ca-1dc9-4b29-9382-ac96f96bb01f tempest-CreateVolumesFromSnapshotTest-428000733 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:32:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-795821ca-1dc9-4b29-9382-ac96f96bb01f tempest-CreateVolumesFromSnapshotTest-428000733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:32:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-0257210f-9836-41c8-839c-492131b085b4 tempest-CreateVolumesFromSnapshotTest-428000733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.680s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:32:52 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-0257210f-9836-41c8-839c-492131b085b4 tempest-CreateVolumesFromSnapshotTest-428000733 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:32:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1699817549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0234cae-c056-4ef3-ae6c-8b25aea75468,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='247e12218ea4474e9ce4fca42a428274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:32:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:32:49Z,use_quota=True,user_id='b6ba55c537f94c5db6de4e02dea1ffa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:32:52 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-0257210f-9836-41c8-839c-492131b085b4 tempest-CreateVolumesFromSnapshotTest-428000733 None] Creating volume f0234cae-c056-4ef3-ae6c-8b25aea75468 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:32:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-0257210f-9836-41c8-839c-492131b085b4 tempest-CreateVolumesFromSnapshotTest-428000733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:32:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-0257210f-9836-41c8-839c-492131b085b4 tempest-CreateVolumesFromSnapshotTest-428000733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:32:52 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-0257210f-9836-41c8-839c-492131b085b4 tempest-CreateVolumesFromSnapshotTest-428000733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:32:52 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-0257210f-9836-41c8-839c-492131b085b4 tempest-CreateVolumesFromSnapshotTest-428000733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:32:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-0257210f-9836-41c8-839c-492131b085b4 tempest-CreateVolumesFromSnapshotTest-428000733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:32:52 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-0257210f-9836-41c8-839c-492131b085b4 tempest-CreateVolumesFromSnapshotTest-428000733 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:32:52 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-0257210f-9836-41c8-839c-492131b085b4 tempest-CreateVolumesFromSnapshotTest-428000733 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:32:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-0257210f-9836-41c8-839c-492131b085b4 tempest-CreateVolumesFromSnapshotTest-428000733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f0234cae-c056-4ef3-ae6c-8b25aea75468 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:52 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-ba82c1bf-4fa3-45fa-91b8-926f50eada02 tempest-CreateVolumesFromImageTest-627372874 None] Acquiring lock "cinder-quobyte-e16bb5ef-309d-459e-99ef-ee7501bcf069" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:32:52 devstack sudo[106396]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:52 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-795821ca-1dc9-4b29-9382-ac96f96bb01f tempest-CreateVolumesFromSnapshotTest-428000733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbfbb825-0b15-4103-bc66-82d5cfeb7de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62f867d2-3667-4ad2-b6e5-2dc93e699ac1', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:52 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-795821ca-1dc9-4b29-9382-ac96f96bb01f tempest-CreateVolumesFromSnapshotTest-428000733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e432040-e6db-4894-8d07-0c2a5fd4b104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:52 devstack sudo[106400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f0234cae-c056-4ef3-ae6c-8b25aea75468 1073741824 Aug 05 10:32:52 devstack sudo[106400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e7ba631f-c022-431c-9e6a-ad366b51afc5 tempest-VolumeImageDependencyTests-105585306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.366s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:52 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-a5f6d70f-e001-4f40-8e27-21219afc7515 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] Acquiring lock "cinder-09df092a-5782-4416-b213-8f2075a71202-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:32:52 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-e7ba631f-c022-431c-9e6a-ad366b51afc5 tempest-VolumeImageDependencyTests-105585306 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:32:52 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-795821ca-1dc9-4b29-9382-ac96f96bb01f tempest-CreateVolumesFromSnapshotTest-428000733 None] Volume volume-62f867d2-3667-4ad2-b6e5-2dc93e699ac1 (62f867d2-3667-4ad2-b6e5-2dc93e699ac1): created successfully Aug 05 10:32:52 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-795821ca-1dc9-4b29-9382-ac96f96bb01f tempest-CreateVolumesFromSnapshotTest-428000733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e432040-e6db-4894-8d07-0c2a5fd4b104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:52 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-795821ca-1dc9-4b29-9382-ac96f96bb01f tempest-CreateVolumesFromSnapshotTest-428000733 None] Flow 'volume_create_manager' (c6faa1c8-d03f-429d-9330-d74e4a51c778) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:32:52 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-ba82c1bf-4fa3-45fa-91b8-926f50eada02 tempest-CreateVolumesFromImageTest-627372874 None] Lock "cinder-quobyte-e16bb5ef-309d-459e-99ef-ee7501bcf069" acquired by "delete_volume" :: waited 0.069s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:32:52 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-e7ba631f-c022-431c-9e6a-ad366b51afc5 tempest-VolumeImageDependencyTests-105585306 None] Deleted volume successfully. Aug 05 10:32:52 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-a5f6d70f-e001-4f40-8e27-21219afc7515 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] Lock "cinder-09df092a-5782-4416-b213-8f2075a71202-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:32:52 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6679203-5f2e-4f4a-b907-6636496546cb]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:32:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ba82c1bf-4fa3-45fa-91b8-926f50eada02 tempest-CreateVolumesFromImageTest-627372874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e16bb5ef-309d-459e-99ef-ee7501bcf069 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:52 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-795821ca-1dc9-4b29-9382-ac96f96bb01f tempest-CreateVolumesFromSnapshotTest-428000733 None] Created volume successfully. Aug 05 10:32:52 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e7ba631f-c022-431c-9e6a-ad366b51afc5 tempest-VolumeImageDependencyTests-105585306 None] Lock "cinder-8c91bc06-4c6d-497b-8b23-e8354f65fcb4-delete_volume" released by "delete_volume" :: held 1.500s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:32:52 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-a5f6d70f-e001-4f40-8e27-21219afc7515 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] Acquiring lock "cinder-quobyte-09df092a-5782-4416-b213-8f2075a71202" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:32:52 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-a5f6d70f-e001-4f40-8e27-21219afc7515 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] Lock "cinder-quobyte-09df092a-5782-4416-b213-8f2075a71202" acquired by "delete_volume" :: waited 0.015s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:32:52 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18fb56d-f450-4516-bd85-38ca4970cce5]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:32:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a5f6d70f-e001-4f40-8e27-21219afc7515 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-09df092a-5782-4416-b213-8f2075a71202 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:52 devstack sudo[106402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e16bb5ef-309d-459e-99ef-ee7501bcf069 Aug 05 10:32:52 devstack sudo[106402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:52 devstack sudo[106405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-09df092a-5782-4416-b213-8f2075a71202 Aug 05 10:32:52 devstack sudo[106405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:52 devstack sudo[106400]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-0257210f-9836-41c8-839c-492131b085b4 tempest-CreateVolumesFromSnapshotTest-428000733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f0234cae-c056-4ef3-ae6c-8b25aea75468 1073741824" returned: 0 in 0.585s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:52 devstack sudo[106402]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ba82c1bf-4fa3-45fa-91b8-926f50eada02 tempest-CreateVolumesFromImageTest-627372874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e16bb5ef-309d-459e-99ef-ee7501bcf069" returned: 0 in 0.459s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ba82c1bf-4fa3-45fa-91b8-926f50eada02 tempest-CreateVolumesFromImageTest-627372874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e16bb5ef-309d-459e-99ef-ee7501bcf069 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:52 devstack sudo[106412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e16bb5ef-309d-459e-99ef-ee7501bcf069 Aug 05 10:32:52 devstack sudo[106412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-0257210f-9836-41c8-839c-492131b085b4 tempest-CreateVolumesFromSnapshotTest-428000733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f0234cae-c056-4ef3-ae6c-8b25aea75468 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:52 devstack sudo[106414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f0234cae-c056-4ef3-ae6c-8b25aea75468 Aug 05 10:32:52 devstack sudo[106414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:52 devstack sudo[106405]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a5f6d70f-e001-4f40-8e27-21219afc7515 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-09df092a-5782-4416-b213-8f2075a71202" returned: 0 in 0.515s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a5f6d70f-e001-4f40-8e27-21219afc7515 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-09df092a-5782-4416-b213-8f2075a71202 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:52 devstack sudo[106419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-09df092a-5782-4416-b213-8f2075a71202 Aug 05 10:32:52 devstack sudo[106419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:53 devstack sudo[106412]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ba82c1bf-4fa3-45fa-91b8-926f50eada02 tempest-CreateVolumesFromImageTest-627372874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e16bb5ef-309d-459e-99ef-ee7501bcf069" returned: 0 in 0.318s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:53 devstack sudo[106414]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-0257210f-9836-41c8-839c-492131b085b4 tempest-CreateVolumesFromSnapshotTest-428000733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f0234cae-c056-4ef3-ae6c-8b25aea75468" returned: 0 in 0.291s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:53 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-0257210f-9836-41c8-839c-492131b085b4 tempest-CreateVolumesFromSnapshotTest-428000733 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:32:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-0257210f-9836-41c8-839c-492131b085b4 tempest-CreateVolumesFromSnapshotTest-428000733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:32:53 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-ba82c1bf-4fa3-45fa-91b8-926f50eada02 tempest-CreateVolumesFromImageTest-627372874 None] Lock "cinder-quobyte-e16bb5ef-309d-459e-99ef-ee7501bcf069" released by "delete_volume" :: held 0.864s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:32:53 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0257210f-9836-41c8-839c-492131b085b4 tempest-CreateVolumesFromSnapshotTest-428000733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b108aa56-7d87-47f8-90e9-d293eec836be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0234cae-c056-4ef3-ae6c-8b25aea75468', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:53 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0257210f-9836-41c8-839c-492131b085b4 tempest-CreateVolumesFromSnapshotTest-428000733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb85a765-42e2-4cee-a1bd-751e89c4502b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:53 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-0257210f-9836-41c8-839c-492131b085b4 tempest-CreateVolumesFromSnapshotTest-428000733 None] Volume volume-f0234cae-c056-4ef3-ae6c-8b25aea75468 (f0234cae-c056-4ef3-ae6c-8b25aea75468): created successfully Aug 05 10:32:53 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0257210f-9836-41c8-839c-492131b085b4 tempest-CreateVolumesFromSnapshotTest-428000733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb85a765-42e2-4cee-a1bd-751e89c4502b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:53 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0257210f-9836-41c8-839c-492131b085b4 tempest-CreateVolumesFromSnapshotTest-428000733 None] Flow 'volume_create_manager' (e700186c-d418-4f4b-b029-1a847c6a4d49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:32:53 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-0257210f-9836-41c8-839c-492131b085b4 tempest-CreateVolumesFromSnapshotTest-428000733 None] Created volume successfully. Aug 05 10:32:53 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-ba82c1bf-4fa3-45fa-91b8-926f50eada02 tempest-CreateVolumesFromImageTest-627372874 None] Created reservations ['b22e6f51-41e8-4111-8f47-3612e66276e2', '3bfff019-ad94-4cd0-9fe9-6dc910507cd9', '504b56e0-52d2-4538-be9c-966a213ce197', '11de3a7c-75cb-4ab7-ad1d-1b6f4528309e'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:32:53 devstack sudo[106419]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a5f6d70f-e001-4f40-8e27-21219afc7515 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-09df092a-5782-4416-b213-8f2075a71202" returned: 0 in 0.331s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-ba82c1bf-4fa3-45fa-91b8-926f50eada02 tempest-CreateVolumesFromImageTest-627372874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:32:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-ba82c1bf-4fa3-45fa-91b8-926f50eada02 tempest-CreateVolumesFromImageTest-627372874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:32:53 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-ba82c1bf-4fa3-45fa-91b8-926f50eada02 tempest-CreateVolumesFromImageTest-627372874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:32:53 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-ba82c1bf-4fa3-45fa-91b8-926f50eada02 tempest-CreateVolumesFromImageTest-627372874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:32:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-ba82c1bf-4fa3-45fa-91b8-926f50eada02 tempest-CreateVolumesFromImageTest-627372874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:32:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ba82c1bf-4fa3-45fa-91b8-926f50eada02 tempest-CreateVolumesFromImageTest-627372874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:53 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-a5f6d70f-e001-4f40-8e27-21219afc7515 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] Lock "cinder-quobyte-09df092a-5782-4416-b213-8f2075a71202" released by "delete_volume" :: held 0.909s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:32:53 devstack sudo[106424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:32:53 devstack sudo[106424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:53 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-a5f6d70f-e001-4f40-8e27-21219afc7515 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] Created reservations ['f8f3614e-8a33-4c54-9a8c-ee8272c986af', '2ef0b079-0373-4d8c-a54c-2e9d09f92f59', '4a812fde-c010-4f71-899b-fe8416d16692', '863cf5a5-61aa-4c1d-a06b-9b3412a4c19e'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:32:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a5f6d70f-e001-4f40-8e27-21219afc7515 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:32:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a5f6d70f-e001-4f40-8e27-21219afc7515 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:32:53 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-a5f6d70f-e001-4f40-8e27-21219afc7515 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:32:53 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-a5f6d70f-e001-4f40-8e27-21219afc7515 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:32:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a5f6d70f-e001-4f40-8e27-21219afc7515 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:32:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a5f6d70f-e001-4f40-8e27-21219afc7515 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:53 devstack sudo[106426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:32:53 devstack sudo[106426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:53 devstack sudo[106424]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ba82c1bf-4fa3-45fa-91b8-926f50eada02 tempest-CreateVolumesFromImageTest-627372874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.270s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:53 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-ba82c1bf-4fa3-45fa-91b8-926f50eada02 tempest-CreateVolumesFromImageTest-627372874 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:32:53 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-ba82c1bf-4fa3-45fa-91b8-926f50eada02 tempest-CreateVolumesFromImageTest-627372874 None] Deleted volume successfully. Aug 05 10:32:53 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-ba82c1bf-4fa3-45fa-91b8-926f50eada02 tempest-CreateVolumesFromImageTest-627372874 None] Lock "cinder-e16bb5ef-309d-459e-99ef-ee7501bcf069-delete_volume" released by "delete_volume" :: held 1.495s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:32:53 devstack sudo[106426]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a5f6d70f-e001-4f40-8e27-21219afc7515 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.294s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:53 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-a5f6d70f-e001-4f40-8e27-21219afc7515 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:32:53 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-a5f6d70f-e001-4f40-8e27-21219afc7515 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] Deleted volume successfully. Aug 05 10:32:53 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-9398b26c-a9da-4609-a792-534fcf59fc33 tempest-CreateVolumesFromSnapshotTest-428000733 None] Acquiring lock "cinder-f0234cae-c056-4ef3-ae6c-8b25aea75468-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:32:53 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-a5f6d70f-e001-4f40-8e27-21219afc7515 tempest-VolumeAndVolumeTypeFromImageTest-1953273635 None] Lock "cinder-09df092a-5782-4416-b213-8f2075a71202-delete_volume" released by "delete_volume" :: held 1.531s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:32:53 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-9398b26c-a9da-4609-a792-534fcf59fc33 tempest-CreateVolumesFromSnapshotTest-428000733 None] Lock "cinder-f0234cae-c056-4ef3-ae6c-8b25aea75468-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:32:53 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-9398b26c-a9da-4609-a792-534fcf59fc33 tempest-CreateVolumesFromSnapshotTest-428000733 None] Acquiring lock "cinder-quobyte-f0234cae-c056-4ef3-ae6c-8b25aea75468" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:32:53 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-9398b26c-a9da-4609-a792-534fcf59fc33 tempest-CreateVolumesFromSnapshotTest-428000733 None] Lock "cinder-quobyte-f0234cae-c056-4ef3-ae6c-8b25aea75468" acquired by "delete_volume" :: waited 0.027s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:32:53 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c3d6fbb-96c9-4750-ada2-69ed32f53c70]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:32:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9398b26c-a9da-4609-a792-534fcf59fc33 tempest-CreateVolumesFromSnapshotTest-428000733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f0234cae-c056-4ef3-ae6c-8b25aea75468 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:54 devstack sudo[106430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f0234cae-c056-4ef3-ae6c-8b25aea75468 Aug 05 10:32:54 devstack sudo[106430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:54 devstack sudo[106430]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9398b26c-a9da-4609-a792-534fcf59fc33 tempest-CreateVolumesFromSnapshotTest-428000733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f0234cae-c056-4ef3-ae6c-8b25aea75468" returned: 0 in 0.453s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9398b26c-a9da-4609-a792-534fcf59fc33 tempest-CreateVolumesFromSnapshotTest-428000733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f0234cae-c056-4ef3-ae6c-8b25aea75468 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:54 devstack sudo[106437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f0234cae-c056-4ef3-ae6c-8b25aea75468 Aug 05 10:32:54 devstack sudo[106437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:54 devstack sudo[106437]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9398b26c-a9da-4609-a792-534fcf59fc33 tempest-CreateVolumesFromSnapshotTest-428000733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f0234cae-c056-4ef3-ae6c-8b25aea75468" returned: 0 in 0.330s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:54 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-9398b26c-a9da-4609-a792-534fcf59fc33 tempest-CreateVolumesFromSnapshotTest-428000733 None] Lock "cinder-quobyte-f0234cae-c056-4ef3-ae6c-8b25aea75468" released by "delete_volume" :: held 0.857s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:32:54 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-9398b26c-a9da-4609-a792-534fcf59fc33 tempest-CreateVolumesFromSnapshotTest-428000733 None] Created reservations ['af87c28c-18e2-483a-b59c-358474596975', 'acec8f07-0467-4cbf-99e7-2a5c1867950d', 'f5b469e4-8e6a-4ffc-a5e9-ff5b12ddb946', 'a9ad61ca-0316-4aae-98f4-cfeeff59bd5b'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:32:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-9398b26c-a9da-4609-a792-534fcf59fc33 tempest-CreateVolumesFromSnapshotTest-428000733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:32:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-9398b26c-a9da-4609-a792-534fcf59fc33 tempest-CreateVolumesFromSnapshotTest-428000733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:32:54 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-9398b26c-a9da-4609-a792-534fcf59fc33 tempest-CreateVolumesFromSnapshotTest-428000733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:32:54 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-9398b26c-a9da-4609-a792-534fcf59fc33 tempest-CreateVolumesFromSnapshotTest-428000733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:32:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-9398b26c-a9da-4609-a792-534fcf59fc33 tempest-CreateVolumesFromSnapshotTest-428000733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:32:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9398b26c-a9da-4609-a792-534fcf59fc33 tempest-CreateVolumesFromSnapshotTest-428000733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:54 devstack sudo[106441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:32:54 devstack sudo[106441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:55 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-f2bccf4f-a86b-47a6-a3a5-584818fb38af tempest-CreateVolumesFromSnapshotTest-428000733 None] Acquiring lock "cinder-62f867d2-3667-4ad2-b6e5-2dc93e699ac1-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:32:55 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-f2bccf4f-a86b-47a6-a3a5-584818fb38af tempest-CreateVolumesFromSnapshotTest-428000733 None] Lock "cinder-62f867d2-3667-4ad2-b6e5-2dc93e699ac1-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:32:55 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-f2bccf4f-a86b-47a6-a3a5-584818fb38af tempest-CreateVolumesFromSnapshotTest-428000733 None] Acquiring lock "cinder-quobyte-62f867d2-3667-4ad2-b6e5-2dc93e699ac1" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:32:55 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-f2bccf4f-a86b-47a6-a3a5-584818fb38af tempest-CreateVolumesFromSnapshotTest-428000733 None] Lock "cinder-quobyte-62f867d2-3667-4ad2-b6e5-2dc93e699ac1" acquired by "delete_volume" :: waited 0.023s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:32:55 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf64e34-a673-4f0e-843e-d376506d7dbe]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:32:55 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f2bccf4f-a86b-47a6-a3a5-584818fb38af tempest-CreateVolumesFromSnapshotTest-428000733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-62f867d2-3667-4ad2-b6e5-2dc93e699ac1 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:55 devstack sudo[106443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-62f867d2-3667-4ad2-b6e5-2dc93e699ac1 Aug 05 10:32:55 devstack sudo[106443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:55 devstack sudo[106441]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:55 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9398b26c-a9da-4609-a792-534fcf59fc33 tempest-CreateVolumesFromSnapshotTest-428000733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.506s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:55 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-9398b26c-a9da-4609-a792-534fcf59fc33 tempest-CreateVolumesFromSnapshotTest-428000733 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:32:55 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-9398b26c-a9da-4609-a792-534fcf59fc33 tempest-CreateVolumesFromSnapshotTest-428000733 None] Deleted volume successfully. Aug 05 10:32:55 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-9398b26c-a9da-4609-a792-534fcf59fc33 tempest-CreateVolumesFromSnapshotTest-428000733 None] Lock "cinder-f0234cae-c056-4ef3-ae6c-8b25aea75468-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:32:55 devstack sudo[106443]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:55 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f2bccf4f-a86b-47a6-a3a5-584818fb38af tempest-CreateVolumesFromSnapshotTest-428000733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-62f867d2-3667-4ad2-b6e5-2dc93e699ac1" returned: 0 in 0.549s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:55 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f2bccf4f-a86b-47a6-a3a5-584818fb38af tempest-CreateVolumesFromSnapshotTest-428000733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-62f867d2-3667-4ad2-b6e5-2dc93e699ac1 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:55 devstack sudo[106450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-62f867d2-3667-4ad2-b6e5-2dc93e699ac1 Aug 05 10:32:55 devstack sudo[106450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:56 devstack sudo[106450]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f2bccf4f-a86b-47a6-a3a5-584818fb38af tempest-CreateVolumesFromSnapshotTest-428000733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-62f867d2-3667-4ad2-b6e5-2dc93e699ac1" returned: 0 in 0.310s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:56 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-f2bccf4f-a86b-47a6-a3a5-584818fb38af tempest-CreateVolumesFromSnapshotTest-428000733 None] Lock "cinder-quobyte-62f867d2-3667-4ad2-b6e5-2dc93e699ac1" released by "delete_volume" :: held 0.919s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:32:56 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-f2bccf4f-a86b-47a6-a3a5-584818fb38af tempest-CreateVolumesFromSnapshotTest-428000733 None] Created reservations ['e9e1ee5b-b9a5-4c15-ac54-6f7c34e3d5b2', 'd8bee349-4a42-4547-a688-90491bb5050f', '4867cfba-052f-41f3-9b52-9eb36c8fdce0', 'ad395341-0315-4f2a-b175-43fa1c8bd44f'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:32:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-f2bccf4f-a86b-47a6-a3a5-584818fb38af tempest-CreateVolumesFromSnapshotTest-428000733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:32:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-f2bccf4f-a86b-47a6-a3a5-584818fb38af tempest-CreateVolumesFromSnapshotTest-428000733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:32:56 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-f2bccf4f-a86b-47a6-a3a5-584818fb38af tempest-CreateVolumesFromSnapshotTest-428000733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:32:56 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-f2bccf4f-a86b-47a6-a3a5-584818fb38af tempest-CreateVolumesFromSnapshotTest-428000733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:32:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-f2bccf4f-a86b-47a6-a3a5-584818fb38af tempest-CreateVolumesFromSnapshotTest-428000733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:32:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f2bccf4f-a86b-47a6-a3a5-584818fb38af tempest-CreateVolumesFromSnapshotTest-428000733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:56 devstack sudo[106453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:32:56 devstack sudo[106453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:56 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-c2b66746-3ca1-4707-9a39-51ae7fd02e15 tempest-CreateVolumesFromSnapshotTest-428000733 None] Acquiring lock "cinder-08b633af-3ea1-48c4-bcbf-8bb5dab38ed1-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:32:56 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-c2b66746-3ca1-4707-9a39-51ae7fd02e15 tempest-CreateVolumesFromSnapshotTest-428000733 None] Lock "cinder-08b633af-3ea1-48c4-bcbf-8bb5dab38ed1-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:32:56 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-c2b66746-3ca1-4707-9a39-51ae7fd02e15 tempest-CreateVolumesFromSnapshotTest-428000733 None] Acquiring lock "cinder-quobyte-08b633af-3ea1-48c4-bcbf-8bb5dab38ed1" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:32:56 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-c2b66746-3ca1-4707-9a39-51ae7fd02e15 tempest-CreateVolumesFromSnapshotTest-428000733 None] Lock "cinder-quobyte-08b633af-3ea1-48c4-bcbf-8bb5dab38ed1" acquired by "delete_volume" :: waited 0.028s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:32:56 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c7b746a-05eb-4d24-a2de-d17599163832]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:32:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c2b66746-3ca1-4707-9a39-51ae7fd02e15 tempest-CreateVolumesFromSnapshotTest-428000733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-08b633af-3ea1-48c4-bcbf-8bb5dab38ed1 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:56 devstack sudo[106453]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f2bccf4f-a86b-47a6-a3a5-584818fb38af tempest-CreateVolumesFromSnapshotTest-428000733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.406s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:56 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-f2bccf4f-a86b-47a6-a3a5-584818fb38af tempest-CreateVolumesFromSnapshotTest-428000733 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:32:56 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-f2bccf4f-a86b-47a6-a3a5-584818fb38af tempest-CreateVolumesFromSnapshotTest-428000733 None] Deleted volume successfully. Aug 05 10:32:56 devstack sudo[106455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-08b633af-3ea1-48c4-bcbf-8bb5dab38ed1 Aug 05 10:32:56 devstack sudo[106455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:56 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-f2bccf4f-a86b-47a6-a3a5-584818fb38af tempest-CreateVolumesFromSnapshotTest-428000733 None] Lock "cinder-62f867d2-3667-4ad2-b6e5-2dc93e699ac1-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:32:56 devstack sudo[106455]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c2b66746-3ca1-4707-9a39-51ae7fd02e15 tempest-CreateVolumesFromSnapshotTest-428000733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-08b633af-3ea1-48c4-bcbf-8bb5dab38ed1" returned: 0 in 0.449s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c2b66746-3ca1-4707-9a39-51ae7fd02e15 tempest-CreateVolumesFromSnapshotTest-428000733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-08b633af-3ea1-48c4-bcbf-8bb5dab38ed1 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:56 devstack sudo[106462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-08b633af-3ea1-48c4-bcbf-8bb5dab38ed1 Aug 05 10:32:56 devstack sudo[106462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:57 devstack sudo[106462]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c2b66746-3ca1-4707-9a39-51ae7fd02e15 tempest-CreateVolumesFromSnapshotTest-428000733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-08b633af-3ea1-48c4-bcbf-8bb5dab38ed1" returned: 0 in 0.334s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:57 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-c2b66746-3ca1-4707-9a39-51ae7fd02e15 tempest-CreateVolumesFromSnapshotTest-428000733 None] Lock "cinder-quobyte-08b633af-3ea1-48c4-bcbf-8bb5dab38ed1" released by "delete_volume" :: held 0.856s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:32:57 devstack cinder-volume[88613]: DEBUG dbcounter [-] [88613] Writing DB stats cinder:SELECT=114,cinder:INSERT=37,cinder:UPDATE=143,cinder:DELETE=15 {{(pid=88613) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:32:57 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-c2b66746-3ca1-4707-9a39-51ae7fd02e15 tempest-CreateVolumesFromSnapshotTest-428000733 None] Created reservations ['6c26768f-f828-4748-81a4-7a2d8311cd3a', '7c36987a-6e86-4267-ba7f-7eedac75a8f8', '1ce8a1d4-130d-4476-aa15-c7b531dfefb6', '570a643d-287a-4328-adf1-6a9908989e36'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:32:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c2b66746-3ca1-4707-9a39-51ae7fd02e15 tempest-CreateVolumesFromSnapshotTest-428000733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:32:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c2b66746-3ca1-4707-9a39-51ae7fd02e15 tempest-CreateVolumesFromSnapshotTest-428000733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:32:57 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-c2b66746-3ca1-4707-9a39-51ae7fd02e15 tempest-CreateVolumesFromSnapshotTest-428000733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:32:57 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-c2b66746-3ca1-4707-9a39-51ae7fd02e15 tempest-CreateVolumesFromSnapshotTest-428000733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:32:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c2b66746-3ca1-4707-9a39-51ae7fd02e15 tempest-CreateVolumesFromSnapshotTest-428000733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:32:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c2b66746-3ca1-4707-9a39-51ae7fd02e15 tempest-CreateVolumesFromSnapshotTest-428000733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:57 devstack sudo[106465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:32:57 devstack sudo[106465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:57 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-70b10133-59fe-49f9-b8cf-813cc89b3388 tempest-CreateVolumesFromSnapshotTest-428000733 None] Acquiring lock "cinder-a1406e22-a3f6-433d-9e63-6b1492c706a1-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:32:57 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-70b10133-59fe-49f9-b8cf-813cc89b3388 tempest-CreateVolumesFromSnapshotTest-428000733 None] Lock "cinder-a1406e22-a3f6-433d-9e63-6b1492c706a1-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:32:57 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-70b10133-59fe-49f9-b8cf-813cc89b3388 tempest-CreateVolumesFromSnapshotTest-428000733 None] Acquiring lock "cinder-quobyte-a1406e22-a3f6-433d-9e63-6b1492c706a1" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:32:57 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-70b10133-59fe-49f9-b8cf-813cc89b3388 tempest-CreateVolumesFromSnapshotTest-428000733 None] Lock "cinder-quobyte-a1406e22-a3f6-433d-9e63-6b1492c706a1" acquired by "delete_volume" :: waited 0.022s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:32:57 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[087f1f28-15a0-43a2-ba6e-963eb9494b61]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:32:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-70b10133-59fe-49f9-b8cf-813cc89b3388 tempest-CreateVolumesFromSnapshotTest-428000733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a1406e22-a3f6-433d-9e63-6b1492c706a1 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:57 devstack sudo[106465]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c2b66746-3ca1-4707-9a39-51ae7fd02e15 tempest-CreateVolumesFromSnapshotTest-428000733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.341s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:57 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-c2b66746-3ca1-4707-9a39-51ae7fd02e15 tempest-CreateVolumesFromSnapshotTest-428000733 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:32:57 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-c2b66746-3ca1-4707-9a39-51ae7fd02e15 tempest-CreateVolumesFromSnapshotTest-428000733 None] Deleted volume successfully. Aug 05 10:32:57 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-c2b66746-3ca1-4707-9a39-51ae7fd02e15 tempest-CreateVolumesFromSnapshotTest-428000733 None] Lock "cinder-08b633af-3ea1-48c4-bcbf-8bb5dab38ed1-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:32:57 devstack sudo[106468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a1406e22-a3f6-433d-9e63-6b1492c706a1 Aug 05 10:32:57 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:58 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-70b10133-59fe-49f9-b8cf-813cc89b3388 tempest-CreateVolumesFromSnapshotTest-428000733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a1406e22-a3f6-433d-9e63-6b1492c706a1" returned: 0 in 0.589s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-70b10133-59fe-49f9-b8cf-813cc89b3388 tempest-CreateVolumesFromSnapshotTest-428000733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a1406e22-a3f6-433d-9e63-6b1492c706a1 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:58 devstack sudo[106474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a1406e22-a3f6-433d-9e63-6b1492c706a1 Aug 05 10:32:58 devstack sudo[106474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:58 devstack sudo[106474]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-70b10133-59fe-49f9-b8cf-813cc89b3388 tempest-CreateVolumesFromSnapshotTest-428000733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-a1406e22-a3f6-433d-9e63-6b1492c706a1" returned: 0 in 0.402s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:58 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-70b10133-59fe-49f9-b8cf-813cc89b3388 tempest-CreateVolumesFromSnapshotTest-428000733 None] Lock "cinder-quobyte-a1406e22-a3f6-433d-9e63-6b1492c706a1" released by "delete_volume" :: held 1.074s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:32:58 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d90fef3-4168-4c59-982d-26fcd654b528 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:32:58 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9d90fef3-4168-4c59-982d-26fcd654b528 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Flow 'volume_create_manager' (fa893579-484d-4007-9863-d03a9fe6acd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:32:58 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9d90fef3-4168-4c59-982d-26fcd654b528 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3366171a-db89-49f6-8cee-41f1f398f2b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:58 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9d90fef3-4168-4c59-982d-26fcd654b528 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3366171a-db89-49f6-8cee-41f1f398f2b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:32:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1611126119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f8dddfa-b25c-475b-a78b-05c246cddfd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93f7671870ef4865a87f4534064b201c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:32:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:32:59Z,use_quota=True,user_id='88ac70ccddaf4507835c3edfd8685a7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:58 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9d90fef3-4168-4c59-982d-26fcd654b528 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c0b4902-11c3-438e-a067-c9a795ec3306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:58 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9d90fef3-4168-4c59-982d-26fcd654b528 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c0b4902-11c3-438e-a067-c9a795ec3306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:58 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9d90fef3-4168-4c59-982d-26fcd654b528 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b709f7cd-65a5-4546-b8d3-20e0901e659e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:58 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9d90fef3-4168-4c59-982d-26fcd654b528 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b709f7cd-65a5-4546-b8d3-20e0901e659e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f8dddfa-b25c-475b-a78b-05c246cddfd2', 'volume_name': 'volume-3f8dddfa-b25c-475b-a78b-05c246cddfd2', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:58 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9d90fef3-4168-4c59-982d-26fcd654b528 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4592053a-5aad-440b-9836-d096340c2c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:58 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9d90fef3-4168-4c59-982d-26fcd654b528 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4592053a-5aad-440b-9836-d096340c2c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:58 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9d90fef3-4168-4c59-982d-26fcd654b528 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bd3323b-2d18-4da5-a9e8-5fb6445da7fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:58 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-9d90fef3-4168-4c59-982d-26fcd654b528 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Volume 3f8dddfa-b25c-475b-a78b-05c246cddfd2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f8dddfa-b25c-475b-a78b-05c246cddfd2', 'volume_size': 1} Aug 05 10:32:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-9d90fef3-4168-4c59-982d-26fcd654b528 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:32:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-9d90fef3-4168-4c59-982d-26fcd654b528 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:32:58 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-9d90fef3-4168-4c59-982d-26fcd654b528 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:32:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1611126119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f8dddfa-b25c-475b-a78b-05c246cddfd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93f7671870ef4865a87f4534064b201c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:32:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:32:59Z,use_quota=True,user_id='88ac70ccddaf4507835c3edfd8685a7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:32:58 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-9d90fef3-4168-4c59-982d-26fcd654b528 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Creating volume 3f8dddfa-b25c-475b-a78b-05c246cddfd2 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:32:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-9d90fef3-4168-4c59-982d-26fcd654b528 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:32:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-9d90fef3-4168-4c59-982d-26fcd654b528 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:32:58 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-9d90fef3-4168-4c59-982d-26fcd654b528 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:32:58 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-9d90fef3-4168-4c59-982d-26fcd654b528 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:32:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-9d90fef3-4168-4c59-982d-26fcd654b528 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:32:58 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-9d90fef3-4168-4c59-982d-26fcd654b528 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:32:58 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-9d90fef3-4168-4c59-982d-26fcd654b528 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:32:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9d90fef3-4168-4c59-982d-26fcd654b528 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3f8dddfa-b25c-475b-a78b-05c246cddfd2 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:58 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-70b10133-59fe-49f9-b8cf-813cc89b3388 tempest-CreateVolumesFromSnapshotTest-428000733 None] Created reservations ['c7bb215d-60e9-42c5-8fb1-8e098e6f3b72', 'eb412875-a663-4370-9b3f-909f7caff6a0', 'f13a47d2-fa53-41ec-acc4-5196ed552347', '28799c73-4b1b-4c57-b358-3e70efe659c0'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:32:58 devstack sudo[106477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3f8dddfa-b25c-475b-a78b-05c246cddfd2 1073741824 Aug 05 10:32:58 devstack sudo[106477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-70b10133-59fe-49f9-b8cf-813cc89b3388 tempest-CreateVolumesFromSnapshotTest-428000733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:32:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-70b10133-59fe-49f9-b8cf-813cc89b3388 tempest-CreateVolumesFromSnapshotTest-428000733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:32:59 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-70b10133-59fe-49f9-b8cf-813cc89b3388 tempest-CreateVolumesFromSnapshotTest-428000733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:32:59 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-70b10133-59fe-49f9-b8cf-813cc89b3388 tempest-CreateVolumesFromSnapshotTest-428000733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:32:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-70b10133-59fe-49f9-b8cf-813cc89b3388 tempest-CreateVolumesFromSnapshotTest-428000733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:32:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-70b10133-59fe-49f9-b8cf-813cc89b3388 tempest-CreateVolumesFromSnapshotTest-428000733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:59 devstack sudo[106479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:32:59 devstack sudo[106479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:59 devstack sudo[106479]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-70b10133-59fe-49f9-b8cf-813cc89b3388 tempest-CreateVolumesFromSnapshotTest-428000733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.287s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:59 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-70b10133-59fe-49f9-b8cf-813cc89b3388 tempest-CreateVolumesFromSnapshotTest-428000733 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:32:59 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-70b10133-59fe-49f9-b8cf-813cc89b3388 tempest-CreateVolumesFromSnapshotTest-428000733 None] Deleted volume successfully. Aug 05 10:32:59 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-70b10133-59fe-49f9-b8cf-813cc89b3388 tempest-CreateVolumesFromSnapshotTest-428000733 None] Lock "cinder-a1406e22-a3f6-433d-9e63-6b1492c706a1-delete_volume" released by "delete_volume" :: held 1.804s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:32:59 devstack sudo[106477]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9d90fef3-4168-4c59-982d-26fcd654b528 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3f8dddfa-b25c-475b-a78b-05c246cddfd2 1073741824" returned: 0 in 0.549s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9d90fef3-4168-4c59-982d-26fcd654b528 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3f8dddfa-b25c-475b-a78b-05c246cddfd2 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:59 devstack sudo[106486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3f8dddfa-b25c-475b-a78b-05c246cddfd2 Aug 05 10:32:59 devstack sudo[106486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:59 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-46dc61b0-c32f-4335-a4d6-dd9b1ad17d1b tempest-CreateVolumesFromSnapshotTest-428000733 None] Acquiring lock "cinder-e4821834-840b-45f6-8574-24200d4fd73b-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:32:59 devstack sudo[106486]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9d90fef3-4168-4c59-982d-26fcd654b528 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3f8dddfa-b25c-475b-a78b-05c246cddfd2" returned: 0 in 0.337s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:59 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-9d90fef3-4168-4c59-982d-26fcd654b528 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:32:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-9d90fef3-4168-4c59-982d-26fcd654b528 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:32:59 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-46dc61b0-c32f-4335-a4d6-dd9b1ad17d1b tempest-CreateVolumesFromSnapshotTest-428000733 None] Lock "cinder-e4821834-840b-45f6-8574-24200d4fd73b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:32:59 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9d90fef3-4168-4c59-982d-26fcd654b528 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bd3323b-2d18-4da5-a9e8-5fb6445da7fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f8dddfa-b25c-475b-a78b-05c246cddfd2', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:59 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9d90fef3-4168-4c59-982d-26fcd654b528 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2114cd3-3da9-4fe7-9258-85d150a62ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:59 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-9d90fef3-4168-4c59-982d-26fcd654b528 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Volume volume-3f8dddfa-b25c-475b-a78b-05c246cddfd2 (3f8dddfa-b25c-475b-a78b-05c246cddfd2): created successfully Aug 05 10:32:59 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9d90fef3-4168-4c59-982d-26fcd654b528 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2114cd3-3da9-4fe7-9258-85d150a62ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:59 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9d90fef3-4168-4c59-982d-26fcd654b528 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Flow 'volume_create_manager' (fa893579-484d-4007-9863-d03a9fe6acd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:32:59 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-46dc61b0-c32f-4335-a4d6-dd9b1ad17d1b tempest-CreateVolumesFromSnapshotTest-428000733 None] Acquiring lock "cinder-quobyte-e4821834-840b-45f6-8574-24200d4fd73b" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:32:59 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-46dc61b0-c32f-4335-a4d6-dd9b1ad17d1b tempest-CreateVolumesFromSnapshotTest-428000733 None] Lock "cinder-quobyte-e4821834-840b-45f6-8574-24200d4fd73b" acquired by "delete_volume" :: waited 0.019s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:32:59 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-9d90fef3-4168-4c59-982d-26fcd654b528 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Created volume successfully. Aug 05 10:33:00 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6cd9b0d-bf91-4673-94d9-60929d20c251]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:33:00 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-46dc61b0-c32f-4335-a4d6-dd9b1ad17d1b tempest-CreateVolumesFromSnapshotTest-428000733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e4821834-840b-45f6-8574-24200d4fd73b {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:00 devstack sudo[106489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e4821834-840b-45f6-8574-24200d4fd73b Aug 05 10:33:00 devstack sudo[106489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:00 devstack sudo[106489]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:00 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-46dc61b0-c32f-4335-a4d6-dd9b1ad17d1b tempest-CreateVolumesFromSnapshotTest-428000733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e4821834-840b-45f6-8574-24200d4fd73b" returned: 0 in 0.437s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:00 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-46dc61b0-c32f-4335-a4d6-dd9b1ad17d1b tempest-CreateVolumesFromSnapshotTest-428000733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e4821834-840b-45f6-8574-24200d4fd73b {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:00 devstack sudo[106518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e4821834-840b-45f6-8574-24200d4fd73b Aug 05 10:33:00 devstack sudo[106518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:00 devstack sudo[106518]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:00 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-46dc61b0-c32f-4335-a4d6-dd9b1ad17d1b tempest-CreateVolumesFromSnapshotTest-428000733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e4821834-840b-45f6-8574-24200d4fd73b" returned: 0 in 0.369s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:00 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-46dc61b0-c32f-4335-a4d6-dd9b1ad17d1b tempest-CreateVolumesFromSnapshotTest-428000733 None] Lock "cinder-quobyte-e4821834-840b-45f6-8574-24200d4fd73b" released by "delete_volume" :: held 0.861s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:00 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-46dc61b0-c32f-4335-a4d6-dd9b1ad17d1b tempest-CreateVolumesFromSnapshotTest-428000733 None] Created reservations ['dddc2aae-0ded-4bd0-9a03-d614f9aa5416', '88fab70f-4031-4f89-a470-22bfc022552b', '31d0e189-283f-42d3-99f3-a651ed3604bc', '16d9e747-803c-4196-8ad9-701cd40955c9'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:33:00 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-c93ae086-97d1-41d3-b94a-1855cb8ad802 tempest-VolumeDependencyTests-1689696164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:33:00 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c93ae086-97d1-41d3-b94a-1855cb8ad802 tempest-VolumeDependencyTests-1689696164 None] Flow 'volume_create_manager' (371577b5-c2da-4d2c-9d46-a2f3de65ae74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:33:01 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c93ae086-97d1-41d3-b94a-1855cb8ad802 tempest-VolumeDependencyTests-1689696164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a7fbc4a-c8a2-4cdf-bce2-b2c90a8bec58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:01 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c93ae086-97d1-41d3-b94a-1855cb8ad802 tempest-VolumeDependencyTests-1689696164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a7fbc4a-c8a2-4cdf-bce2-b2c90a8bec58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:33:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-56072867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ec15480f5d74dffb5a1eb8f2edf4e22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:33:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:33:01Z,use_quota=True,user_id='a1469325018c45369a72d83f06b11ade',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:01 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c93ae086-97d1-41d3-b94a-1855cb8ad802 tempest-VolumeDependencyTests-1689696164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4f7c375-39c0-45e0-a47a-29e58a837b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:01 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c93ae086-97d1-41d3-b94a-1855cb8ad802 tempest-VolumeDependencyTests-1689696164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4f7c375-39c0-45e0-a47a-29e58a837b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:01 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c93ae086-97d1-41d3-b94a-1855cb8ad802 tempest-VolumeDependencyTests-1689696164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f392830d-722e-414f-8d32-7970378306e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:01 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c93ae086-97d1-41d3-b94a-1855cb8ad802 tempest-VolumeDependencyTests-1689696164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f392830d-722e-414f-8d32-7970378306e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a', 'volume_name': 'volume-50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:01 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c93ae086-97d1-41d3-b94a-1855cb8ad802 tempest-VolumeDependencyTests-1689696164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (672a0818-6ed0-47e7-bf07-9708385ad658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:01 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c93ae086-97d1-41d3-b94a-1855cb8ad802 tempest-VolumeDependencyTests-1689696164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (672a0818-6ed0-47e7-bf07-9708385ad658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:01 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c93ae086-97d1-41d3-b94a-1855cb8ad802 tempest-VolumeDependencyTests-1689696164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d5e677e-a066-4ea3-9e0d-f6509c7c877d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:01 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-c93ae086-97d1-41d3-b94a-1855cb8ad802 tempest-VolumeDependencyTests-1689696164 None] Volume 50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a', 'volume_size': 1} Aug 05 10:33:01 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c93ae086-97d1-41d3-b94a-1855cb8ad802 tempest-VolumeDependencyTests-1689696164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:01 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c93ae086-97d1-41d3-b94a-1855cb8ad802 tempest-VolumeDependencyTests-1689696164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:01 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-c93ae086-97d1-41d3-b94a-1855cb8ad802 tempest-VolumeDependencyTests-1689696164 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:33:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-56072867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ec15480f5d74dffb5a1eb8f2edf4e22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:33:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:33:01Z,use_quota=True,user_id='a1469325018c45369a72d83f06b11ade',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:33:01 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-c93ae086-97d1-41d3-b94a-1855cb8ad802 tempest-VolumeDependencyTests-1689696164 None] Creating volume 50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:33:01 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c93ae086-97d1-41d3-b94a-1855cb8ad802 tempest-VolumeDependencyTests-1689696164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:01 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c93ae086-97d1-41d3-b94a-1855cb8ad802 tempest-VolumeDependencyTests-1689696164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:01 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-c93ae086-97d1-41d3-b94a-1855cb8ad802 tempest-VolumeDependencyTests-1689696164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:33:01 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-c93ae086-97d1-41d3-b94a-1855cb8ad802 tempest-VolumeDependencyTests-1689696164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:33:01 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c93ae086-97d1-41d3-b94a-1855cb8ad802 tempest-VolumeDependencyTests-1689696164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:01 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-c93ae086-97d1-41d3-b94a-1855cb8ad802 tempest-VolumeDependencyTests-1689696164 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:33:01 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-c93ae086-97d1-41d3-b94a-1855cb8ad802 tempest-VolumeDependencyTests-1689696164 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:33:01 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c93ae086-97d1-41d3-b94a-1855cb8ad802 tempest-VolumeDependencyTests-1689696164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:01 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-ceda4f91-8613-4e56-8481-6b797dbd03bc tempest-CreateVolumesFromSnapshotTest-428000733 None] Acquiring lock "cinder-c906fd9f-3bae-4634-a209-6a2ed2596ae4-delete_snapshot" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:01 devstack sudo[106533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a 1073741824 Aug 05 10:33:01 devstack sudo[106533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:01 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-ceda4f91-8613-4e56-8481-6b797dbd03bc tempest-CreateVolumesFromSnapshotTest-428000733 None] Lock "cinder-c906fd9f-3bae-4634-a209-6a2ed2596ae4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:01 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-ceda4f91-8613-4e56-8481-6b797dbd03bc tempest-CreateVolumesFromSnapshotTest-428000733 None] Acquiring lock "cinder-quobyte-0b5984b3-aa0a-46f3-b6dd-18026e655ac9" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:01 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-46dc61b0-c32f-4335-a4d6-dd9b1ad17d1b tempest-CreateVolumesFromSnapshotTest-428000733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:01 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-46dc61b0-c32f-4335-a4d6-dd9b1ad17d1b tempest-CreateVolumesFromSnapshotTest-428000733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:01 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-46dc61b0-c32f-4335-a4d6-dd9b1ad17d1b tempest-CreateVolumesFromSnapshotTest-428000733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:33:01 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-46dc61b0-c32f-4335-a4d6-dd9b1ad17d1b tempest-CreateVolumesFromSnapshotTest-428000733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:33:01 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-46dc61b0-c32f-4335-a4d6-dd9b1ad17d1b tempest-CreateVolumesFromSnapshotTest-428000733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:01 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-46dc61b0-c32f-4335-a4d6-dd9b1ad17d1b tempest-CreateVolumesFromSnapshotTest-428000733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:01 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-ceda4f91-8613-4e56-8481-6b797dbd03bc tempest-CreateVolumesFromSnapshotTest-428000733 None] Lock "cinder-quobyte-0b5984b3-aa0a-46f3-b6dd-18026e655ac9" acquired by "delete_snapshot" :: waited 0.048s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:01 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-ceda4f91-8613-4e56-8481-6b797dbd03bc tempest-CreateVolumesFromSnapshotTest-428000733 None] Acquiring lock "cinder-quobyte-c906fd9f-3bae-4634-a209-6a2ed2596ae4" by "_delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:01 devstack sudo[106535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:33:01 devstack sudo[106535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:01 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-ceda4f91-8613-4e56-8481-6b797dbd03bc tempest-CreateVolumesFromSnapshotTest-428000733 None] Lock "cinder-quobyte-c906fd9f-3bae-4634-a209-6a2ed2596ae4" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:01 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-ceda4f91-8613-4e56-8481-6b797dbd03bc tempest-CreateVolumesFromSnapshotTest-428000733 None] Deleting offline snapshot c906fd9f-3bae-4634-a209-6a2ed2596ae4 of volume 0b5984b3-aa0a-46f3-b6dd-18026e655ac9 {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:33:01 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-ceda4f91-8613-4e56-8481-6b797dbd03bc tempest-CreateVolumesFromSnapshotTest-428000733 None] snapshot_file for this snap is: volume-0b5984b3-aa0a-46f3-b6dd-18026e655ac9.c906fd9f-3bae-4634-a209-6a2ed2596ae4 {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:33:01 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[843c101b-a12b-455f-b38e-c88ed8f8766d]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:33:01 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ceda4f91-8613-4e56-8481-6b797dbd03bc tempest-CreateVolumesFromSnapshotTest-428000733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0b5984b3-aa0a-46f3-b6dd-18026e655ac9.c906fd9f-3bae-4634-a209-6a2ed2596ae4 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:01 devstack sudo[106537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0b5984b3-aa0a-46f3-b6dd-18026e655ac9.c906fd9f-3bae-4634-a209-6a2ed2596ae4 Aug 05 10:33:01 devstack sudo[106537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:01 devstack sudo[106535]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:01 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-46dc61b0-c32f-4335-a4d6-dd9b1ad17d1b tempest-CreateVolumesFromSnapshotTest-428000733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.434s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:01 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-46dc61b0-c32f-4335-a4d6-dd9b1ad17d1b tempest-CreateVolumesFromSnapshotTest-428000733 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:33:01 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-46dc61b0-c32f-4335-a4d6-dd9b1ad17d1b tempest-CreateVolumesFromSnapshotTest-428000733 None] Deleted volume successfully. Aug 05 10:33:01 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-46dc61b0-c32f-4335-a4d6-dd9b1ad17d1b tempest-CreateVolumesFromSnapshotTest-428000733 None] Lock "cinder-e4821834-840b-45f6-8574-24200d4fd73b-delete_volume" released by "delete_volume" :: held 1.849s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:01 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-81c3e471-ff87-465a-8a17-5d1477d0d36f tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:33:01 devstack sudo[106533]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:01 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-81c3e471-ff87-465a-8a17-5d1477d0d36f tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Flow 'volume_create_manager' (77d66deb-5076-4f72-8649-bdaf295f1e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:33:01 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-81c3e471-ff87-465a-8a17-5d1477d0d36f tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbb3e048-c9ea-4edb-a438-15eb39aae9fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:01 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c93ae086-97d1-41d3-b94a-1855cb8ad802 tempest-VolumeDependencyTests-1689696164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a 1073741824" returned: 0 in 0.759s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:01 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-81c3e471-ff87-465a-8a17-5d1477d0d36f tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbb3e048-c9ea-4edb-a438-15eb39aae9fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:33:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-364761795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2f436cc-b7d1-4c95-a9ed-db33bda20af9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93f7671870ef4865a87f4534064b201c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:33:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:33:02Z,use_quota=True,user_id='88ac70ccddaf4507835c3edfd8685a7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:01 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-81c3e471-ff87-465a-8a17-5d1477d0d36f tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b58236b0-35e4-4f60-80c1-3bfedcadb532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:01 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-81c3e471-ff87-465a-8a17-5d1477d0d36f tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b58236b0-35e4-4f60-80c1-3bfedcadb532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:01 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-81c3e471-ff87-465a-8a17-5d1477d0d36f tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f2f25e0-4886-4cf7-a296-4044ea031db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:01 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-81c3e471-ff87-465a-8a17-5d1477d0d36f tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f2f25e0-4886-4cf7-a296-4044ea031db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2f436cc-b7d1-4c95-a9ed-db33bda20af9', 'volume_name': 'volume-c2f436cc-b7d1-4c95-a9ed-db33bda20af9', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:01 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-81c3e471-ff87-465a-8a17-5d1477d0d36f tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad8dc673-d307-49bb-b09c-f8b22c5b4ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:01 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-81c3e471-ff87-465a-8a17-5d1477d0d36f tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad8dc673-d307-49bb-b09c-f8b22c5b4ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:01 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-81c3e471-ff87-465a-8a17-5d1477d0d36f tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63ddee3b-85e0-44cf-a005-e508a91e3206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:01 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-81c3e471-ff87-465a-8a17-5d1477d0d36f tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Volume c2f436cc-b7d1-4c95-a9ed-db33bda20af9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2f436cc-b7d1-4c95-a9ed-db33bda20af9', 'volume_size': 1} Aug 05 10:33:01 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-81c3e471-ff87-465a-8a17-5d1477d0d36f tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:02 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c93ae086-97d1-41d3-b94a-1855cb8ad802 tempest-VolumeDependencyTests-1689696164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:02 devstack sudo[106537]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:02 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ceda4f91-8613-4e56-8481-6b797dbd03bc tempest-CreateVolumesFromSnapshotTest-428000733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0b5984b3-aa0a-46f3-b6dd-18026e655ac9.c906fd9f-3bae-4634-a209-6a2ed2596ae4" returned: 0 in 0.664s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:02 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-ceda4f91-8613-4e56-8481-6b797dbd03bc tempest-CreateVolumesFromSnapshotTest-428000733 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b5984b3-aa0a-46f3-b6dd-18026e655ac9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88613) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:33:02 devstack sudo[106547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a Aug 05 10:33:02 devstack sudo[106547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:02 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7e01f5-f114-476a-9a12-3b1ce9fd497a]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:33:02 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ceda4f91-8613-4e56-8481-6b797dbd03bc tempest-CreateVolumesFromSnapshotTest-428000733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0b5984b3-aa0a-46f3-b6dd-18026e655ac9 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:02 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-8caf7536-1c05-4ff6-9b35-ffa1064ed2a0 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:33:02 devstack sudo[106549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0b5984b3-aa0a-46f3-b6dd-18026e655ac9 Aug 05 10:33:02 devstack sudo[106549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:02 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-8caf7536-1c05-4ff6-9b35-ffa1064ed2a0 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Flow 'volume_create_manager' (d5aa51f8-6dfa-4d17-98fc-ddeaa11d490c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:33:02 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-8caf7536-1c05-4ff6-9b35-ffa1064ed2a0 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (882e42ed-53c8-41cb-854f-8274fa362379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:02 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-8caf7536-1c05-4ff6-9b35-ffa1064ed2a0 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (882e42ed-53c8-41cb-854f-8274fa362379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:33:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1411065901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46c3e4f2-326e-49ad-9d64-2a23fe64a65b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93f7671870ef4865a87f4534064b201c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:33:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:33:02Z,use_quota=True,user_id='88ac70ccddaf4507835c3edfd8685a7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:02 devstack sudo[106547]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:02 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-8caf7536-1c05-4ff6-9b35-ffa1064ed2a0 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f68a3b13-afe9-48f9-a56d-ff5ea069f448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:02 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-8caf7536-1c05-4ff6-9b35-ffa1064ed2a0 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f68a3b13-afe9-48f9-a56d-ff5ea069f448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:02 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-8caf7536-1c05-4ff6-9b35-ffa1064ed2a0 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dca67aca-c823-414a-8b5f-109f50dbc749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:02 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-8caf7536-1c05-4ff6-9b35-ffa1064ed2a0 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dca67aca-c823-414a-8b5f-109f50dbc749) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46c3e4f2-326e-49ad-9d64-2a23fe64a65b', 'volume_name': 'volume-46c3e4f2-326e-49ad-9d64-2a23fe64a65b', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:02 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-8caf7536-1c05-4ff6-9b35-ffa1064ed2a0 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cfb8249-8510-4e64-8887-e5716ef79917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:02 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-8caf7536-1c05-4ff6-9b35-ffa1064ed2a0 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cfb8249-8510-4e64-8887-e5716ef79917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:02 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-8caf7536-1c05-4ff6-9b35-ffa1064ed2a0 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cf6aa4a-e1f5-4b5f-91a2-d7fd793393f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:02 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-8caf7536-1c05-4ff6-9b35-ffa1064ed2a0 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Volume 46c3e4f2-326e-49ad-9d64-2a23fe64a65b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46c3e4f2-326e-49ad-9d64-2a23fe64a65b', 'volume_size': 1} Aug 05 10:33:02 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-8caf7536-1c05-4ff6-9b35-ffa1064ed2a0 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:02 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c93ae086-97d1-41d3-b94a-1855cb8ad802 tempest-VolumeDependencyTests-1689696164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a" returned: 0 in 0.413s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:02 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-c93ae086-97d1-41d3-b94a-1855cb8ad802 tempest-VolumeDependencyTests-1689696164 None] <== create_volume: return (1284ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:33:02 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c93ae086-97d1-41d3-b94a-1855cb8ad802 tempest-VolumeDependencyTests-1689696164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.287s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:02 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-81c3e471-ff87-465a-8a17-5d1477d0d36f tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.453s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:02 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-81c3e471-ff87-465a-8a17-5d1477d0d36f tempest-CreateVolumesFromSourceVolumeTest-43181798 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:33:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-364761795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2f436cc-b7d1-4c95-a9ed-db33bda20af9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93f7671870ef4865a87f4534064b201c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:33:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:33:02Z,use_quota=True,user_id='88ac70ccddaf4507835c3edfd8685a7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:33:02 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-81c3e471-ff87-465a-8a17-5d1477d0d36f tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Creating volume c2f436cc-b7d1-4c95-a9ed-db33bda20af9 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:33:02 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-81c3e471-ff87-465a-8a17-5d1477d0d36f tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:02 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-81c3e471-ff87-465a-8a17-5d1477d0d36f tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:02 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-81c3e471-ff87-465a-8a17-5d1477d0d36f tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:33:02 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-81c3e471-ff87-465a-8a17-5d1477d0d36f tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:33:02 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-81c3e471-ff87-465a-8a17-5d1477d0d36f tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:02 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-81c3e471-ff87-465a-8a17-5d1477d0d36f tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:33:02 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-81c3e471-ff87-465a-8a17-5d1477d0d36f tempest-CreateVolumesFromSourceVolumeTest-43181798 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:33:02 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-81c3e471-ff87-465a-8a17-5d1477d0d36f tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-c2f436cc-b7d1-4c95-a9ed-db33bda20af9 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:02 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c93ae086-97d1-41d3-b94a-1855cb8ad802 tempest-VolumeDependencyTests-1689696164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d5e677e-a066-4ea3-9e0d-f6509c7c877d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:02 devstack sudo[106552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-c2f436cc-b7d1-4c95-a9ed-db33bda20af9 1073741824 Aug 05 10:33:02 devstack sudo[106552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:02 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c93ae086-97d1-41d3-b94a-1855cb8ad802 tempest-VolumeDependencyTests-1689696164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (966c3d7f-22b9-4694-ad30-ce80d29a172a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:02 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-c93ae086-97d1-41d3-b94a-1855cb8ad802 tempest-VolumeDependencyTests-1689696164 None] Volume volume-50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a (50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a): created successfully Aug 05 10:33:02 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c93ae086-97d1-41d3-b94a-1855cb8ad802 tempest-VolumeDependencyTests-1689696164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (966c3d7f-22b9-4694-ad30-ce80d29a172a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:02 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c93ae086-97d1-41d3-b94a-1855cb8ad802 tempest-VolumeDependencyTests-1689696164 None] Flow 'volume_create_manager' (371577b5-c2da-4d2c-9d46-a2f3de65ae74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:33:02 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-c93ae086-97d1-41d3-b94a-1855cb8ad802 tempest-VolumeDependencyTests-1689696164 None] Created volume successfully. Aug 05 10:33:02 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-a625b8dc-2f08-4b6f-bac6-040d37a04d0b tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:33:02 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a625b8dc-2f08-4b6f-bac6-040d37a04d0b tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Flow 'volume_create_manager' (0dc931fc-f511-4d80-9634-8ff3c1f42465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:33:02 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a625b8dc-2f08-4b6f-bac6-040d37a04d0b tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b99122a8-1ebe-4e9f-817c-9ee3d3c4be97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:02 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a625b8dc-2f08-4b6f-bac6-040d37a04d0b tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b99122a8-1ebe-4e9f-817c-9ee3d3c4be97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:33:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1213667261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e632ec27-5fb2-4d80-a83f-e0d2bcfb06d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93f7671870ef4865a87f4534064b201c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:33:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:33:03Z,use_quota=True,user_id='88ac70ccddaf4507835c3edfd8685a7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:02 devstack sudo[106549]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:02 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a625b8dc-2f08-4b6f-bac6-040d37a04d0b tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70493579-8415-4e7c-85d6-5a800426ff6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:02 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a625b8dc-2f08-4b6f-bac6-040d37a04d0b tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70493579-8415-4e7c-85d6-5a800426ff6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:02 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a625b8dc-2f08-4b6f-bac6-040d37a04d0b tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76e7c75b-f28d-4ab7-acea-81c58d984b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:02 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a625b8dc-2f08-4b6f-bac6-040d37a04d0b tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76e7c75b-f28d-4ab7-acea-81c58d984b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e632ec27-5fb2-4d80-a83f-e0d2bcfb06d6', 'volume_name': 'volume-e632ec27-5fb2-4d80-a83f-e0d2bcfb06d6', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:02 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a625b8dc-2f08-4b6f-bac6-040d37a04d0b tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d08a6fea-3892-4ac9-ae65-5017dda8a9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:02 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a625b8dc-2f08-4b6f-bac6-040d37a04d0b tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d08a6fea-3892-4ac9-ae65-5017dda8a9fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:02 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a625b8dc-2f08-4b6f-bac6-040d37a04d0b tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c7199bb-622b-4988-b1a0-b56411c4a4df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:02 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-a625b8dc-2f08-4b6f-bac6-040d37a04d0b tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Volume e632ec27-5fb2-4d80-a83f-e0d2bcfb06d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e632ec27-5fb2-4d80-a83f-e0d2bcfb06d6', 'volume_size': 1} Aug 05 10:33:02 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a625b8dc-2f08-4b6f-bac6-040d37a04d0b tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:02 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ceda4f91-8613-4e56-8481-6b797dbd03bc tempest-CreateVolumesFromSnapshotTest-428000733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0b5984b3-aa0a-46f3-b6dd-18026e655ac9" returned: 0 in 0.704s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:02 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ceda4f91-8613-4e56-8481-6b797dbd03bc tempest-CreateVolumesFromSnapshotTest-428000733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0b5984b3-aa0a-46f3-b6dd-18026e655ac9.c906fd9f-3bae-4634-a209-6a2ed2596ae4 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:02 devstack sudo[106557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0b5984b3-aa0a-46f3-b6dd-18026e655ac9.c906fd9f-3bae-4634-a209-6a2ed2596ae4 Aug 05 10:33:02 devstack sudo[106557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:03 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fa6ab83-21e8-4bf7-bd41-b2e1f6d6c22e tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:33:03 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2fa6ab83-21e8-4bf7-bd41-b2e1f6d6c22e tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Flow 'volume_create_manager' (9dccc1d4-7438-4764-ba9f-34a73134773d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:33:03 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2fa6ab83-21e8-4bf7-bd41-b2e1f6d6c22e tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c55ca25-132f-4b51-a68f-29498f8adc0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:03 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2fa6ab83-21e8-4bf7-bd41-b2e1f6d6c22e tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c55ca25-132f-4b51-a68f-29498f8adc0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:33:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1904930077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f88a235-58fe-44e7-8324-e0c5e337fb44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93f7671870ef4865a87f4534064b201c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:33:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:33:03Z,use_quota=True,user_id='88ac70ccddaf4507835c3edfd8685a7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:03 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2fa6ab83-21e8-4bf7-bd41-b2e1f6d6c22e tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d08bf7ca-1aea-431f-9691-662be262ab9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:03 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2fa6ab83-21e8-4bf7-bd41-b2e1f6d6c22e tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d08bf7ca-1aea-431f-9691-662be262ab9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:03 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2fa6ab83-21e8-4bf7-bd41-b2e1f6d6c22e tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25c9466d-d800-4ef1-b1ef-9b6a9477bfa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:03 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2fa6ab83-21e8-4bf7-bd41-b2e1f6d6c22e tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25c9466d-d800-4ef1-b1ef-9b6a9477bfa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f88a235-58fe-44e7-8324-e0c5e337fb44', 'volume_name': 'volume-4f88a235-58fe-44e7-8324-e0c5e337fb44', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:03 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2fa6ab83-21e8-4bf7-bd41-b2e1f6d6c22e tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (329aed8a-84e6-49c0-b290-317296859378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:03 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2fa6ab83-21e8-4bf7-bd41-b2e1f6d6c22e tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (329aed8a-84e6-49c0-b290-317296859378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:03 devstack sudo[106552]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:03 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2fa6ab83-21e8-4bf7-bd41-b2e1f6d6c22e tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2879dafe-f6a5-426b-9e55-397932c2e151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:03 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-2fa6ab83-21e8-4bf7-bd41-b2e1f6d6c22e tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Volume 4f88a235-58fe-44e7-8324-e0c5e337fb44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f88a235-58fe-44e7-8324-e0c5e337fb44', 'volume_size': 1} Aug 05 10:33:03 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2fa6ab83-21e8-4bf7-bd41-b2e1f6d6c22e tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:03 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-81c3e471-ff87-465a-8a17-5d1477d0d36f tempest-CreateVolumesFromSourceVolumeTest-43181798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-c2f436cc-b7d1-4c95-a9ed-db33bda20af9 1073741824" returned: 0 in 0.877s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:03 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-0fafafb4-527d-419e-9b7c-dc9523f8fae6 tempest-VolumeDependencyTests-1689696164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:03 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-81c3e471-ff87-465a-8a17-5d1477d0d36f tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-c2f436cc-b7d1-4c95-a9ed-db33bda20af9 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:03 devstack sudo[106567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-c2f436cc-b7d1-4c95-a9ed-db33bda20af9 Aug 05 10:33:03 devstack sudo[106567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:03 devstack sudo[106557]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:03 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ceda4f91-8613-4e56-8481-6b797dbd03bc tempest-CreateVolumesFromSnapshotTest-428000733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0b5984b3-aa0a-46f3-b6dd-18026e655ac9.c906fd9f-3bae-4634-a209-6a2ed2596ae4" returned: 0 in 0.698s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:03 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ceda4f91-8613-4e56-8481-6b797dbd03bc tempest-CreateVolumesFromSnapshotTest-428000733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0b5984b3-aa0a-46f3-b6dd-18026e655ac9.c906fd9f-3bae-4634-a209-6a2ed2596ae4 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:03 devstack sudo[106569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0b5984b3-aa0a-46f3-b6dd-18026e655ac9.c906fd9f-3bae-4634-a209-6a2ed2596ae4 Aug 05 10:33:03 devstack sudo[106569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:03 devstack sudo[106567]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:03 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-81c3e471-ff87-465a-8a17-5d1477d0d36f tempest-CreateVolumesFromSourceVolumeTest-43181798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-c2f436cc-b7d1-4c95-a9ed-db33bda20af9" returned: 0 in 0.329s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:03 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-81c3e471-ff87-465a-8a17-5d1477d0d36f tempest-CreateVolumesFromSourceVolumeTest-43181798 None] <== create_volume: return (1261ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:33:03 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-81c3e471-ff87-465a-8a17-5d1477d0d36f tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.266s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:03 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-8caf7536-1c05-4ff6-9b35-ffa1064ed2a0 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.281s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:03 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-8caf7536-1c05-4ff6-9b35-ffa1064ed2a0 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:33:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1411065901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46c3e4f2-326e-49ad-9d64-2a23fe64a65b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93f7671870ef4865a87f4534064b201c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:33:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:33:02Z,use_quota=True,user_id='88ac70ccddaf4507835c3edfd8685a7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:33:03 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-8caf7536-1c05-4ff6-9b35-ffa1064ed2a0 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Creating volume 46c3e4f2-326e-49ad-9d64-2a23fe64a65b {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:33:03 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-8caf7536-1c05-4ff6-9b35-ffa1064ed2a0 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:03 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-8caf7536-1c05-4ff6-9b35-ffa1064ed2a0 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:03 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-8caf7536-1c05-4ff6-9b35-ffa1064ed2a0 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:33:03 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-8caf7536-1c05-4ff6-9b35-ffa1064ed2a0 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:33:03 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-8caf7536-1c05-4ff6-9b35-ffa1064ed2a0 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:03 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-8caf7536-1c05-4ff6-9b35-ffa1064ed2a0 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:33:03 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-8caf7536-1c05-4ff6-9b35-ffa1064ed2a0 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:33:03 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-8caf7536-1c05-4ff6-9b35-ffa1064ed2a0 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-46c3e4f2-326e-49ad-9d64-2a23fe64a65b 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:03 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-81c3e471-ff87-465a-8a17-5d1477d0d36f tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63ddee3b-85e0-44cf-a005-e508a91e3206) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2f436cc-b7d1-4c95-a9ed-db33bda20af9', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:03 devstack sudo[106572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-46c3e4f2-326e-49ad-9d64-2a23fe64a65b 1073741824 Aug 05 10:33:03 devstack sudo[106572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:03 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-81c3e471-ff87-465a-8a17-5d1477d0d36f tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4410b7ae-6758-417d-be86-777da74b9f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:03 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-81c3e471-ff87-465a-8a17-5d1477d0d36f tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Volume volume-c2f436cc-b7d1-4c95-a9ed-db33bda20af9 (c2f436cc-b7d1-4c95-a9ed-db33bda20af9): created successfully Aug 05 10:33:03 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-81c3e471-ff87-465a-8a17-5d1477d0d36f tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4410b7ae-6758-417d-be86-777da74b9f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:03 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-81c3e471-ff87-465a-8a17-5d1477d0d36f tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Flow 'volume_create_manager' (77d66deb-5076-4f72-8649-bdaf295f1e3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:33:03 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-72463581-6e69-4b51-806c-cd0abe8f3884 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:33:03 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-72463581-6e69-4b51-806c-cd0abe8f3884 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Flow 'volume_create_manager' (127e19a1-3cc6-4fc8-8b62-1c011d2381bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:33:03 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-72463581-6e69-4b51-806c-cd0abe8f3884 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca54cc5d-cf01-44e3-bba6-b59c700a8b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:03 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-81c3e471-ff87-465a-8a17-5d1477d0d36f tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Created volume successfully. Aug 05 10:33:03 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-72463581-6e69-4b51-806c-cd0abe8f3884 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca54cc5d-cf01-44e3-bba6-b59c700a8b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:33:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-145664216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff4134e8-bda9-4b61-af64-378872a210ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93f7671870ef4865a87f4534064b201c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:33:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:33:04Z,use_quota=True,user_id='88ac70ccddaf4507835c3edfd8685a7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:03 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-72463581-6e69-4b51-806c-cd0abe8f3884 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (452cfed8-d28f-4c8e-bd0e-7f298bf4d470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:03 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-72463581-6e69-4b51-806c-cd0abe8f3884 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (452cfed8-d28f-4c8e-bd0e-7f298bf4d470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:03 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-72463581-6e69-4b51-806c-cd0abe8f3884 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e618f48-c6fe-4c30-aab9-4c3cbaf4393b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:03 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-72463581-6e69-4b51-806c-cd0abe8f3884 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e618f48-c6fe-4c30-aab9-4c3cbaf4393b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff4134e8-bda9-4b61-af64-378872a210ee', 'volume_name': 'volume-ff4134e8-bda9-4b61-af64-378872a210ee', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:03 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-72463581-6e69-4b51-806c-cd0abe8f3884 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f53cabd4-5494-49fd-832d-776798104148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:03 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-72463581-6e69-4b51-806c-cd0abe8f3884 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f53cabd4-5494-49fd-832d-776798104148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:03 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-72463581-6e69-4b51-806c-cd0abe8f3884 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7be3725b-462b-4bf2-a573-0411f9133609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:03 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-72463581-6e69-4b51-806c-cd0abe8f3884 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Volume ff4134e8-bda9-4b61-af64-378872a210ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff4134e8-bda9-4b61-af64-378872a210ee', 'volume_size': 1} Aug 05 10:33:03 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-72463581-6e69-4b51-806c-cd0abe8f3884 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:03 devstack sudo[106569]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:03 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ceda4f91-8613-4e56-8481-6b797dbd03bc tempest-CreateVolumesFromSnapshotTest-428000733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0b5984b3-aa0a-46f3-b6dd-18026e655ac9.c906fd9f-3bae-4634-a209-6a2ed2596ae4" returned: 0 in 0.441s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:03 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-ceda4f91-8613-4e56-8481-6b797dbd03bc tempest-CreateVolumesFromSnapshotTest-428000733 None] Lock "cinder-quobyte-c906fd9f-3bae-4634-a209-6a2ed2596ae4" released by "_delete_snapshot" :: held 2.674s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:03 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-ceda4f91-8613-4e56-8481-6b797dbd03bc tempest-CreateVolumesFromSnapshotTest-428000733 None] Lock "cinder-quobyte-0b5984b3-aa0a-46f3-b6dd-18026e655ac9" released by "delete_snapshot" :: held 2.714s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:04 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-ceda4f91-8613-4e56-8481-6b797dbd03bc tempest-CreateVolumesFromSnapshotTest-428000733 None] Created reservations ['ec0ae757-39be-4d73-9c13-bf1ec47ceaf9', '98841112-6391-41af-b058-9f9347caf596', '23effcd1-0638-4bbd-a3d5-43d0db349233', 'd8515f75-f07e-4593-a8f3-be85d5133115'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:33:04 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-ceda4f91-8613-4e56-8481-6b797dbd03bc tempest-CreateVolumesFromSnapshotTest-428000733 None] Delete snapshot completed successfully. Aug 05 10:33:04 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-ceda4f91-8613-4e56-8481-6b797dbd03bc tempest-CreateVolumesFromSnapshotTest-428000733 None] Lock "cinder-c906fd9f-3bae-4634-a209-6a2ed2596ae4-delete_snapshot" released by "delete_snapshot" :: held 2.920s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:04 devstack sudo[106572]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-8caf7536-1c05-4ff6-9b35-ffa1064ed2a0 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-46c3e4f2-326e-49ad-9d64-2a23fe64a65b 1073741824" returned: 0 in 0.527s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-8caf7536-1c05-4ff6-9b35-ffa1064ed2a0 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-46c3e4f2-326e-49ad-9d64-2a23fe64a65b {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:04 devstack sudo[106579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-46c3e4f2-326e-49ad-9d64-2a23fe64a65b Aug 05 10:33:04 devstack sudo[106579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:04 devstack sudo[106579]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-8caf7536-1c05-4ff6-9b35-ffa1064ed2a0 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-46c3e4f2-326e-49ad-9d64-2a23fe64a65b" returned: 0 in 0.259s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:04 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-8caf7536-1c05-4ff6-9b35-ffa1064ed2a0 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:33:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-8caf7536-1c05-4ff6-9b35-ffa1064ed2a0 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a625b8dc-2f08-4b6f-bac6-040d37a04d0b tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.763s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:04 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-a625b8dc-2f08-4b6f-bac6-040d37a04d0b tempest-CreateVolumesFromSourceVolumeTest-43181798 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:33:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1213667261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e632ec27-5fb2-4d80-a83f-e0d2bcfb06d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93f7671870ef4865a87f4534064b201c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:33:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:33:03Z,use_quota=True,user_id='88ac70ccddaf4507835c3edfd8685a7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:33:04 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-a625b8dc-2f08-4b6f-bac6-040d37a04d0b tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Creating volume e632ec27-5fb2-4d80-a83f-e0d2bcfb06d6 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:33:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a625b8dc-2f08-4b6f-bac6-040d37a04d0b tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a625b8dc-2f08-4b6f-bac6-040d37a04d0b tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:04 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-a625b8dc-2f08-4b6f-bac6-040d37a04d0b tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:33:04 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-a625b8dc-2f08-4b6f-bac6-040d37a04d0b tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:33:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a625b8dc-2f08-4b6f-bac6-040d37a04d0b tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:04 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-a625b8dc-2f08-4b6f-bac6-040d37a04d0b tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:33:04 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-a625b8dc-2f08-4b6f-bac6-040d37a04d0b tempest-CreateVolumesFromSourceVolumeTest-43181798 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:33:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a625b8dc-2f08-4b6f-bac6-040d37a04d0b tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e632ec27-5fb2-4d80-a83f-e0d2bcfb06d6 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:04 devstack sudo[106582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e632ec27-5fb2-4d80-a83f-e0d2bcfb06d6 1073741824 Aug 05 10:33:04 devstack sudo[106582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:04 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-8caf7536-1c05-4ff6-9b35-ffa1064ed2a0 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cf6aa4a-e1f5-4b5f-91a2-d7fd793393f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46c3e4f2-326e-49ad-9d64-2a23fe64a65b', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:04 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-8caf7536-1c05-4ff6-9b35-ffa1064ed2a0 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70281429-66ad-45e9-843f-7e869580072d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:04 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-8caf7536-1c05-4ff6-9b35-ffa1064ed2a0 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Volume volume-46c3e4f2-326e-49ad-9d64-2a23fe64a65b (46c3e4f2-326e-49ad-9d64-2a23fe64a65b): created successfully Aug 05 10:33:04 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-8caf7536-1c05-4ff6-9b35-ffa1064ed2a0 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70281429-66ad-45e9-843f-7e869580072d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:04 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-8caf7536-1c05-4ff6-9b35-ffa1064ed2a0 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Flow 'volume_create_manager' (d5aa51f8-6dfa-4d17-98fc-ddeaa11d490c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:33:04 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-8caf7536-1c05-4ff6-9b35-ffa1064ed2a0 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Created volume successfully. Aug 05 10:33:04 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-72ad4642-84ae-474a-89ac-037778633c5f tempest-CreateVolumesFromSnapshotTest-428000733 None] Acquiring lock "cinder-0b5984b3-aa0a-46f3-b6dd-18026e655ac9-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:04 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-72ad4642-84ae-474a-89ac-037778633c5f tempest-CreateVolumesFromSnapshotTest-428000733 None] Lock "cinder-0b5984b3-aa0a-46f3-b6dd-18026e655ac9-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:04 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-72ad4642-84ae-474a-89ac-037778633c5f tempest-CreateVolumesFromSnapshotTest-428000733 None] Acquiring lock "cinder-quobyte-0b5984b3-aa0a-46f3-b6dd-18026e655ac9" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:04 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-72ad4642-84ae-474a-89ac-037778633c5f tempest-CreateVolumesFromSnapshotTest-428000733 None] Lock "cinder-quobyte-0b5984b3-aa0a-46f3-b6dd-18026e655ac9" acquired by "delete_volume" :: waited 0.021s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:04 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccff177b-4e89-43d8-8f3b-24933323cabd]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:33:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-72ad4642-84ae-474a-89ac-037778633c5f tempest-CreateVolumesFromSnapshotTest-428000733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0b5984b3-aa0a-46f3-b6dd-18026e655ac9 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:04 devstack sudo[106587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0b5984b3-aa0a-46f3-b6dd-18026e655ac9 Aug 05 10:33:04 devstack sudo[106587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:05 devstack sudo[106582]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:05 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a625b8dc-2f08-4b6f-bac6-040d37a04d0b tempest-CreateVolumesFromSourceVolumeTest-43181798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e632ec27-5fb2-4d80-a83f-e0d2bcfb06d6 1073741824" returned: 0 in 0.567s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:05 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a625b8dc-2f08-4b6f-bac6-040d37a04d0b tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e632ec27-5fb2-4d80-a83f-e0d2bcfb06d6 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:05 devstack sudo[106590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e632ec27-5fb2-4d80-a83f-e0d2bcfb06d6 Aug 05 10:33:05 devstack sudo[106590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:05 devstack sudo[106587]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:05 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-72ad4642-84ae-474a-89ac-037778633c5f tempest-CreateVolumesFromSnapshotTest-428000733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0b5984b3-aa0a-46f3-b6dd-18026e655ac9" returned: 0 in 0.420s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:05 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-72ad4642-84ae-474a-89ac-037778633c5f tempest-CreateVolumesFromSnapshotTest-428000733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0b5984b3-aa0a-46f3-b6dd-18026e655ac9 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:05 devstack sudo[106595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0b5984b3-aa0a-46f3-b6dd-18026e655ac9 Aug 05 10:33:05 devstack sudo[106595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:05 devstack sudo[106590]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:05 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a625b8dc-2f08-4b6f-bac6-040d37a04d0b tempest-CreateVolumesFromSourceVolumeTest-43181798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e632ec27-5fb2-4d80-a83f-e0d2bcfb06d6" returned: 0 in 0.259s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:05 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-a625b8dc-2f08-4b6f-bac6-040d37a04d0b tempest-CreateVolumesFromSourceVolumeTest-43181798 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:33:05 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a625b8dc-2f08-4b6f-bac6-040d37a04d0b tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:05 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2fa6ab83-21e8-4bf7-bd41-b2e1f6d6c22e tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.135s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:05 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-2fa6ab83-21e8-4bf7-bd41-b2e1f6d6c22e tempest-CreateVolumesFromSourceVolumeTest-43181798 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:33:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1904930077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f88a235-58fe-44e7-8324-e0c5e337fb44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93f7671870ef4865a87f4534064b201c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:33:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:33:03Z,use_quota=True,user_id='88ac70ccddaf4507835c3edfd8685a7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:33:05 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-2fa6ab83-21e8-4bf7-bd41-b2e1f6d6c22e tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Creating volume 4f88a235-58fe-44e7-8324-e0c5e337fb44 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:33:05 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2fa6ab83-21e8-4bf7-bd41-b2e1f6d6c22e tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:05 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2fa6ab83-21e8-4bf7-bd41-b2e1f6d6c22e tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:05 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-2fa6ab83-21e8-4bf7-bd41-b2e1f6d6c22e tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:33:05 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-2fa6ab83-21e8-4bf7-bd41-b2e1f6d6c22e tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:33:05 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2fa6ab83-21e8-4bf7-bd41-b2e1f6d6c22e tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:05 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-2fa6ab83-21e8-4bf7-bd41-b2e1f6d6c22e tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:33:05 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-2fa6ab83-21e8-4bf7-bd41-b2e1f6d6c22e tempest-CreateVolumesFromSourceVolumeTest-43181798 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:33:05 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2fa6ab83-21e8-4bf7-bd41-b2e1f6d6c22e tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-4f88a235-58fe-44e7-8324-e0c5e337fb44 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:05 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a625b8dc-2f08-4b6f-bac6-040d37a04d0b tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c7199bb-622b-4988-b1a0-b56411c4a4df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e632ec27-5fb2-4d80-a83f-e0d2bcfb06d6', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:05 devstack sudo[106598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-4f88a235-58fe-44e7-8324-e0c5e337fb44 1073741824 Aug 05 10:33:05 devstack sudo[106598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:05 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a625b8dc-2f08-4b6f-bac6-040d37a04d0b tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a15425f6-10b6-488a-ae88-41fdc09ca49c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:05 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-a625b8dc-2f08-4b6f-bac6-040d37a04d0b tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Volume volume-e632ec27-5fb2-4d80-a83f-e0d2bcfb06d6 (e632ec27-5fb2-4d80-a83f-e0d2bcfb06d6): created successfully Aug 05 10:33:05 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a625b8dc-2f08-4b6f-bac6-040d37a04d0b tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a15425f6-10b6-488a-ae88-41fdc09ca49c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:05 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-a625b8dc-2f08-4b6f-bac6-040d37a04d0b tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Flow 'volume_create_manager' (0dc931fc-f511-4d80-9634-8ff3c1f42465) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:33:05 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-a625b8dc-2f08-4b6f-bac6-040d37a04d0b tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Created volume successfully. Aug 05 10:33:05 devstack sudo[106595]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:05 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-72ad4642-84ae-474a-89ac-037778633c5f tempest-CreateVolumesFromSnapshotTest-428000733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0b5984b3-aa0a-46f3-b6dd-18026e655ac9" returned: 0 in 0.298s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:05 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-72ad4642-84ae-474a-89ac-037778633c5f tempest-CreateVolumesFromSnapshotTest-428000733 None] Lock "cinder-quobyte-0b5984b3-aa0a-46f3-b6dd-18026e655ac9" released by "delete_volume" :: held 0.803s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:05 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-72ad4642-84ae-474a-89ac-037778633c5f tempest-CreateVolumesFromSnapshotTest-428000733 None] Created reservations ['ce94a680-dd0f-4ac6-80ff-9bc6d60d2149', '58c762d4-c4e1-46a3-9ff6-f1fac03bf8c5', '23e18e21-d5ac-4358-abd0-5d101aef2c72', '1942eb6d-b6f1-4576-ace5-9b4c78cce18b'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:33:05 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-72ad4642-84ae-474a-89ac-037778633c5f tempest-CreateVolumesFromSnapshotTest-428000733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:05 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-72ad4642-84ae-474a-89ac-037778633c5f tempest-CreateVolumesFromSnapshotTest-428000733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:05 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-72ad4642-84ae-474a-89ac-037778633c5f tempest-CreateVolumesFromSnapshotTest-428000733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:33:05 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-72ad4642-84ae-474a-89ac-037778633c5f tempest-CreateVolumesFromSnapshotTest-428000733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:33:05 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-72ad4642-84ae-474a-89ac-037778633c5f tempest-CreateVolumesFromSnapshotTest-428000733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:05 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-72ad4642-84ae-474a-89ac-037778633c5f tempest-CreateVolumesFromSnapshotTest-428000733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:05 devstack sudo[106604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:33:05 devstack sudo[106604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:06 devstack sudo[106598]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2fa6ab83-21e8-4bf7-bd41-b2e1f6d6c22e tempest-CreateVolumesFromSourceVolumeTest-43181798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-4f88a235-58fe-44e7-8324-e0c5e337fb44 1073741824" returned: 0 in 0.571s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2fa6ab83-21e8-4bf7-bd41-b2e1f6d6c22e tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-4f88a235-58fe-44e7-8324-e0c5e337fb44 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:06 devstack sudo[106604]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:06 devstack sudo[106608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-4f88a235-58fe-44e7-8324-e0c5e337fb44 Aug 05 10:33:06 devstack sudo[106608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-72ad4642-84ae-474a-89ac-037778633c5f tempest-CreateVolumesFromSnapshotTest-428000733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.349s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:06 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-72ad4642-84ae-474a-89ac-037778633c5f tempest-CreateVolumesFromSnapshotTest-428000733 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:33:06 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-72ad4642-84ae-474a-89ac-037778633c5f tempest-CreateVolumesFromSnapshotTest-428000733 None] Deleted volume successfully. Aug 05 10:33:06 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-72ad4642-84ae-474a-89ac-037778633c5f tempest-CreateVolumesFromSnapshotTest-428000733 None] Lock "cinder-0b5984b3-aa0a-46f3-b6dd-18026e655ac9-delete_volume" released by "delete_volume" :: held 1.434s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:06 devstack sudo[106608]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2fa6ab83-21e8-4bf7-bd41-b2e1f6d6c22e tempest-CreateVolumesFromSourceVolumeTest-43181798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-4f88a235-58fe-44e7-8324-e0c5e337fb44" returned: 0 in 0.265s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:06 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-2fa6ab83-21e8-4bf7-bd41-b2e1f6d6c22e tempest-CreateVolumesFromSourceVolumeTest-43181798 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:33:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2fa6ab83-21e8-4bf7-bd41-b2e1f6d6c22e tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-0fafafb4-527d-419e-9b7c-dc9523f8fae6 tempest-VolumeDependencyTests-1689696164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.002s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:06 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2fa6ab83-21e8-4bf7-bd41-b2e1f6d6c22e tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2879dafe-f6a5-426b-9e55-397932c2e151) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f88a235-58fe-44e7-8324-e0c5e337fb44', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:06 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2fa6ab83-21e8-4bf7-bd41-b2e1f6d6c22e tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3a9f9f8-eca6-4b6f-aeba-03066ab53ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:06 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-0fafafb4-527d-419e-9b7c-dc9523f8fae6 tempest-VolumeDependencyTests-1689696164 None] Creating offline snapshot 42cca555-ea9d-46a1-a003-2b9e2aa368bf of volume 50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a {{(pid=88613) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:33:06 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-2fa6ab83-21e8-4bf7-bd41-b2e1f6d6c22e tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Volume volume-4f88a235-58fe-44e7-8324-e0c5e337fb44 (4f88a235-58fe-44e7-8324-e0c5e337fb44): created successfully Aug 05 10:33:06 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2fa6ab83-21e8-4bf7-bd41-b2e1f6d6c22e tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3a9f9f8-eca6-4b6f-aeba-03066ab53ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:06 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2fa6ab83-21e8-4bf7-bd41-b2e1f6d6c22e tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Flow 'volume_create_manager' (9dccc1d4-7438-4764-ba9f-34a73134773d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:33:06 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d1a37af-f306-4bfb-a00a-684d07f51386]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:33:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-0fafafb4-527d-419e-9b7c-dc9523f8fae6 tempest-VolumeDependencyTests-1689696164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:06 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-2fa6ab83-21e8-4bf7-bd41-b2e1f6d6c22e tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Created volume successfully. Aug 05 10:33:06 devstack sudo[106611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a Aug 05 10:33:06 devstack sudo[106611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:06 devstack sudo[106611]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-0fafafb4-527d-419e-9b7c-dc9523f8fae6 tempest-VolumeDependencyTests-1689696164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a" returned: 0 in 0.436s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-0fafafb4-527d-419e-9b7c-dc9523f8fae6 tempest-VolumeDependencyTests-1689696164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a.42cca555-ea9d-46a1-a003-2b9e2aa368bf 1G {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:06 devstack sudo[106616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a.42cca555-ea9d-46a1-a003-2b9e2aa368bf 1G Aug 05 10:33:06 devstack sudo[106616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:07 devstack sudo[106616]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-0fafafb4-527d-419e-9b7c-dc9523f8fae6 tempest-VolumeDependencyTests-1689696164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a.42cca555-ea9d-46a1-a003-2b9e2aa368bf 1G" returned: 0 in 0.561s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-0fafafb4-527d-419e-9b7c-dc9523f8fae6 tempest-VolumeDependencyTests-1689696164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a.42cca555-ea9d-46a1-a003-2b9e2aa368bf {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:07 devstack sudo[106623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a.42cca555-ea9d-46a1-a003-2b9e2aa368bf Aug 05 10:33:07 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:07 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-0fafafb4-527d-419e-9b7c-dc9523f8fae6 tempest-VolumeDependencyTests-1689696164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a.42cca555-ea9d-46a1-a003-2b9e2aa368bf" returned: 0 in 0.366s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:07 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-0fafafb4-527d-419e-9b7c-dc9523f8fae6 tempest-VolumeDependencyTests-1689696164 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a.42cca555-ea9d-46a1-a003-2b9e2aa368bf is being set with open permissions: ugo+rw Aug 05 10:33:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-0fafafb4-527d-419e-9b7c-dc9523f8fae6 tempest-VolumeDependencyTests-1689696164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a.42cca555-ea9d-46a1-a003-2b9e2aa368bf {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:07 devstack sudo[106628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a.42cca555-ea9d-46a1-a003-2b9e2aa368bf Aug 05 10:33:07 devstack sudo[106628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:08 devstack sudo[106628]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-0fafafb4-527d-419e-9b7c-dc9523f8fae6 tempest-VolumeDependencyTests-1689696164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a.42cca555-ea9d-46a1-a003-2b9e2aa368bf" returned: 0 in 0.285s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-0fafafb4-527d-419e-9b7c-dc9523f8fae6 tempest-VolumeDependencyTests-1689696164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:08 devstack sudo[106631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a.info Aug 05 10:33:08 devstack sudo[106631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:08 devstack sudo[106631]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-0fafafb4-527d-419e-9b7c-dc9523f8fae6 tempest-VolumeDependencyTests-1689696164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a.info" returned: 0 in 0.290s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:08 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-0fafafb4-527d-419e-9b7c-dc9523f8fae6 tempest-VolumeDependencyTests-1689696164 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a.info is being set with open permissions: ugo+rw Aug 05 10:33:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-0fafafb4-527d-419e-9b7c-dc9523f8fae6 tempest-VolumeDependencyTests-1689696164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:08 devstack sudo[106634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a.info Aug 05 10:33:08 devstack sudo[106634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:08 devstack sudo[106634]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-0fafafb4-527d-419e-9b7c-dc9523f8fae6 tempest-VolumeDependencyTests-1689696164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a.info" returned: 0 in 0.293s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-0fafafb4-527d-419e-9b7c-dc9523f8fae6 tempest-VolumeDependencyTests-1689696164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.388s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-72463581-6e69-4b51-806c-cd0abe8f3884 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.838s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:08 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-72463581-6e69-4b51-806c-cd0abe8f3884 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:33:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-145664216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff4134e8-bda9-4b61-af64-378872a210ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93f7671870ef4865a87f4534064b201c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:33:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:33:04Z,use_quota=True,user_id='88ac70ccddaf4507835c3edfd8685a7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:33:08 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-72463581-6e69-4b51-806c-cd0abe8f3884 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Creating volume ff4134e8-bda9-4b61-af64-378872a210ee {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:33:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-72463581-6e69-4b51-806c-cd0abe8f3884 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-72463581-6e69-4b51-806c-cd0abe8f3884 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:08 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-72463581-6e69-4b51-806c-cd0abe8f3884 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:33:08 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-72463581-6e69-4b51-806c-cd0abe8f3884 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:33:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-72463581-6e69-4b51-806c-cd0abe8f3884 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:08 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-72463581-6e69-4b51-806c-cd0abe8f3884 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:33:08 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-72463581-6e69-4b51-806c-cd0abe8f3884 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:33:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-72463581-6e69-4b51-806c-cd0abe8f3884 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ff4134e8-bda9-4b61-af64-378872a210ee 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:08 devstack sudo[106643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ff4134e8-bda9-4b61-af64-378872a210ee 1073741824 Aug 05 10:33:08 devstack sudo[106643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:08 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-0fafafb4-527d-419e-9b7c-dc9523f8fae6 tempest-VolumeDependencyTests-1689696164 None] Create snapshot completed successfully Aug 05 10:33:09 devstack sudo[106643]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-72463581-6e69-4b51-806c-cd0abe8f3884 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ff4134e8-bda9-4b61-af64-378872a210ee 1073741824" returned: 0 in 0.525s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-72463581-6e69-4b51-806c-cd0abe8f3884 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ff4134e8-bda9-4b61-af64-378872a210ee {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:09 devstack sudo[106649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ff4134e8-bda9-4b61-af64-378872a210ee Aug 05 10:33:09 devstack sudo[106649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:09 devstack sudo[106649]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-72463581-6e69-4b51-806c-cd0abe8f3884 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ff4134e8-bda9-4b61-af64-378872a210ee" returned: 0 in 0.281s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:09 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-72463581-6e69-4b51-806c-cd0abe8f3884 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:33:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-72463581-6e69-4b51-806c-cd0abe8f3884 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:09 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-72463581-6e69-4b51-806c-cd0abe8f3884 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7be3725b-462b-4bf2-a573-0411f9133609) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff4134e8-bda9-4b61-af64-378872a210ee', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:09 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-72463581-6e69-4b51-806c-cd0abe8f3884 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98ec0b4b-a1f4-4a92-85f1-c05699b3c6e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:09 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-72463581-6e69-4b51-806c-cd0abe8f3884 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Volume volume-ff4134e8-bda9-4b61-af64-378872a210ee (ff4134e8-bda9-4b61-af64-378872a210ee): created successfully Aug 05 10:33:09 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-72463581-6e69-4b51-806c-cd0abe8f3884 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98ec0b4b-a1f4-4a92-85f1-c05699b3c6e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:09 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-72463581-6e69-4b51-806c-cd0abe8f3884 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Flow 'volume_create_manager' (127e19a1-3cc6-4fc8-8b62-1c011d2381bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:33:09 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-72463581-6e69-4b51-806c-cd0abe8f3884 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Created volume successfully. Aug 05 10:33:09 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-664281df-f04e-4207-9ab3-37dffd934e5e tempest-ProjectAdminTests-1542470402 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7257652282715, 'free_capacity_gb': 1775.7257652282715, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88613) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 05 10:33:10 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4b04622-f8d1-4cba-b3df-cae694315f8a tempest-VolumeDependencyTests-1689696164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:33:10 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-00f21778-ae2b-45ed-8dc6-a53864a4b362 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Acquiring lock "cinder-ff4134e8-bda9-4b61-af64-378872a210ee-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:10 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-e4b04622-f8d1-4cba-b3df-cae694315f8a tempest-VolumeDependencyTests-1689696164 None] Flow 'volume_create_manager' (02578056-257e-4467-8c6b-d169e61794ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:33:10 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-e4b04622-f8d1-4cba-b3df-cae694315f8a tempest-VolumeDependencyTests-1689696164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b20f73b-79ce-4b54-87e7-7479ded1c5bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:10 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-00f21778-ae2b-45ed-8dc6-a53864a4b362 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Lock "cinder-ff4134e8-bda9-4b61-af64-378872a210ee-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:10 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-e4b04622-f8d1-4cba-b3df-cae694315f8a tempest-VolumeDependencyTests-1689696164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b20f73b-79ce-4b54-87e7-7479ded1c5bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:33:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-206233885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61c6357f-66c1-41e5-b846-a48b69fe84c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ec15480f5d74dffb5a1eb8f2edf4e22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:33:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=42cca555-ea9d-46a1-a003-2b9e2aa368bf,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:33:11Z,use_quota=True,user_id='a1469325018c45369a72d83f06b11ade',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:10 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-e4b04622-f8d1-4cba-b3df-cae694315f8a tempest-VolumeDependencyTests-1689696164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db4c1a9d-de58-4785-b52f-b32eaab71284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:10 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-e4b04622-f8d1-4cba-b3df-cae694315f8a tempest-VolumeDependencyTests-1689696164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db4c1a9d-de58-4785-b52f-b32eaab71284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:10 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-e4b04622-f8d1-4cba-b3df-cae694315f8a tempest-VolumeDependencyTests-1689696164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f92cd848-bcde-40e3-8fe7-a419570d5c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:10 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-e4b04622-f8d1-4cba-b3df-cae694315f8a tempest-VolumeDependencyTests-1689696164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f92cd848-bcde-40e3-8fe7-a419570d5c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '61c6357f-66c1-41e5-b846-a48b69fe84c3', 'volume_name': 'volume-61c6357f-66c1-41e5-b846-a48b69fe84c3', 'volume_size': 1, 'snapshot_id': '42cca555-ea9d-46a1-a003-2b9e2aa368bf'}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:10 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-e4b04622-f8d1-4cba-b3df-cae694315f8a tempest-VolumeDependencyTests-1689696164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffe21703-c839-48da-925c-b4ad972b42c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:10 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-e4b04622-f8d1-4cba-b3df-cae694315f8a tempest-VolumeDependencyTests-1689696164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffe21703-c839-48da-925c-b4ad972b42c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:10 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-e4b04622-f8d1-4cba-b3df-cae694315f8a tempest-VolumeDependencyTests-1689696164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (821d78a4-4b91-4a18-9b2f-b5faef32f51f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:10 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-e4b04622-f8d1-4cba-b3df-cae694315f8a tempest-VolumeDependencyTests-1689696164 None] Volume 61c6357f-66c1-41e5-b846-a48b69fe84c3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-61c6357f-66c1-41e5-b846-a48b69fe84c3', 'volume_size': 1, 'snapshot_id': '42cca555-ea9d-46a1-a003-2b9e2aa368bf'} Aug 05 10:33:10 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-e4b04622-f8d1-4cba-b3df-cae694315f8a tempest-VolumeDependencyTests-1689696164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:10 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-e4b04622-f8d1-4cba-b3df-cae694315f8a tempest-VolumeDependencyTests-1689696164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:10 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e4b04622-f8d1-4cba-b3df-cae694315f8a tempest-VolumeDependencyTests-1689696164 None] Acquiring lock "cinder-quobyte-42cca555-ea9d-46a1-a003-2b9e2aa368bf-61c6357f-66c1-41e5-b846-a48b69fe84c3" by "_create_volume_from_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:10 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-00f21778-ae2b-45ed-8dc6-a53864a4b362 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Acquiring lock "cinder-quobyte-ff4134e8-bda9-4b61-af64-378872a210ee" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:10 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e4b04622-f8d1-4cba-b3df-cae694315f8a tempest-VolumeDependencyTests-1689696164 None] Lock "cinder-quobyte-42cca555-ea9d-46a1-a003-2b9e2aa368bf-61c6357f-66c1-41e5-b846-a48b69fe84c3" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:10 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-e4b04622-f8d1-4cba-b3df-cae694315f8a tempest-VolumeDependencyTests-1689696164 None] Creating volume 61c6357f-66c1-41e5-b846-a48b69fe84c3 from snapshot 42cca555-ea9d-46a1-a003-2b9e2aa368bf {{(pid=88613) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 05 10:33:10 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-e4b04622-f8d1-4cba-b3df-cae694315f8a tempest-VolumeDependencyTests-1689696164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:10 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-e4b04622-f8d1-4cba-b3df-cae694315f8a tempest-VolumeDependencyTests-1689696164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:10 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-e4b04622-f8d1-4cba-b3df-cae694315f8a tempest-VolumeDependencyTests-1689696164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:33:10 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-e4b04622-f8d1-4cba-b3df-cae694315f8a tempest-VolumeDependencyTests-1689696164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:33:10 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-e4b04622-f8d1-4cba-b3df-cae694315f8a tempest-VolumeDependencyTests-1689696164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:10 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-e4b04622-f8d1-4cba-b3df-cae694315f8a tempest-VolumeDependencyTests-1689696164 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:33:10 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e4b04622-f8d1-4cba-b3df-cae694315f8a tempest-VolumeDependencyTests-1689696164 None] Acquiring lock "cinder-quobyte-61c6357f-66c1-41e5-b846-a48b69fe84c3" by "_copy_volume_from_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:10 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-00f21778-ae2b-45ed-8dc6-a53864a4b362 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Lock "cinder-quobyte-ff4134e8-bda9-4b61-af64-378872a210ee" acquired by "delete_volume" :: waited 0.031s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:10 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e4b04622-f8d1-4cba-b3df-cae694315f8a tempest-VolumeDependencyTests-1689696164 None] Lock "cinder-quobyte-61c6357f-66c1-41e5-b846-a48b69fe84c3" acquired by "_copy_volume_from_snapshot" :: waited 0.043s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:10 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-e4b04622-f8d1-4cba-b3df-cae694315f8a tempest-VolumeDependencyTests-1689696164 None] snapshot: 42cca555-ea9d-46a1-a003-2b9e2aa368bf, volume: 61c6357f-66c1-41e5-b846-a48b69fe84c3, {{(pid=88613) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 05 10:33:10 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[650d7622-b476-40c5-8045-3a3ecd39491a]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:33:10 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-00f21778-ae2b-45ed-8dc6-a53864a4b362 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ff4134e8-bda9-4b61-af64-378872a210ee {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:10 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-e4b04622-f8d1-4cba-b3df-cae694315f8a tempest-VolumeDependencyTests-1689696164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:10 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-e4b04622-f8d1-4cba-b3df-cae694315f8a tempest-VolumeDependencyTests-1689696164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:10 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-e4b04622-f8d1-4cba-b3df-cae694315f8a tempest-VolumeDependencyTests-1689696164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:33:10 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-e4b04622-f8d1-4cba-b3df-cae694315f8a tempest-VolumeDependencyTests-1689696164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:33:10 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-e4b04622-f8d1-4cba-b3df-cae694315f8a tempest-VolumeDependencyTests-1689696164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:10 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e5a5b03-afc4-4a7a-b862-3c05ee09a961]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:33:10 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e4b04622-f8d1-4cba-b3df-cae694315f8a tempest-VolumeDependencyTests-1689696164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a.42cca555-ea9d-46a1-a003-2b9e2aa368bf {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:10 devstack sudo[106652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ff4134e8-bda9-4b61-af64-378872a210ee Aug 05 10:33:10 devstack sudo[106652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:11 devstack sudo[106653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a.42cca555-ea9d-46a1-a003-2b9e2aa368bf Aug 05 10:33:11 devstack sudo[106653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:11 devstack sudo[106652]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:11 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-00f21778-ae2b-45ed-8dc6-a53864a4b362 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ff4134e8-bda9-4b61-af64-378872a210ee" returned: 0 in 0.503s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:11 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-00f21778-ae2b-45ed-8dc6-a53864a4b362 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ff4134e8-bda9-4b61-af64-378872a210ee {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:11 devstack sudo[106653]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:11 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e4b04622-f8d1-4cba-b3df-cae694315f8a tempest-VolumeDependencyTests-1689696164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a.42cca555-ea9d-46a1-a003-2b9e2aa368bf" returned: 0 in 0.442s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:11 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-e4b04622-f8d1-4cba-b3df-cae694315f8a tempest-VolumeDependencyTests-1689696164 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88613) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:33:11 devstack sudo[106663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ff4134e8-bda9-4b61-af64-378872a210ee Aug 05 10:33:11 devstack sudo[106663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:11 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[088a9c54-5499-4740-8542-cc018ef6e65e]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:33:11 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e4b04622-f8d1-4cba-b3df-cae694315f8a tempest-VolumeDependencyTests-1689696164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:11 devstack sudo[106665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a Aug 05 10:33:11 devstack sudo[106665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:11 devstack sudo[106663]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:11 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-00f21778-ae2b-45ed-8dc6-a53864a4b362 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-ff4134e8-bda9-4b61-af64-378872a210ee" returned: 0 in 0.344s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:11 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-00f21778-ae2b-45ed-8dc6-a53864a4b362 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Lock "cinder-quobyte-ff4134e8-bda9-4b61-af64-378872a210ee" released by "delete_volume" :: held 0.928s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:11 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-00f21778-ae2b-45ed-8dc6-a53864a4b362 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Created reservations ['0ce3e70a-dfb0-4557-9276-64fa8d18b3e2', 'fb4a0922-8ad7-4edd-8cb0-c5f11fdd0999', '9202243c-03cf-4b3a-a100-da9efb77c8e1', '4e67b191-9560-462b-8bbb-699cf8149f64'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:33:11 devstack sudo[106665]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:11 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e4b04622-f8d1-4cba-b3df-cae694315f8a tempest-VolumeDependencyTests-1689696164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a" returned: 0 in 0.548s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:11 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-e4b04622-f8d1-4cba-b3df-cae694315f8a tempest-VolumeDependencyTests-1689696164 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a {{(pid=88613) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 05 10:33:11 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-e4b04622-f8d1-4cba-b3df-cae694315f8a tempest-VolumeDependencyTests-1689696164 None] Creating direct copy from snapshot {{(pid=88613) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 05 10:33:11 devstack cinder-volume[88613]: DEBUG cinder.utils [None req-e4b04622-f8d1-4cba-b3df-cae694315f8a tempest-VolumeDependencyTests-1689696164 None] Path /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-61c6357f-66c1-41e5-b846-a48b69fe84c3 not found in is_blk_device check {{(pid=88613) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 05 10:33:11 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e4b04622-f8d1-4cba-b3df-cae694315f8a tempest-VolumeDependencyTests-1689696164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-61c6357f-66c1-41e5-b846-a48b69fe84c3 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:11 devstack sudo[106671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-61c6357f-66c1-41e5-b846-a48b69fe84c3 Aug 05 10:33:11 devstack sudo[106671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:12 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-00f21778-ae2b-45ed-8dc6-a53864a4b362 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:12 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-00f21778-ae2b-45ed-8dc6-a53864a4b362 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:12 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-00f21778-ae2b-45ed-8dc6-a53864a4b362 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:33:12 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-00f21778-ae2b-45ed-8dc6-a53864a4b362 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:33:12 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-00f21778-ae2b-45ed-8dc6-a53864a4b362 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:12 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-00f21778-ae2b-45ed-8dc6-a53864a4b362 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:12 devstack sudo[106673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:33:12 devstack sudo[106673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:12 devstack sudo[106673]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:12 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-00f21778-ae2b-45ed-8dc6-a53864a4b362 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.333s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:12 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-00f21778-ae2b-45ed-8dc6-a53864a4b362 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:33:12 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-00f21778-ae2b-45ed-8dc6-a53864a4b362 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Deleted volume successfully. Aug 05 10:33:12 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-00f21778-ae2b-45ed-8dc6-a53864a4b362 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Lock "cinder-ff4134e8-bda9-4b61-af64-378872a210ee-delete_volume" released by "delete_volume" :: held 1.735s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:13 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-9b2e643a-91e3-40cd-b30b-31e90852a72f tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Acquiring lock "cinder-4f88a235-58fe-44e7-8324-e0c5e337fb44-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:13 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-9b2e643a-91e3-40cd-b30b-31e90852a72f tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Lock "cinder-4f88a235-58fe-44e7-8324-e0c5e337fb44-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:13 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-9b2e643a-91e3-40cd-b30b-31e90852a72f tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Acquiring lock "cinder-quobyte-4f88a235-58fe-44e7-8324-e0c5e337fb44" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:13 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-9b2e643a-91e3-40cd-b30b-31e90852a72f tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Lock "cinder-quobyte-4f88a235-58fe-44e7-8324-e0c5e337fb44" acquired by "delete_volume" :: waited 0.063s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:13 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c7e4df-e5c8-4cd0-9458-fcf01559380e]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:33:13 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9b2e643a-91e3-40cd-b30b-31e90852a72f tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-4f88a235-58fe-44e7-8324-e0c5e337fb44 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:13 devstack sudo[106686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-4f88a235-58fe-44e7-8324-e0c5e337fb44 Aug 05 10:33:13 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:14 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9b2e643a-91e3-40cd-b30b-31e90852a72f tempest-CreateVolumesFromSourceVolumeTest-43181798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-4f88a235-58fe-44e7-8324-e0c5e337fb44" returned: 0 in 0.861s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:14 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:14 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9b2e643a-91e3-40cd-b30b-31e90852a72f tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-4f88a235-58fe-44e7-8324-e0c5e337fb44 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:14 devstack sudo[106692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-4f88a235-58fe-44e7-8324-e0c5e337fb44 Aug 05 10:33:14 devstack sudo[106692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:14 devstack sudo[106692]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:14 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9b2e643a-91e3-40cd-b30b-31e90852a72f tempest-CreateVolumesFromSourceVolumeTest-43181798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-4f88a235-58fe-44e7-8324-e0c5e337fb44" returned: 0 in 0.475s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:14 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-9b2e643a-91e3-40cd-b30b-31e90852a72f tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Lock "cinder-quobyte-4f88a235-58fe-44e7-8324-e0c5e337fb44" released by "delete_volume" :: held 1.464s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:15 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-9b2e643a-91e3-40cd-b30b-31e90852a72f tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Created reservations ['e88c5e9f-fd7c-42a7-9a64-591f283d530d', '182cbc7d-04a9-43b3-964b-f60dd3e258a5', '40b82875-7d9f-4df2-abf1-d7553f20fd77', 'ffdd91a1-91c8-4ac4-8ec7-563f4ae68d2f'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:33:15 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-9b2e643a-91e3-40cd-b30b-31e90852a72f tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:15 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-9b2e643a-91e3-40cd-b30b-31e90852a72f tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:15 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-9b2e643a-91e3-40cd-b30b-31e90852a72f tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:33:15 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-9b2e643a-91e3-40cd-b30b-31e90852a72f tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:33:15 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-9b2e643a-91e3-40cd-b30b-31e90852a72f tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:15 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9b2e643a-91e3-40cd-b30b-31e90852a72f tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:15 devstack sudo[106696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:33:15 devstack sudo[106696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:15 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-ae14e80e-8b87-4e80-80ff-fe68ebddc925 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Acquiring lock "cinder-e632ec27-5fb2-4d80-a83f-e0d2bcfb06d6-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:15 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-ae14e80e-8b87-4e80-80ff-fe68ebddc925 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Lock "cinder-e632ec27-5fb2-4d80-a83f-e0d2bcfb06d6-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:15 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-ae14e80e-8b87-4e80-80ff-fe68ebddc925 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Acquiring lock "cinder-quobyte-e632ec27-5fb2-4d80-a83f-e0d2bcfb06d6" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:15 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-ae14e80e-8b87-4e80-80ff-fe68ebddc925 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Lock "cinder-quobyte-e632ec27-5fb2-4d80-a83f-e0d2bcfb06d6" acquired by "delete_volume" :: waited 0.019s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:15 devstack sudo[106696]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:15 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9b2e643a-91e3-40cd-b30b-31e90852a72f tempest-CreateVolumesFromSourceVolumeTest-43181798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.668s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:15 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-9b2e643a-91e3-40cd-b30b-31e90852a72f tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:33:15 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-9b2e643a-91e3-40cd-b30b-31e90852a72f tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Deleted volume successfully. Aug 05 10:33:15 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[5897c401-a568-458b-9735-1163239ffab5]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:33:15 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ae14e80e-8b87-4e80-80ff-fe68ebddc925 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e632ec27-5fb2-4d80-a83f-e0d2bcfb06d6 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:15 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-9b2e643a-91e3-40cd-b30b-31e90852a72f tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Lock "cinder-4f88a235-58fe-44e7-8324-e0c5e337fb44-delete_volume" released by "delete_volume" :: held 2.868s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:16 devstack sudo[106699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e632ec27-5fb2-4d80-a83f-e0d2bcfb06d6 Aug 05 10:33:16 devstack sudo[106699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:16 devstack sudo[106699]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:16 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ae14e80e-8b87-4e80-80ff-fe68ebddc925 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e632ec27-5fb2-4d80-a83f-e0d2bcfb06d6" returned: 0 in 0.807s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:16 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ae14e80e-8b87-4e80-80ff-fe68ebddc925 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e632ec27-5fb2-4d80-a83f-e0d2bcfb06d6 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:16 devstack sudo[106706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e632ec27-5fb2-4d80-a83f-e0d2bcfb06d6 Aug 05 10:33:16 devstack sudo[106706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:17 devstack sudo[106706]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ae14e80e-8b87-4e80-80ff-fe68ebddc925 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e632ec27-5fb2-4d80-a83f-e0d2bcfb06d6" returned: 0 in 0.491s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:17 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-ae14e80e-8b87-4e80-80ff-fe68ebddc925 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Lock "cinder-quobyte-e632ec27-5fb2-4d80-a83f-e0d2bcfb06d6" released by "delete_volume" :: held 1.438s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:17 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-ae14e80e-8b87-4e80-80ff-fe68ebddc925 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Created reservations ['a3a6ff81-aa27-4e2c-909a-f776ca6bb93c', '73651c60-63f1-4cc8-b799-f1c64b9c4d7d', '4376676a-1537-42ef-bd70-be9208c634a9', '044422be-fb86-4415-bcdd-5f8dc6982447'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:33:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-ae14e80e-8b87-4e80-80ff-fe68ebddc925 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-ae14e80e-8b87-4e80-80ff-fe68ebddc925 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:17 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-ae14e80e-8b87-4e80-80ff-fe68ebddc925 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:33:17 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-ae14e80e-8b87-4e80-80ff-fe68ebddc925 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:33:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-ae14e80e-8b87-4e80-80ff-fe68ebddc925 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ae14e80e-8b87-4e80-80ff-fe68ebddc925 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:17 devstack sudo[106709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:33:17 devstack sudo[106709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:18 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e0a8b328-861c-411e-8241-2d2fcf75c364 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Acquiring lock "cinder-46c3e4f2-326e-49ad-9d64-2a23fe64a65b-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:18 devstack sudo[106671]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:18 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e0a8b328-861c-411e-8241-2d2fcf75c364 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Lock "cinder-46c3e4f2-326e-49ad-9d64-2a23fe64a65b-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e4b04622-f8d1-4cba-b3df-cae694315f8a tempest-VolumeDependencyTests-1689696164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-61c6357f-66c1-41e5-b846-a48b69fe84c3" returned: 0 in 6.433s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:18 devstack cinder-volume[88613]: DEBUG cinder.image.image_utils [None req-e4b04622-f8d1-4cba-b3df-cae694315f8a tempest-VolumeDependencyTests-1689696164 None] Image conversion details: src /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a, size 1024.00 MB, duration 6.44 sec, destination /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-61c6357f-66c1-41e5-b846-a48b69fe84c3 {{(pid=88613) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 10:33:18 devstack cinder-volume[88613]: INFO cinder.image.image_utils [None req-e4b04622-f8d1-4cba-b3df-cae694315f8a tempest-VolumeDependencyTests-1689696164 None] Converted 1024.00 MB image at 159.12 MB/s Aug 05 10:33:18 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-e4b04622-f8d1-4cba-b3df-cae694315f8a tempest-VolumeDependencyTests-1689696164 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-61c6357f-66c1-41e5-b846-a48b69fe84c3 is being set with open permissions: ugo+rw Aug 05 10:33:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e4b04622-f8d1-4cba-b3df-cae694315f8a tempest-VolumeDependencyTests-1689696164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-61c6357f-66c1-41e5-b846-a48b69fe84c3 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:18 devstack sudo[106709]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:18 devstack sudo[106712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-61c6357f-66c1-41e5-b846-a48b69fe84c3 Aug 05 10:33:18 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8191490-9ba3-458d-bc13-4528dc8cd037 tempest-ProjectReaderTests-75358439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:33:18 devstack sudo[106712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:18 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-f8191490-9ba3-458d-bc13-4528dc8cd037 tempest-ProjectReaderTests-75358439 None] Flow 'volume_create_manager' (5973e44d-3136-4ce0-8320-8cae9b335c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:33:18 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-f8191490-9ba3-458d-bc13-4528dc8cd037 tempest-ProjectReaderTests-75358439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5554229b-fbaa-4b76-9f33-7b2d25240d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-ae14e80e-8b87-4e80-80ff-fe68ebddc925 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.687s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:18 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-ae14e80e-8b87-4e80-80ff-fe68ebddc925 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:33:18 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-f8191490-9ba3-458d-bc13-4528dc8cd037 tempest-ProjectReaderTests-75358439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5554229b-fbaa-4b76-9f33-7b2d25240d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:33:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-769099614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=290e0b36-5336-44ef-aafc-5c4d7de23688,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9b5160d951e4a2a96ce9b3e8fdeea1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:33:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:33:18Z,use_quota=True,user_id='933aa00d66fc4d42adc58da2c963056c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:18 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-f8191490-9ba3-458d-bc13-4528dc8cd037 tempest-ProjectReaderTests-75358439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2bee7b8-a6a2-47de-b9ea-a12fb6c8b30c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:18 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-f8191490-9ba3-458d-bc13-4528dc8cd037 tempest-ProjectReaderTests-75358439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2bee7b8-a6a2-47de-b9ea-a12fb6c8b30c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:18 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-f8191490-9ba3-458d-bc13-4528dc8cd037 tempest-ProjectReaderTests-75358439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eec0e5fa-285e-41ba-b596-77075dc31c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:18 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-f8191490-9ba3-458d-bc13-4528dc8cd037 tempest-ProjectReaderTests-75358439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eec0e5fa-285e-41ba-b596-77075dc31c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '290e0b36-5336-44ef-aafc-5c4d7de23688', 'volume_name': 'volume-290e0b36-5336-44ef-aafc-5c4d7de23688', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:18 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-f8191490-9ba3-458d-bc13-4528dc8cd037 tempest-ProjectReaderTests-75358439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c436d5f1-0b5b-4762-be21-c4868804e254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:18 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-f8191490-9ba3-458d-bc13-4528dc8cd037 tempest-ProjectReaderTests-75358439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c436d5f1-0b5b-4762-be21-c4868804e254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:18 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-f8191490-9ba3-458d-bc13-4528dc8cd037 tempest-ProjectReaderTests-75358439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3eeaa46-a5a1-492f-aeab-01672ef979c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:18 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-f8191490-9ba3-458d-bc13-4528dc8cd037 tempest-ProjectReaderTests-75358439 None] Volume 290e0b36-5336-44ef-aafc-5c4d7de23688: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-290e0b36-5336-44ef-aafc-5c4d7de23688', 'volume_size': 1} Aug 05 10:33:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-f8191490-9ba3-458d-bc13-4528dc8cd037 tempest-ProjectReaderTests-75358439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:18 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-ae14e80e-8b87-4e80-80ff-fe68ebddc925 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Deleted volume successfully. Aug 05 10:33:18 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e0a8b328-861c-411e-8241-2d2fcf75c364 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Acquiring lock "cinder-quobyte-46c3e4f2-326e-49ad-9d64-2a23fe64a65b" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:18 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e0a8b328-861c-411e-8241-2d2fcf75c364 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Lock "cinder-quobyte-46c3e4f2-326e-49ad-9d64-2a23fe64a65b" acquired by "delete_volume" :: waited 0.025s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:18 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-ae14e80e-8b87-4e80-80ff-fe68ebddc925 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Lock "cinder-e632ec27-5fb2-4d80-a83f-e0d2bcfb06d6-delete_volume" released by "delete_volume" :: held 2.780s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:18 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff92ed2a-363e-4f37-8f44-b2d3b3521525]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:33:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e0a8b328-861c-411e-8241-2d2fcf75c364 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-46c3e4f2-326e-49ad-9d64-2a23fe64a65b {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:18 devstack sudo[106712]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e4b04622-f8d1-4cba-b3df-cae694315f8a tempest-VolumeDependencyTests-1689696164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-61c6357f-66c1-41e5-b846-a48b69fe84c3" returned: 0 in 0.299s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:18 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e4b04622-f8d1-4cba-b3df-cae694315f8a tempest-VolumeDependencyTests-1689696164 None] Lock "cinder-quobyte-61c6357f-66c1-41e5-b846-a48b69fe84c3" released by "_copy_volume_from_snapshot" :: held 7.858s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:18 devstack sudo[106714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-46c3e4f2-326e-49ad-9d64-2a23fe64a65b Aug 05 10:33:18 devstack sudo[106714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:18 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e4b04622-f8d1-4cba-b3df-cae694315f8a tempest-VolumeDependencyTests-1689696164 None] Lock "cinder-quobyte-42cca555-ea9d-46a1-a003-2b9e2aa368bf-61c6357f-66c1-41e5-b846-a48b69fe84c3" released by "_create_volume_from_snapshot" :: held 7.959s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-e4b04622-f8d1-4cba-b3df-cae694315f8a tempest-VolumeDependencyTests-1689696164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.987s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-f8191490-9ba3-458d-bc13-4528dc8cd037 tempest-ProjectReaderTests-75358439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.220s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:18 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-f8191490-9ba3-458d-bc13-4528dc8cd037 tempest-ProjectReaderTests-75358439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:33:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-769099614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=290e0b36-5336-44ef-aafc-5c4d7de23688,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9b5160d951e4a2a96ce9b3e8fdeea1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:33:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:33:18Z,use_quota=True,user_id='933aa00d66fc4d42adc58da2c963056c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:33:18 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-f8191490-9ba3-458d-bc13-4528dc8cd037 tempest-ProjectReaderTests-75358439 None] Creating volume 290e0b36-5336-44ef-aafc-5c4d7de23688 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:33:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-f8191490-9ba3-458d-bc13-4528dc8cd037 tempest-ProjectReaderTests-75358439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-f8191490-9ba3-458d-bc13-4528dc8cd037 tempest-ProjectReaderTests-75358439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:18 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-f8191490-9ba3-458d-bc13-4528dc8cd037 tempest-ProjectReaderTests-75358439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:33:18 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-f8191490-9ba3-458d-bc13-4528dc8cd037 tempest-ProjectReaderTests-75358439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:33:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-f8191490-9ba3-458d-bc13-4528dc8cd037 tempest-ProjectReaderTests-75358439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:18 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-f8191490-9ba3-458d-bc13-4528dc8cd037 tempest-ProjectReaderTests-75358439 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:33:18 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-f8191490-9ba3-458d-bc13-4528dc8cd037 tempest-ProjectReaderTests-75358439 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:33:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f8191490-9ba3-458d-bc13-4528dc8cd037 tempest-ProjectReaderTests-75358439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-290e0b36-5336-44ef-aafc-5c4d7de23688 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:18 devstack sudo[106717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-290e0b36-5336-44ef-aafc-5c4d7de23688 1073741824 Aug 05 10:33:18 devstack sudo[106717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:18 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-e4b04622-f8d1-4cba-b3df-cae694315f8a tempest-VolumeDependencyTests-1689696164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (821d78a4-4b91-4a18-9b2f-b5faef32f51f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61c6357f-66c1-41e5-b846-a48b69fe84c3', 'volume_size': 1, 'snapshot_id': '42cca555-ea9d-46a1-a003-2b9e2aa368bf'}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:18 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-e4b04622-f8d1-4cba-b3df-cae694315f8a tempest-VolumeDependencyTests-1689696164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dab0fe27-5313-4dcf-97c4-9bb959897621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:18 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-e4b04622-f8d1-4cba-b3df-cae694315f8a tempest-VolumeDependencyTests-1689696164 None] Volume volume-61c6357f-66c1-41e5-b846-a48b69fe84c3 (61c6357f-66c1-41e5-b846-a48b69fe84c3): created successfully Aug 05 10:33:18 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-e4b04622-f8d1-4cba-b3df-cae694315f8a tempest-VolumeDependencyTests-1689696164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dab0fe27-5313-4dcf-97c4-9bb959897621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:18 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-e4b04622-f8d1-4cba-b3df-cae694315f8a tempest-VolumeDependencyTests-1689696164 None] Flow 'volume_create_manager' (02578056-257e-4467-8c6b-d169e61794ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:33:18 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-e4b04622-f8d1-4cba-b3df-cae694315f8a tempest-VolumeDependencyTests-1689696164 None] Created volume successfully. Aug 05 10:33:18 devstack sudo[106714]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e0a8b328-861c-411e-8241-2d2fcf75c364 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-46c3e4f2-326e-49ad-9d64-2a23fe64a65b" returned: 0 in 0.418s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e0a8b328-861c-411e-8241-2d2fcf75c364 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-46c3e4f2-326e-49ad-9d64-2a23fe64a65b {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:19 devstack sudo[106722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-46c3e4f2-326e-49ad-9d64-2a23fe64a65b Aug 05 10:33:19 devstack sudo[106722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:19 devstack sudo[106717]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f8191490-9ba3-458d-bc13-4528dc8cd037 tempest-ProjectReaderTests-75358439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-290e0b36-5336-44ef-aafc-5c4d7de23688 1073741824" returned: 0 in 0.517s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:19 devstack sudo[106722]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e0a8b328-861c-411e-8241-2d2fcf75c364 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-46c3e4f2-326e-49ad-9d64-2a23fe64a65b" returned: 0 in 0.277s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:19 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e0a8b328-861c-411e-8241-2d2fcf75c364 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Lock "cinder-quobyte-46c3e4f2-326e-49ad-9d64-2a23fe64a65b" released by "delete_volume" :: held 0.743s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f8191490-9ba3-458d-bc13-4528dc8cd037 tempest-ProjectReaderTests-75358439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-290e0b36-5336-44ef-aafc-5c4d7de23688 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:19 devstack sudo[106728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-290e0b36-5336-44ef-aafc-5c4d7de23688 Aug 05 10:33:19 devstack sudo[106728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:19 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-e0a8b328-861c-411e-8241-2d2fcf75c364 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Created reservations ['03518109-eb18-4f69-9ab3-c232f45bcdd5', 'a5618606-3883-4919-80c5-337ae082b33f', '517a9548-0897-416d-90c9-fdf7b55e6831', 'a19282b9-2947-4fac-9d82-5d18f84b2a09'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:33:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-e0a8b328-861c-411e-8241-2d2fcf75c364 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-e0a8b328-861c-411e-8241-2d2fcf75c364 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:19 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-e0a8b328-861c-411e-8241-2d2fcf75c364 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:33:19 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-e0a8b328-861c-411e-8241-2d2fcf75c364 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:33:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-e0a8b328-861c-411e-8241-2d2fcf75c364 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e0a8b328-861c-411e-8241-2d2fcf75c364 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:19 devstack sudo[106730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:33:19 devstack sudo[106730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:19 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-1721e041-e119-4989-b308-bf906a1c8500 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Acquiring lock "cinder-c2f436cc-b7d1-4c95-a9ed-db33bda20af9-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:19 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-1721e041-e119-4989-b308-bf906a1c8500 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Lock "cinder-c2f436cc-b7d1-4c95-a9ed-db33bda20af9-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:19 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-1721e041-e119-4989-b308-bf906a1c8500 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Acquiring lock "cinder-quobyte-c2f436cc-b7d1-4c95-a9ed-db33bda20af9" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:19 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-1721e041-e119-4989-b308-bf906a1c8500 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Lock "cinder-quobyte-c2f436cc-b7d1-4c95-a9ed-db33bda20af9" acquired by "delete_volume" :: waited 0.031s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:19 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-796d7e4c-2ea2-4352-82a3-de3a2b3b4a3b tempest-VolumeDependencyTests-1689696164 None] Acquiring lock "cinder-42cca555-ea9d-46a1-a003-2b9e2aa368bf-delete_snapshot" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:19 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[768c5e49-b131-4d7a-a91e-46fa1bba0727]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:33:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1721e041-e119-4989-b308-bf906a1c8500 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-c2f436cc-b7d1-4c95-a9ed-db33bda20af9 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:19 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-796d7e4c-2ea2-4352-82a3-de3a2b3b4a3b tempest-VolumeDependencyTests-1689696164 None] Lock "cinder-42cca555-ea9d-46a1-a003-2b9e2aa368bf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:19 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-796d7e4c-2ea2-4352-82a3-de3a2b3b4a3b tempest-VolumeDependencyTests-1689696164 None] Acquiring lock "cinder-quobyte-50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:19 devstack sudo[106728]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f8191490-9ba3-458d-bc13-4528dc8cd037 tempest-ProjectReaderTests-75358439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-290e0b36-5336-44ef-aafc-5c4d7de23688" returned: 0 in 0.425s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:19 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-f8191490-9ba3-458d-bc13-4528dc8cd037 tempest-ProjectReaderTests-75358439 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:33:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-f8191490-9ba3-458d-bc13-4528dc8cd037 tempest-ProjectReaderTests-75358439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:19 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-796d7e4c-2ea2-4352-82a3-de3a2b3b4a3b tempest-VolumeDependencyTests-1689696164 None] Lock "cinder-quobyte-50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a" acquired by "delete_snapshot" :: waited 0.036s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:19 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-796d7e4c-2ea2-4352-82a3-de3a2b3b4a3b tempest-VolumeDependencyTests-1689696164 None] Acquiring lock "cinder-quobyte-42cca555-ea9d-46a1-a003-2b9e2aa368bf" by "_delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:19 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-f8191490-9ba3-458d-bc13-4528dc8cd037 tempest-ProjectReaderTests-75358439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3eeaa46-a5a1-492f-aeab-01672ef979c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-290e0b36-5336-44ef-aafc-5c4d7de23688', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:19 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-f8191490-9ba3-458d-bc13-4528dc8cd037 tempest-ProjectReaderTests-75358439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3332ed4c-7534-486f-8397-880edd11f7da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:19 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-796d7e4c-2ea2-4352-82a3-de3a2b3b4a3b tempest-VolumeDependencyTests-1689696164 None] Lock "cinder-quobyte-42cca555-ea9d-46a1-a003-2b9e2aa368bf" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:19 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-796d7e4c-2ea2-4352-82a3-de3a2b3b4a3b tempest-VolumeDependencyTests-1689696164 None] Deleting offline snapshot 42cca555-ea9d-46a1-a003-2b9e2aa368bf of volume 50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:33:19 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-796d7e4c-2ea2-4352-82a3-de3a2b3b4a3b tempest-VolumeDependencyTests-1689696164 None] snapshot_file for this snap is: volume-50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a.42cca555-ea9d-46a1-a003-2b9e2aa368bf {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:33:19 devstack sudo[106730]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e0a8b328-861c-411e-8241-2d2fcf75c364 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.397s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:19 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-e0a8b328-861c-411e-8241-2d2fcf75c364 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:33:19 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a3ee3fb-10a7-4166-88fa-1debb7d5293f]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:33:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-796d7e4c-2ea2-4352-82a3-de3a2b3b4a3b tempest-VolumeDependencyTests-1689696164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a.42cca555-ea9d-46a1-a003-2b9e2aa368bf {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:19 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-f8191490-9ba3-458d-bc13-4528dc8cd037 tempest-ProjectReaderTests-75358439 None] Volume volume-290e0b36-5336-44ef-aafc-5c4d7de23688 (290e0b36-5336-44ef-aafc-5c4d7de23688): created successfully Aug 05 10:33:19 devstack sudo[106733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-c2f436cc-b7d1-4c95-a9ed-db33bda20af9 Aug 05 10:33:19 devstack sudo[106733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:19 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-f8191490-9ba3-458d-bc13-4528dc8cd037 tempest-ProjectReaderTests-75358439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3332ed4c-7534-486f-8397-880edd11f7da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:19 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-f8191490-9ba3-458d-bc13-4528dc8cd037 tempest-ProjectReaderTests-75358439 None] Flow 'volume_create_manager' (5973e44d-3136-4ce0-8320-8cae9b335c43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:33:19 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-e0a8b328-861c-411e-8241-2d2fcf75c364 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Deleted volume successfully. Aug 05 10:33:19 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-f8191490-9ba3-458d-bc13-4528dc8cd037 tempest-ProjectReaderTests-75358439 None] Created volume successfully. Aug 05 10:33:19 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e0a8b328-861c-411e-8241-2d2fcf75c364 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Lock "cinder-46c3e4f2-326e-49ad-9d64-2a23fe64a65b-delete_volume" released by "delete_volume" :: held 1.582s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:19 devstack sudo[106735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a.42cca555-ea9d-46a1-a003-2b9e2aa368bf Aug 05 10:33:19 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:20 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ac10484-95e9-4bdc-a76a-e0922d77e104 tempest-ProjectReaderTests-1836518789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:33:20 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2ac10484-95e9-4bdc-a76a-e0922d77e104 tempest-ProjectReaderTests-1836518789 None] Flow 'volume_create_manager' (fea8bd6e-e501-48f9-be61-a8cbf3567d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:33:20 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2ac10484-95e9-4bdc-a76a-e0922d77e104 tempest-ProjectReaderTests-1836518789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be532d90-f684-4180-9a6d-10ed825697b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:20 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2ac10484-95e9-4bdc-a76a-e0922d77e104 tempest-ProjectReaderTests-1836518789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be532d90-f684-4180-9a6d-10ed825697b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:33:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-508786389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de7e0815-d272-45e2-a37d-ed3a12b0935b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1b086e408b44e5ea0ed7bdf81eaf277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:33:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:33:20Z,use_quota=True,user_id='b9819babf0b14d119e0f77d557379f60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:20 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2ac10484-95e9-4bdc-a76a-e0922d77e104 tempest-ProjectReaderTests-1836518789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8eaad21-ebd5-484e-8fd0-369a9ef53d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:20 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2ac10484-95e9-4bdc-a76a-e0922d77e104 tempest-ProjectReaderTests-1836518789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8eaad21-ebd5-484e-8fd0-369a9ef53d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:20 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2ac10484-95e9-4bdc-a76a-e0922d77e104 tempest-ProjectReaderTests-1836518789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb4f7d7e-fd19-45b5-98c0-21a1b0c38bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:20 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2ac10484-95e9-4bdc-a76a-e0922d77e104 tempest-ProjectReaderTests-1836518789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb4f7d7e-fd19-45b5-98c0-21a1b0c38bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de7e0815-d272-45e2-a37d-ed3a12b0935b', 'volume_name': 'volume-de7e0815-d272-45e2-a37d-ed3a12b0935b', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:20 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2ac10484-95e9-4bdc-a76a-e0922d77e104 tempest-ProjectReaderTests-1836518789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f295007-4f65-4fb1-bcd0-6551f3c4ab61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:20 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2ac10484-95e9-4bdc-a76a-e0922d77e104 tempest-ProjectReaderTests-1836518789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f295007-4f65-4fb1-bcd0-6551f3c4ab61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:20 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2ac10484-95e9-4bdc-a76a-e0922d77e104 tempest-ProjectReaderTests-1836518789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (669b5cb2-27aa-4c68-943e-eeca06509987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:20 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-2ac10484-95e9-4bdc-a76a-e0922d77e104 tempest-ProjectReaderTests-1836518789 None] Volume de7e0815-d272-45e2-a37d-ed3a12b0935b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de7e0815-d272-45e2-a37d-ed3a12b0935b', 'volume_size': 1} Aug 05 10:33:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2ac10484-95e9-4bdc-a76a-e0922d77e104 tempest-ProjectReaderTests-1836518789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2ac10484-95e9-4bdc-a76a-e0922d77e104 tempest-ProjectReaderTests-1836518789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:20 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-2ac10484-95e9-4bdc-a76a-e0922d77e104 tempest-ProjectReaderTests-1836518789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:33:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-508786389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de7e0815-d272-45e2-a37d-ed3a12b0935b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1b086e408b44e5ea0ed7bdf81eaf277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:33:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:33:20Z,use_quota=True,user_id='b9819babf0b14d119e0f77d557379f60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:33:20 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-2ac10484-95e9-4bdc-a76a-e0922d77e104 tempest-ProjectReaderTests-1836518789 None] Creating volume de7e0815-d272-45e2-a37d-ed3a12b0935b {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:33:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2ac10484-95e9-4bdc-a76a-e0922d77e104 tempest-ProjectReaderTests-1836518789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:20 devstack sudo[106733]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2ac10484-95e9-4bdc-a76a-e0922d77e104 tempest-ProjectReaderTests-1836518789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:20 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-2ac10484-95e9-4bdc-a76a-e0922d77e104 tempest-ProjectReaderTests-1836518789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:33:20 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-2ac10484-95e9-4bdc-a76a-e0922d77e104 tempest-ProjectReaderTests-1836518789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:33:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2ac10484-95e9-4bdc-a76a-e0922d77e104 tempest-ProjectReaderTests-1836518789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:20 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-2ac10484-95e9-4bdc-a76a-e0922d77e104 tempest-ProjectReaderTests-1836518789 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:33:20 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-2ac10484-95e9-4bdc-a76a-e0922d77e104 tempest-ProjectReaderTests-1836518789 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:33:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2ac10484-95e9-4bdc-a76a-e0922d77e104 tempest-ProjectReaderTests-1836518789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-de7e0815-d272-45e2-a37d-ed3a12b0935b 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1721e041-e119-4989-b308-bf906a1c8500 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-c2f436cc-b7d1-4c95-a9ed-db33bda20af9" returned: 0 in 0.483s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1721e041-e119-4989-b308-bf906a1c8500 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-c2f436cc-b7d1-4c95-a9ed-db33bda20af9 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:20 devstack sudo[106743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-de7e0815-d272-45e2-a37d-ed3a12b0935b 1073741824 Aug 05 10:33:20 devstack sudo[106743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:20 devstack sudo[106745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-c2f436cc-b7d1-4c95-a9ed-db33bda20af9 Aug 05 10:33:20 devstack sudo[106745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:20 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-796d7e4c-2ea2-4352-82a3-de3a2b3b4a3b tempest-VolumeDependencyTests-1689696164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a.42cca555-ea9d-46a1-a003-2b9e2aa368bf" returned: 0 in 0.414s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:20 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-796d7e4c-2ea2-4352-82a3-de3a2b3b4a3b tempest-VolumeDependencyTests-1689696164 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88613) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:33:20 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee78b3e-efcc-4fec-9cb7-5b6e39545bc4]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:33:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-796d7e4c-2ea2-4352-82a3-de3a2b3b4a3b tempest-VolumeDependencyTests-1689696164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:20 devstack sudo[106748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a Aug 05 10:33:20 devstack sudo[106748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:20 devstack sudo[106745]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1721e041-e119-4989-b308-bf906a1c8500 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-c2f436cc-b7d1-4c95-a9ed-db33bda20af9" returned: 0 in 0.278s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:20 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-1721e041-e119-4989-b308-bf906a1c8500 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Lock "cinder-quobyte-c2f436cc-b7d1-4c95-a9ed-db33bda20af9" released by "delete_volume" :: held 0.846s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:20 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-1721e041-e119-4989-b308-bf906a1c8500 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Created reservations ['186fb66f-ac4e-4e6e-b3d4-d7a763ad8d17', 'ce37cd29-c463-4004-a8ba-a996bfbe75b5', '30f8f67b-2121-46b0-b6e1-b9b2128705a1', '1ea5749f-9872-4971-a428-910115dd4f9d'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:33:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a9ebbeec-d6bd-4a77-8ddd-4eeaacafa2a6 tempest-ProjectReaderTests-75358439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-1721e041-e119-4989-b308-bf906a1c8500 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-1721e041-e119-4989-b308-bf906a1c8500 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:20 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-1721e041-e119-4989-b308-bf906a1c8500 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:33:20 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-1721e041-e119-4989-b308-bf906a1c8500 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:33:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-1721e041-e119-4989-b308-bf906a1c8500 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1721e041-e119-4989-b308-bf906a1c8500 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:20 devstack sudo[106757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:33:20 devstack sudo[106757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:20 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-19992eac-9b7b-4eec-a7c6-a015bd84914f tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Acquiring lock "cinder-3f8dddfa-b25c-475b-a78b-05c246cddfd2-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:20 devstack sudo[106743]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2ac10484-95e9-4bdc-a76a-e0922d77e104 tempest-ProjectReaderTests-1836518789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-de7e0815-d272-45e2-a37d-ed3a12b0935b 1073741824" returned: 0 in 0.589s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:20 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-19992eac-9b7b-4eec-a7c6-a015bd84914f tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Lock "cinder-3f8dddfa-b25c-475b-a78b-05c246cddfd2-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2ac10484-95e9-4bdc-a76a-e0922d77e104 tempest-ProjectReaderTests-1836518789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-de7e0815-d272-45e2-a37d-ed3a12b0935b {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:20 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-19992eac-9b7b-4eec-a7c6-a015bd84914f tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Acquiring lock "cinder-quobyte-3f8dddfa-b25c-475b-a78b-05c246cddfd2" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:20 devstack sudo[106759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-de7e0815-d272-45e2-a37d-ed3a12b0935b Aug 05 10:33:20 devstack sudo[106759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:20 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-19992eac-9b7b-4eec-a7c6-a015bd84914f tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Lock "cinder-quobyte-3f8dddfa-b25c-475b-a78b-05c246cddfd2" acquired by "delete_volume" :: waited 0.026s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:20 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d418823-5532-44ec-9ce0-edeebdfbcc04]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:33:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-19992eac-9b7b-4eec-a7c6-a015bd84914f tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3f8dddfa-b25c-475b-a78b-05c246cddfd2 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:20 devstack sudo[106748]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-796d7e4c-2ea2-4352-82a3-de3a2b3b4a3b tempest-VolumeDependencyTests-1689696164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a" returned: 0 in 0.666s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-796d7e4c-2ea2-4352-82a3-de3a2b3b4a3b tempest-VolumeDependencyTests-1689696164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a.42cca555-ea9d-46a1-a003-2b9e2aa368bf {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:20 devstack sudo[106763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a.42cca555-ea9d-46a1-a003-2b9e2aa368bf Aug 05 10:33:20 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:21 devstack sudo[106762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3f8dddfa-b25c-475b-a78b-05c246cddfd2 Aug 05 10:33:21 devstack sudo[106762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:21 devstack sudo[106757]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-1721e041-e119-4989-b308-bf906a1c8500 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.344s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:21 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-1721e041-e119-4989-b308-bf906a1c8500 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:33:21 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-1721e041-e119-4989-b308-bf906a1c8500 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Deleted volume successfully. Aug 05 10:33:21 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-1721e041-e119-4989-b308-bf906a1c8500 tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Lock "cinder-c2f436cc-b7d1-4c95-a9ed-db33bda20af9-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:21 devstack sudo[106759]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2ac10484-95e9-4bdc-a76a-e0922d77e104 tempest-ProjectReaderTests-1836518789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-de7e0815-d272-45e2-a37d-ed3a12b0935b" returned: 0 in 0.320s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:21 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-2ac10484-95e9-4bdc-a76a-e0922d77e104 tempest-ProjectReaderTests-1836518789 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:33:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2ac10484-95e9-4bdc-a76a-e0922d77e104 tempest-ProjectReaderTests-1836518789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a9ebbeec-d6bd-4a77-8ddd-4eeaacafa2a6 tempest-ProjectReaderTests-75358439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.499s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:21 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2ac10484-95e9-4bdc-a76a-e0922d77e104 tempest-ProjectReaderTests-1836518789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (669b5cb2-27aa-4c68-943e-eeca06509987) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de7e0815-d272-45e2-a37d-ed3a12b0935b', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:21 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2ac10484-95e9-4bdc-a76a-e0922d77e104 tempest-ProjectReaderTests-1836518789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9fc664f-5dcd-4327-9b18-6d68980537cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:21 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-a9ebbeec-d6bd-4a77-8ddd-4eeaacafa2a6 tempest-ProjectReaderTests-75358439 None] Creating offline snapshot b279f5ee-1866-4d8a-88c9-7d66b8d96b1a of volume 290e0b36-5336-44ef-aafc-5c4d7de23688 {{(pid=88613) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:33:21 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-2ac10484-95e9-4bdc-a76a-e0922d77e104 tempest-ProjectReaderTests-1836518789 None] Volume volume-de7e0815-d272-45e2-a37d-ed3a12b0935b (de7e0815-d272-45e2-a37d-ed3a12b0935b): created successfully Aug 05 10:33:21 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2ac10484-95e9-4bdc-a76a-e0922d77e104 tempest-ProjectReaderTests-1836518789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9fc664f-5dcd-4327-9b18-6d68980537cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:21 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2ac10484-95e9-4bdc-a76a-e0922d77e104 tempest-ProjectReaderTests-1836518789 None] Flow 'volume_create_manager' (fea8bd6e-e501-48f9-be61-a8cbf3567d58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:33:21 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[592c1d3b-a077-4095-993e-7ee03c88a3e6]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:33:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a9ebbeec-d6bd-4a77-8ddd-4eeaacafa2a6 tempest-ProjectReaderTests-75358439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-290e0b36-5336-44ef-aafc-5c4d7de23688 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:21 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-2ac10484-95e9-4bdc-a76a-e0922d77e104 tempest-ProjectReaderTests-1836518789 None] Created volume successfully. Aug 05 10:33:21 devstack sudo[106762]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-19992eac-9b7b-4eec-a7c6-a015bd84914f tempest-CreateVolumesFromSourceVolumeTest-43181798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3f8dddfa-b25c-475b-a78b-05c246cddfd2" returned: 0 in 0.423s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-19992eac-9b7b-4eec-a7c6-a015bd84914f tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3f8dddfa-b25c-475b-a78b-05c246cddfd2 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:21 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:21 devstack sudo[106775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3f8dddfa-b25c-475b-a78b-05c246cddfd2 Aug 05 10:33:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-796d7e4c-2ea2-4352-82a3-de3a2b3b4a3b tempest-VolumeDependencyTests-1689696164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a.42cca555-ea9d-46a1-a003-2b9e2aa368bf" returned: 0 in 0.408s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-796d7e4c-2ea2-4352-82a3-de3a2b3b4a3b tempest-VolumeDependencyTests-1689696164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a.42cca555-ea9d-46a1-a003-2b9e2aa368bf {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:21 devstack sudo[106775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:21 devstack sudo[106770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-290e0b36-5336-44ef-aafc-5c4d7de23688 Aug 05 10:33:21 devstack sudo[106770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:21 devstack sudo[106778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a.42cca555-ea9d-46a1-a003-2b9e2aa368bf Aug 05 10:33:21 devstack sudo[106778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:21 devstack sudo[106778]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:21 devstack sudo[106775]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-796d7e4c-2ea2-4352-82a3-de3a2b3b4a3b tempest-VolumeDependencyTests-1689696164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a.42cca555-ea9d-46a1-a003-2b9e2aa368bf" returned: 0 in 0.242s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-19992eac-9b7b-4eec-a7c6-a015bd84914f tempest-CreateVolumesFromSourceVolumeTest-43181798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-3f8dddfa-b25c-475b-a78b-05c246cddfd2" returned: 0 in 0.275s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:21 devstack sudo[106770]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:21 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-19992eac-9b7b-4eec-a7c6-a015bd84914f tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Lock "cinder-quobyte-3f8dddfa-b25c-475b-a78b-05c246cddfd2" released by "delete_volume" :: held 0.742s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a9ebbeec-d6bd-4a77-8ddd-4eeaacafa2a6 tempest-ProjectReaderTests-75358439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-290e0b36-5336-44ef-aafc-5c4d7de23688" returned: 0 in 0.422s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a9ebbeec-d6bd-4a77-8ddd-4eeaacafa2a6 tempest-ProjectReaderTests-75358439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-290e0b36-5336-44ef-aafc-5c4d7de23688,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-290e0b36-5336-44ef-aafc-5c4d7de23688.b279f5ee-1866-4d8a-88c9-7d66b8d96b1a 1G {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:21 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-796d7e4c-2ea2-4352-82a3-de3a2b3b4a3b tempest-VolumeDependencyTests-1689696164 None] Lock "cinder-quobyte-42cca555-ea9d-46a1-a003-2b9e2aa368bf" released by "_delete_snapshot" :: held 1.869s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:21 devstack sudo[106785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-290e0b36-5336-44ef-aafc-5c4d7de23688,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-290e0b36-5336-44ef-aafc-5c4d7de23688.b279f5ee-1866-4d8a-88c9-7d66b8d96b1a 1G Aug 05 10:33:21 devstack sudo[106785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:21 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-796d7e4c-2ea2-4352-82a3-de3a2b3b4a3b tempest-VolumeDependencyTests-1689696164 None] Lock "cinder-quobyte-50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a" released by "delete_snapshot" :: held 1.918s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:21 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-19992eac-9b7b-4eec-a7c6-a015bd84914f tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Created reservations ['bf88bf99-62a5-4e2c-9c93-4331d7db4e56', 'a702662d-e9f1-4040-b331-4fa9069cc82e', '8c02d160-cb82-4fc3-ad35-318d2d706d7a', 'ae3409cd-a26c-4f9b-9659-377e0dae8c54'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:33:21 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-796d7e4c-2ea2-4352-82a3-de3a2b3b4a3b tempest-VolumeDependencyTests-1689696164 None] Created reservations ['de58414d-cecd-4eb1-90c9-7ea7ac8e1bd6', 'eacd61e7-5ca1-4bc8-a412-1b8a67716a3c', '740e074b-01ba-4172-a4e8-1460277dd38e', 'ed881b58-e280-4dde-ab01-cc8af3e94325'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:33:21 devstack cinder-volume[88613]: DEBUG oslo_service.periodic_task [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88613) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:33:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:21 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:33:21 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:33:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:21 devstack sudo[106787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:33:21 devstack sudo[106787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-19992eac-9b7b-4eec-a7c6-a015bd84914f tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-19992eac-9b7b-4eec-a7c6-a015bd84914f tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:21 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-19992eac-9b7b-4eec-a7c6-a015bd84914f tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:33:21 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-19992eac-9b7b-4eec-a7c6-a015bd84914f tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:33:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-19992eac-9b7b-4eec-a7c6-a015bd84914f tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-19992eac-9b7b-4eec-a7c6-a015bd84914f tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:21 devstack sudo[106791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:33:21 devstack sudo[106791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:21 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-796d7e4c-2ea2-4352-82a3-de3a2b3b4a3b tempest-VolumeDependencyTests-1689696164 None] Delete snapshot completed successfully. Aug 05 10:33:21 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-796d7e4c-2ea2-4352-82a3-de3a2b3b4a3b tempest-VolumeDependencyTests-1689696164 None] Lock "cinder-42cca555-ea9d-46a1-a003-2b9e2aa368bf-delete_snapshot" released by "delete_snapshot" :: held 2.224s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:22 devstack sudo[106785]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:22 devstack sudo[106787]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.307s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:22 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:33:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a9ebbeec-d6bd-4a77-8ddd-4eeaacafa2a6 tempest-ProjectReaderTests-75358439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-290e0b36-5336-44ef-aafc-5c4d7de23688,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-290e0b36-5336-44ef-aafc-5c4d7de23688.b279f5ee-1866-4d8a-88c9-7d66b8d96b1a 1G" returned: 0 in 0.460s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a9ebbeec-d6bd-4a77-8ddd-4eeaacafa2a6 tempest-ProjectReaderTests-75358439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-290e0b36-5336-44ef-aafc-5c4d7de23688 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-290e0b36-5336-44ef-aafc-5c4d7de23688.b279f5ee-1866-4d8a-88c9-7d66b8d96b1a {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:22 devstack cinder-volume[88613]: DEBUG oslo_service.periodic_task [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Running periodic task VolumeManager._thread_info {{(pid=88613) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:33:22 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] thread count: 29 {{(pid=88613) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 10:33:22 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] thread info: [<_MainThread(MainThread, started 126173666128000)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88613) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 10:33:22 devstack sudo[106797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-290e0b36-5336-44ef-aafc-5c4d7de23688 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-290e0b36-5336-44ef-aafc-5c4d7de23688.b279f5ee-1866-4d8a-88c9-7d66b8d96b1a Aug 05 10:33:22 devstack sudo[106797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:22 devstack sudo[106791]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-19992eac-9b7b-4eec-a7c6-a015bd84914f tempest-CreateVolumesFromSourceVolumeTest-43181798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.373s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:22 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-19992eac-9b7b-4eec-a7c6-a015bd84914f tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:33:22 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-19992eac-9b7b-4eec-a7c6-a015bd84914f tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Deleted volume successfully. Aug 05 10:33:22 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-19992eac-9b7b-4eec-a7c6-a015bd84914f tempest-CreateVolumesFromSourceVolumeTest-43181798 None] Lock "cinder-3f8dddfa-b25c-475b-a78b-05c246cddfd2-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:22 devstack sudo[106797]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a9ebbeec-d6bd-4a77-8ddd-4eeaacafa2a6 tempest-ProjectReaderTests-75358439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-290e0b36-5336-44ef-aafc-5c4d7de23688 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-290e0b36-5336-44ef-aafc-5c4d7de23688.b279f5ee-1866-4d8a-88c9-7d66b8d96b1a" returned: 0 in 0.355s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:22 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-a9ebbeec-d6bd-4a77-8ddd-4eeaacafa2a6 tempest-ProjectReaderTests-75358439 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-290e0b36-5336-44ef-aafc-5c4d7de23688.b279f5ee-1866-4d8a-88c9-7d66b8d96b1a is being set with open permissions: ugo+rw Aug 05 10:33:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a9ebbeec-d6bd-4a77-8ddd-4eeaacafa2a6 tempest-ProjectReaderTests-75358439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-290e0b36-5336-44ef-aafc-5c4d7de23688.b279f5ee-1866-4d8a-88c9-7d66b8d96b1a {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:22 devstack sudo[106803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-290e0b36-5336-44ef-aafc-5c4d7de23688.b279f5ee-1866-4d8a-88c9-7d66b8d96b1a Aug 05 10:33:22 devstack sudo[106803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:22 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-5d3963a7-b5d3-4355-acab-128c7d78f622 tempest-ProjectReaderTests-1836518789 None] Acquiring lock "cinder-de7e0815-d272-45e2-a37d-ed3a12b0935b-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:22 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-5d3963a7-b5d3-4355-acab-128c7d78f622 tempest-ProjectReaderTests-1836518789 None] Lock "cinder-de7e0815-d272-45e2-a37d-ed3a12b0935b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:22 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-5d3963a7-b5d3-4355-acab-128c7d78f622 tempest-ProjectReaderTests-1836518789 None] Acquiring lock "cinder-quobyte-de7e0815-d272-45e2-a37d-ed3a12b0935b" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:22 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-5d3963a7-b5d3-4355-acab-128c7d78f622 tempest-ProjectReaderTests-1836518789 None] Lock "cinder-quobyte-de7e0815-d272-45e2-a37d-ed3a12b0935b" acquired by "delete_volume" :: waited 0.020s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:22 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[5efabaf1-53ad-45e2-a0a7-07e749541634]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:33:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5d3963a7-b5d3-4355-acab-128c7d78f622 tempest-ProjectReaderTests-1836518789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-de7e0815-d272-45e2-a37d-ed3a12b0935b {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:22 devstack sudo[106803]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a9ebbeec-d6bd-4a77-8ddd-4eeaacafa2a6 tempest-ProjectReaderTests-75358439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-290e0b36-5336-44ef-aafc-5c4d7de23688.b279f5ee-1866-4d8a-88c9-7d66b8d96b1a" returned: 0 in 0.339s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:22 devstack sudo[106805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-de7e0815-d272-45e2-a37d-ed3a12b0935b Aug 05 10:33:22 devstack sudo[106805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a9ebbeec-d6bd-4a77-8ddd-4eeaacafa2a6 tempest-ProjectReaderTests-75358439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-290e0b36-5336-44ef-aafc-5c4d7de23688.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:22 devstack sudo[106808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-290e0b36-5336-44ef-aafc-5c4d7de23688.info Aug 05 10:33:22 devstack sudo[106808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:22 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-419f09da-cc3c-4fec-bbb5-bd0eb5338dce tempest-VolumeDependencyTests-1689696164 None] Acquiring lock "cinder-50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:23 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-419f09da-cc3c-4fec-bbb5-bd0eb5338dce tempest-VolumeDependencyTests-1689696164 None] Lock "cinder-50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a-delete_volume" acquired by "delete_volume" :: waited 0.123s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:23 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-419f09da-cc3c-4fec-bbb5-bd0eb5338dce tempest-VolumeDependencyTests-1689696164 None] Acquiring lock "cinder-quobyte-50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:23 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-419f09da-cc3c-4fec-bbb5-bd0eb5338dce tempest-VolumeDependencyTests-1689696164 None] Lock "cinder-quobyte-50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a" acquired by "delete_volume" :: waited 0.024s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:23 devstack sudo[106805]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5d3963a7-b5d3-4355-acab-128c7d78f622 tempest-ProjectReaderTests-1836518789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-de7e0815-d272-45e2-a37d-ed3a12b0935b" returned: 0 in 0.521s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5d3963a7-b5d3-4355-acab-128c7d78f622 tempest-ProjectReaderTests-1836518789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-de7e0815-d272-45e2-a37d-ed3a12b0935b {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:23 devstack sudo[106808]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:23 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbef4aa9-aed1-4d97-b272-d8836af3d4b7]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:33:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-419f09da-cc3c-4fec-bbb5-bd0eb5338dce tempest-VolumeDependencyTests-1689696164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:23 devstack sudo[106814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-de7e0815-d272-45e2-a37d-ed3a12b0935b Aug 05 10:33:23 devstack sudo[106814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a9ebbeec-d6bd-4a77-8ddd-4eeaacafa2a6 tempest-ProjectReaderTests-75358439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-290e0b36-5336-44ef-aafc-5c4d7de23688.info" returned: 0 in 0.382s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:23 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-a9ebbeec-d6bd-4a77-8ddd-4eeaacafa2a6 tempest-ProjectReaderTests-75358439 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-290e0b36-5336-44ef-aafc-5c4d7de23688.info is being set with open permissions: ugo+rw Aug 05 10:33:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a9ebbeec-d6bd-4a77-8ddd-4eeaacafa2a6 tempest-ProjectReaderTests-75358439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-290e0b36-5336-44ef-aafc-5c4d7de23688.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:23 devstack sudo[106817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-290e0b36-5336-44ef-aafc-5c4d7de23688.info Aug 05 10:33:23 devstack sudo[106817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:23 devstack sudo[106816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a Aug 05 10:33:23 devstack sudo[106816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:23 devstack sudo[106814]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5d3963a7-b5d3-4355-acab-128c7d78f622 tempest-ProjectReaderTests-1836518789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-de7e0815-d272-45e2-a37d-ed3a12b0935b" returned: 0 in 0.319s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:23 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-5d3963a7-b5d3-4355-acab-128c7d78f622 tempest-ProjectReaderTests-1836518789 None] Lock "cinder-quobyte-de7e0815-d272-45e2-a37d-ed3a12b0935b" released by "delete_volume" :: held 0.895s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:23 devstack sudo[106817]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a9ebbeec-d6bd-4a77-8ddd-4eeaacafa2a6 tempest-ProjectReaderTests-75358439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-290e0b36-5336-44ef-aafc-5c4d7de23688.info" returned: 0 in 0.338s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a9ebbeec-d6bd-4a77-8ddd-4eeaacafa2a6 tempest-ProjectReaderTests-75358439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.422s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:23 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-a9ebbeec-d6bd-4a77-8ddd-4eeaacafa2a6 tempest-ProjectReaderTests-75358439 None] Create snapshot completed successfully Aug 05 10:33:23 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-5d3963a7-b5d3-4355-acab-128c7d78f622 tempest-ProjectReaderTests-1836518789 None] Created reservations ['d84fd1e1-054f-4e7d-a682-912ad3f58fbc', '54a4189e-af5e-48ce-b7ef-11b3cb05e90b', '54487cea-37c8-4132-85e5-8f679b4e2f0d', '999fde21-7123-4eee-8f79-7460d6691047'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:33:23 devstack sudo[106816]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-419f09da-cc3c-4fec-bbb5-bd0eb5338dce tempest-VolumeDependencyTests-1689696164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a" returned: 0 in 0.436s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-419f09da-cc3c-4fec-bbb5-bd0eb5338dce tempest-VolumeDependencyTests-1689696164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:23 devstack sudo[106825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a Aug 05 10:33:23 devstack sudo[106825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5d3963a7-b5d3-4355-acab-128c7d78f622 tempest-ProjectReaderTests-1836518789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5d3963a7-b5d3-4355-acab-128c7d78f622 tempest-ProjectReaderTests-1836518789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:23 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-5d3963a7-b5d3-4355-acab-128c7d78f622 tempest-ProjectReaderTests-1836518789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:33:23 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-5d3963a7-b5d3-4355-acab-128c7d78f622 tempest-ProjectReaderTests-1836518789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:33:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5d3963a7-b5d3-4355-acab-128c7d78f622 tempest-ProjectReaderTests-1836518789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5d3963a7-b5d3-4355-acab-128c7d78f622 tempest-ProjectReaderTests-1836518789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:23 devstack sudo[106827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:33:23 devstack sudo[106827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:23 devstack sudo[106825]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-419f09da-cc3c-4fec-bbb5-bd0eb5338dce tempest-VolumeDependencyTests-1689696164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a" returned: 0 in 0.329s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:23 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-419f09da-cc3c-4fec-bbb5-bd0eb5338dce tempest-VolumeDependencyTests-1689696164 None] Lock "cinder-quobyte-50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a" released by "delete_volume" :: held 0.842s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:24 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-419f09da-cc3c-4fec-bbb5-bd0eb5338dce tempest-VolumeDependencyTests-1689696164 None] Created reservations ['80e01d07-d7c8-4cb8-b1ad-14abb0f68f49', 'af5b422f-1062-437b-805f-57e870c8c62b', 'cbe8e652-72ca-4965-afc5-4cae057e7ceb', 'bcac898c-9ce5-40f4-9274-717cc1f697a0'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:33:24 devstack sudo[106827]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:24 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5d3963a7-b5d3-4355-acab-128c7d78f622 tempest-ProjectReaderTests-1836518789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.373s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:24 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-5d3963a7-b5d3-4355-acab-128c7d78f622 tempest-ProjectReaderTests-1836518789 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:33:24 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-5d3963a7-b5d3-4355-acab-128c7d78f622 tempest-ProjectReaderTests-1836518789 None] Deleted volume successfully. Aug 05 10:33:24 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-5d3963a7-b5d3-4355-acab-128c7d78f622 tempest-ProjectReaderTests-1836518789 None] Lock "cinder-de7e0815-d272-45e2-a37d-ed3a12b0935b-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:24 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-419f09da-cc3c-4fec-bbb5-bd0eb5338dce tempest-VolumeDependencyTests-1689696164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:24 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-419f09da-cc3c-4fec-bbb5-bd0eb5338dce tempest-VolumeDependencyTests-1689696164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:24 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-419f09da-cc3c-4fec-bbb5-bd0eb5338dce tempest-VolumeDependencyTests-1689696164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:33:24 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-419f09da-cc3c-4fec-bbb5-bd0eb5338dce tempest-VolumeDependencyTests-1689696164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:33:24 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-419f09da-cc3c-4fec-bbb5-bd0eb5338dce tempest-VolumeDependencyTests-1689696164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:24 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-419f09da-cc3c-4fec-bbb5-bd0eb5338dce tempest-VolumeDependencyTests-1689696164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:24 devstack sudo[106831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:33:24 devstack sudo[106831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:24 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d9538e0f-cda3-4381-bbfb-ddfe0c54b9ad tempest-ProjectReaderTests-75358439 None] Acquiring lock "cinder-b279f5ee-1866-4d8a-88c9-7d66b8d96b1a-delete_snapshot" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:24 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d9538e0f-cda3-4381-bbfb-ddfe0c54b9ad tempest-ProjectReaderTests-75358439 None] Lock "cinder-b279f5ee-1866-4d8a-88c9-7d66b8d96b1a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:24 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d9538e0f-cda3-4381-bbfb-ddfe0c54b9ad tempest-ProjectReaderTests-75358439 None] Acquiring lock "cinder-quobyte-290e0b36-5336-44ef-aafc-5c4d7de23688" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:24 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d9538e0f-cda3-4381-bbfb-ddfe0c54b9ad tempest-ProjectReaderTests-75358439 None] Lock "cinder-quobyte-290e0b36-5336-44ef-aafc-5c4d7de23688" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:24 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d9538e0f-cda3-4381-bbfb-ddfe0c54b9ad tempest-ProjectReaderTests-75358439 None] Acquiring lock "cinder-quobyte-b279f5ee-1866-4d8a-88c9-7d66b8d96b1a" by "_delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:24 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d9538e0f-cda3-4381-bbfb-ddfe0c54b9ad tempest-ProjectReaderTests-75358439 None] Lock "cinder-quobyte-b279f5ee-1866-4d8a-88c9-7d66b8d96b1a" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:24 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-d9538e0f-cda3-4381-bbfb-ddfe0c54b9ad tempest-ProjectReaderTests-75358439 None] Deleting offline snapshot b279f5ee-1866-4d8a-88c9-7d66b8d96b1a of volume 290e0b36-5336-44ef-aafc-5c4d7de23688 {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:33:24 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-d9538e0f-cda3-4381-bbfb-ddfe0c54b9ad tempest-ProjectReaderTests-75358439 None] snapshot_file for this snap is: volume-290e0b36-5336-44ef-aafc-5c4d7de23688.b279f5ee-1866-4d8a-88c9-7d66b8d96b1a {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:33:24 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e72fd90-c402-4295-aff0-3a52643f3070]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:33:24 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d9538e0f-cda3-4381-bbfb-ddfe0c54b9ad tempest-ProjectReaderTests-75358439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-290e0b36-5336-44ef-aafc-5c4d7de23688.b279f5ee-1866-4d8a-88c9-7d66b8d96b1a {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:24 devstack sudo[106831]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:24 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-419f09da-cc3c-4fec-bbb5-bd0eb5338dce tempest-VolumeDependencyTests-1689696164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.281s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:24 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-419f09da-cc3c-4fec-bbb5-bd0eb5338dce tempest-VolumeDependencyTests-1689696164 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:33:24 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-419f09da-cc3c-4fec-bbb5-bd0eb5338dce tempest-VolumeDependencyTests-1689696164 None] Deleted volume successfully. Aug 05 10:33:24 devstack sudo[106833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-290e0b36-5336-44ef-aafc-5c4d7de23688.b279f5ee-1866-4d8a-88c9-7d66b8d96b1a Aug 05 10:33:24 devstack sudo[106833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:24 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-419f09da-cc3c-4fec-bbb5-bd0eb5338dce tempest-VolumeDependencyTests-1689696164 None] Lock "cinder-50e4cc7b-7ab6-4f5b-969a-042a2a1d9b1a-delete_volume" released by "delete_volume" :: held 1.405s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:24 devstack sudo[106833]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:24 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d9538e0f-cda3-4381-bbfb-ddfe0c54b9ad tempest-ProjectReaderTests-75358439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-290e0b36-5336-44ef-aafc-5c4d7de23688.b279f5ee-1866-4d8a-88c9-7d66b8d96b1a" returned: 0 in 0.434s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:24 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-d9538e0f-cda3-4381-bbfb-ddfe0c54b9ad tempest-ProjectReaderTests-75358439 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-290e0b36-5336-44ef-aafc-5c4d7de23688(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88613) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:33:24 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda68338-4453-43f8-af1c-1e8bf7a9a9e4]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:33:24 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d9538e0f-cda3-4381-bbfb-ddfe0c54b9ad tempest-ProjectReaderTests-75358439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-290e0b36-5336-44ef-aafc-5c4d7de23688 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:24 devstack sudo[106840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-290e0b36-5336-44ef-aafc-5c4d7de23688 Aug 05 10:33:24 devstack sudo[106840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:25 devstack sudo[106840]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:25 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-6cbd82d1-fe80-479d-b540-b4e02f7b8ff2 tempest-VolumeDependencyTests-1689696164 None] Acquiring lock "cinder-61c6357f-66c1-41e5-b846-a48b69fe84c3-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d9538e0f-cda3-4381-bbfb-ddfe0c54b9ad tempest-ProjectReaderTests-75358439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-290e0b36-5336-44ef-aafc-5c4d7de23688" returned: 0 in 0.454s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d9538e0f-cda3-4381-bbfb-ddfe0c54b9ad tempest-ProjectReaderTests-75358439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-290e0b36-5336-44ef-aafc-5c4d7de23688.b279f5ee-1866-4d8a-88c9-7d66b8d96b1a {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:25 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-6cbd82d1-fe80-479d-b540-b4e02f7b8ff2 tempest-VolumeDependencyTests-1689696164 None] Lock "cinder-61c6357f-66c1-41e5-b846-a48b69fe84c3-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:25 devstack sudo[106845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-290e0b36-5336-44ef-aafc-5c4d7de23688.b279f5ee-1866-4d8a-88c9-7d66b8d96b1a Aug 05 10:33:25 devstack sudo[106845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:25 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6850aa4-295e-444b-9898-e2ac55cf67e5 tempest-ProjectReaderTests-1836518789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:33:25 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c6850aa4-295e-444b-9898-e2ac55cf67e5 tempest-ProjectReaderTests-1836518789 None] Flow 'volume_create_manager' (f565eb8a-c129-4a04-9420-8547c3d37add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:33:25 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c6850aa4-295e-444b-9898-e2ac55cf67e5 tempest-ProjectReaderTests-1836518789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a44c65e-a31c-4d46-bf93-5224c46c6bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:25 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c6850aa4-295e-444b-9898-e2ac55cf67e5 tempest-ProjectReaderTests-1836518789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a44c65e-a31c-4d46-bf93-5224c46c6bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:33:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1369209024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=320aee6a-a809-4fd3-8e8d-60cac3b79afc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1b086e408b44e5ea0ed7bdf81eaf277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:33:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:33:25Z,use_quota=True,user_id='b9819babf0b14d119e0f77d557379f60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:25 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c6850aa4-295e-444b-9898-e2ac55cf67e5 tempest-ProjectReaderTests-1836518789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bdf2999-cf0d-4596-82da-79f37924e89f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:25 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c6850aa4-295e-444b-9898-e2ac55cf67e5 tempest-ProjectReaderTests-1836518789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bdf2999-cf0d-4596-82da-79f37924e89f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:25 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c6850aa4-295e-444b-9898-e2ac55cf67e5 tempest-ProjectReaderTests-1836518789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38d50d04-4c5c-41bc-acfa-b1c05809ba9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:25 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c6850aa4-295e-444b-9898-e2ac55cf67e5 tempest-ProjectReaderTests-1836518789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38d50d04-4c5c-41bc-acfa-b1c05809ba9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '320aee6a-a809-4fd3-8e8d-60cac3b79afc', 'volume_name': 'volume-320aee6a-a809-4fd3-8e8d-60cac3b79afc', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:25 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c6850aa4-295e-444b-9898-e2ac55cf67e5 tempest-ProjectReaderTests-1836518789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9ab2bd7-67e7-4dd1-a0ff-414d00e95750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:25 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c6850aa4-295e-444b-9898-e2ac55cf67e5 tempest-ProjectReaderTests-1836518789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9ab2bd7-67e7-4dd1-a0ff-414d00e95750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:25 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c6850aa4-295e-444b-9898-e2ac55cf67e5 tempest-ProjectReaderTests-1836518789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9295d30e-ce99-43ae-a3bd-9314463b9bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:25 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-c6850aa4-295e-444b-9898-e2ac55cf67e5 tempest-ProjectReaderTests-1836518789 None] Volume 320aee6a-a809-4fd3-8e8d-60cac3b79afc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-320aee6a-a809-4fd3-8e8d-60cac3b79afc', 'volume_size': 1} Aug 05 10:33:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c6850aa4-295e-444b-9898-e2ac55cf67e5 tempest-ProjectReaderTests-1836518789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c6850aa4-295e-444b-9898-e2ac55cf67e5 tempest-ProjectReaderTests-1836518789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:25 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-c6850aa4-295e-444b-9898-e2ac55cf67e5 tempest-ProjectReaderTests-1836518789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:33:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1369209024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=320aee6a-a809-4fd3-8e8d-60cac3b79afc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1b086e408b44e5ea0ed7bdf81eaf277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:33:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:33:25Z,use_quota=True,user_id='b9819babf0b14d119e0f77d557379f60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:33:25 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-c6850aa4-295e-444b-9898-e2ac55cf67e5 tempest-ProjectReaderTests-1836518789 None] Creating volume 320aee6a-a809-4fd3-8e8d-60cac3b79afc {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:33:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c6850aa4-295e-444b-9898-e2ac55cf67e5 tempest-ProjectReaderTests-1836518789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c6850aa4-295e-444b-9898-e2ac55cf67e5 tempest-ProjectReaderTests-1836518789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:25 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-c6850aa4-295e-444b-9898-e2ac55cf67e5 tempest-ProjectReaderTests-1836518789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:33:25 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-c6850aa4-295e-444b-9898-e2ac55cf67e5 tempest-ProjectReaderTests-1836518789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:33:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c6850aa4-295e-444b-9898-e2ac55cf67e5 tempest-ProjectReaderTests-1836518789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:25 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-c6850aa4-295e-444b-9898-e2ac55cf67e5 tempest-ProjectReaderTests-1836518789 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:33:25 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-c6850aa4-295e-444b-9898-e2ac55cf67e5 tempest-ProjectReaderTests-1836518789 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:33:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c6850aa4-295e-444b-9898-e2ac55cf67e5 tempest-ProjectReaderTests-1836518789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-320aee6a-a809-4fd3-8e8d-60cac3b79afc 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:25 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-6cbd82d1-fe80-479d-b540-b4e02f7b8ff2 tempest-VolumeDependencyTests-1689696164 None] Acquiring lock "cinder-quobyte-61c6357f-66c1-41e5-b846-a48b69fe84c3" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:25 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-6cbd82d1-fe80-479d-b540-b4e02f7b8ff2 tempest-VolumeDependencyTests-1689696164 None] Lock "cinder-quobyte-61c6357f-66c1-41e5-b846-a48b69fe84c3" acquired by "delete_volume" :: waited 0.019s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:25 devstack sudo[106847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-320aee6a-a809-4fd3-8e8d-60cac3b79afc 1073741824 Aug 05 10:33:25 devstack sudo[106847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:25 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2fb255a-3eb5-4186-9751-409da4416e3c]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:33:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6cbd82d1-fe80-479d-b540-b4e02f7b8ff2 tempest-VolumeDependencyTests-1689696164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-61c6357f-66c1-41e5-b846-a48b69fe84c3 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:25 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ebbb89e-fb30-4e13-b88a-4eee8e466664 tempest-CinderUnicodeTest-319058763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:33:25 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3ebbb89e-fb30-4e13-b88a-4eee8e466664 tempest-CinderUnicodeTest-319058763 None] Flow 'volume_create_manager' (9c6b1752-4760-4edc-9d69-24b7eaf7ef96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:33:25 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3ebbb89e-fb30-4e13-b88a-4eee8e466664 tempest-CinderUnicodeTest-319058763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7200e163-8ca4-4073-b3f6-2d82892a4fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:25 devstack sudo[106851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-61c6357f-66c1-41e5-b846-a48b69fe84c3 Aug 05 10:33:25 devstack sudo[106851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:25 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3ebbb89e-fb30-4e13-b88a-4eee8e466664 tempest-CinderUnicodeTest-319058763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7200e163-8ca4-4073-b3f6-2d82892a4fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:33:25Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46410d54-454e-4038-88e7-ce33e0809d5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='779579e0fb1d496f866c2b7311dd5d0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:33:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:33:26Z,use_quota=True,user_id='7c46e651c30541cf8d7393b9b81d3e09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:25 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3ebbb89e-fb30-4e13-b88a-4eee8e466664 tempest-CinderUnicodeTest-319058763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53ef134a-e5a5-4711-8f08-b9a227c00276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:25 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3ebbb89e-fb30-4e13-b88a-4eee8e466664 tempest-CinderUnicodeTest-319058763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53ef134a-e5a5-4711-8f08-b9a227c00276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:25 devstack sudo[106845]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:25 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3ebbb89e-fb30-4e13-b88a-4eee8e466664 tempest-CinderUnicodeTest-319058763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b1eeddd-822b-4534-baec-a9b82c464f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:25 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3ebbb89e-fb30-4e13-b88a-4eee8e466664 tempest-CinderUnicodeTest-319058763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b1eeddd-822b-4534-baec-a9b82c464f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46410d54-454e-4038-88e7-ce33e0809d5a', 'volume_name': 'volume-46410d54-454e-4038-88e7-ce33e0809d5a', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:25 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3ebbb89e-fb30-4e13-b88a-4eee8e466664 tempest-CinderUnicodeTest-319058763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2a323a1-0aac-425f-8636-80ab7ee3c987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:25 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3ebbb89e-fb30-4e13-b88a-4eee8e466664 tempest-CinderUnicodeTest-319058763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2a323a1-0aac-425f-8636-80ab7ee3c987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:25 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3ebbb89e-fb30-4e13-b88a-4eee8e466664 tempest-CinderUnicodeTest-319058763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3794b4d8-563e-4c10-83d5-debeae75605f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:25 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-3ebbb89e-fb30-4e13-b88a-4eee8e466664 tempest-CinderUnicodeTest-319058763 None] Volume 46410d54-454e-4038-88e7-ce33e0809d5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46410d54-454e-4038-88e7-ce33e0809d5a', 'volume_size': 1} Aug 05 10:33:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-3ebbb89e-fb30-4e13-b88a-4eee8e466664 tempest-CinderUnicodeTest-319058763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d9538e0f-cda3-4381-bbfb-ddfe0c54b9ad tempest-ProjectReaderTests-75358439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-290e0b36-5336-44ef-aafc-5c4d7de23688.b279f5ee-1866-4d8a-88c9-7d66b8d96b1a" returned: 0 in 0.510s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d9538e0f-cda3-4381-bbfb-ddfe0c54b9ad tempest-ProjectReaderTests-75358439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-290e0b36-5336-44ef-aafc-5c4d7de23688.b279f5ee-1866-4d8a-88c9-7d66b8d96b1a {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:25 devstack sudo[106856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-290e0b36-5336-44ef-aafc-5c4d7de23688.b279f5ee-1866-4d8a-88c9-7d66b8d96b1a Aug 05 10:33:25 devstack sudo[106856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:26 devstack sudo[106851]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:26 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6cbd82d1-fe80-479d-b540-b4e02f7b8ff2 tempest-VolumeDependencyTests-1689696164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-61c6357f-66c1-41e5-b846-a48b69fe84c3" returned: 0 in 0.431s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:26 devstack sudo[106847]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:26 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6cbd82d1-fe80-479d-b540-b4e02f7b8ff2 tempest-VolumeDependencyTests-1689696164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-61c6357f-66c1-41e5-b846-a48b69fe84c3 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:26 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c6850aa4-295e-444b-9898-e2ac55cf67e5 tempest-ProjectReaderTests-1836518789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-320aee6a-a809-4fd3-8e8d-60cac3b79afc 1073741824" returned: 0 in 0.519s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:26 devstack sudo[106864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-61c6357f-66c1-41e5-b846-a48b69fe84c3 Aug 05 10:33:26 devstack sudo[106864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:26 devstack sudo[106856]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:26 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d9538e0f-cda3-4381-bbfb-ddfe0c54b9ad tempest-ProjectReaderTests-75358439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-290e0b36-5336-44ef-aafc-5c4d7de23688.b279f5ee-1866-4d8a-88c9-7d66b8d96b1a" returned: 0 in 0.275s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:26 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c6850aa4-295e-444b-9898-e2ac55cf67e5 tempest-ProjectReaderTests-1836518789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-320aee6a-a809-4fd3-8e8d-60cac3b79afc {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:26 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d9538e0f-cda3-4381-bbfb-ddfe0c54b9ad tempest-ProjectReaderTests-75358439 None] Lock "cinder-quobyte-b279f5ee-1866-4d8a-88c9-7d66b8d96b1a" released by "_delete_snapshot" :: held 1.819s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:26 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d9538e0f-cda3-4381-bbfb-ddfe0c54b9ad tempest-ProjectReaderTests-75358439 None] Lock "cinder-quobyte-290e0b36-5336-44ef-aafc-5c4d7de23688" released by "delete_snapshot" :: held 1.851s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:26 devstack sudo[106866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-320aee6a-a809-4fd3-8e8d-60cac3b79afc Aug 05 10:33:26 devstack sudo[106866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:26 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-d9538e0f-cda3-4381-bbfb-ddfe0c54b9ad tempest-ProjectReaderTests-75358439 None] Created reservations ['a64ce2c2-5e86-4485-9419-35afcc95aff7', 'bb74377d-8721-4a13-aa87-db0d7b07f02f', 'd83df556-3dc7-44a0-b976-dcb88aca40e3', 'dec9e4f9-81b1-4874-807c-b94bc53538f4'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:33:26 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-d9538e0f-cda3-4381-bbfb-ddfe0c54b9ad tempest-ProjectReaderTests-75358439 None] Delete snapshot completed successfully. Aug 05 10:33:26 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d9538e0f-cda3-4381-bbfb-ddfe0c54b9ad tempest-ProjectReaderTests-75358439 None] Lock "cinder-b279f5ee-1866-4d8a-88c9-7d66b8d96b1a-delete_snapshot" released by "delete_snapshot" :: held 2.028s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:26 devstack sudo[106864]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:26 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6cbd82d1-fe80-479d-b540-b4e02f7b8ff2 tempest-VolumeDependencyTests-1689696164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-61c6357f-66c1-41e5-b846-a48b69fe84c3" returned: 0 in 0.291s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:26 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-6cbd82d1-fe80-479d-b540-b4e02f7b8ff2 tempest-VolumeDependencyTests-1689696164 None] Lock "cinder-quobyte-61c6357f-66c1-41e5-b846-a48b69fe84c3" released by "delete_volume" :: held 0.768s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:26 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-6cbd82d1-fe80-479d-b540-b4e02f7b8ff2 tempest-VolumeDependencyTests-1689696164 None] Created reservations ['80b93f6d-f794-4146-a41d-a7ae408d7326', 'ea266532-f40c-4bdb-b228-f312fd21b66c', '71f73f65-158b-437a-8fa3-bb6b585e22ba', '3ba1f04b-8f06-4a23-97d0-a7210aaefed1'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:33:26 devstack sudo[106866]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:26 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c6850aa4-295e-444b-9898-e2ac55cf67e5 tempest-ProjectReaderTests-1836518789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-320aee6a-a809-4fd3-8e8d-60cac3b79afc" returned: 0 in 0.330s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:26 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-c6850aa4-295e-444b-9898-e2ac55cf67e5 tempest-ProjectReaderTests-1836518789 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:33:26 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c6850aa4-295e-444b-9898-e2ac55cf67e5 tempest-ProjectReaderTests-1836518789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:26 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-3ebbb89e-fb30-4e13-b88a-4eee8e466664 tempest-CinderUnicodeTest-319058763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.646s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:26 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-3ebbb89e-fb30-4e13-b88a-4eee8e466664 tempest-CinderUnicodeTest-319058763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:33:25Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46410d54-454e-4038-88e7-ce33e0809d5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='779579e0fb1d496f866c2b7311dd5d0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:33:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:33:26Z,use_quota=True,user_id='7c46e651c30541cf8d7393b9b81d3e09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:33:26 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-3ebbb89e-fb30-4e13-b88a-4eee8e466664 tempest-CinderUnicodeTest-319058763 None] Creating volume 46410d54-454e-4038-88e7-ce33e0809d5a {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:33:26 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-3ebbb89e-fb30-4e13-b88a-4eee8e466664 tempest-CinderUnicodeTest-319058763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:26 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-3ebbb89e-fb30-4e13-b88a-4eee8e466664 tempest-CinderUnicodeTest-319058763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:26 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-3ebbb89e-fb30-4e13-b88a-4eee8e466664 tempest-CinderUnicodeTest-319058763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:33:26 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-3ebbb89e-fb30-4e13-b88a-4eee8e466664 tempest-CinderUnicodeTest-319058763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:33:26 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-3ebbb89e-fb30-4e13-b88a-4eee8e466664 tempest-CinderUnicodeTest-319058763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:26 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-3ebbb89e-fb30-4e13-b88a-4eee8e466664 tempest-CinderUnicodeTest-319058763 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:33:26 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-3ebbb89e-fb30-4e13-b88a-4eee8e466664 tempest-CinderUnicodeTest-319058763 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:33:26 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3ebbb89e-fb30-4e13-b88a-4eee8e466664 tempest-CinderUnicodeTest-319058763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-46410d54-454e-4038-88e7-ce33e0809d5a 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:26 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c6850aa4-295e-444b-9898-e2ac55cf67e5 tempest-ProjectReaderTests-1836518789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9295d30e-ce99-43ae-a3bd-9314463b9bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-320aee6a-a809-4fd3-8e8d-60cac3b79afc', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:26 devstack sudo[106870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-46410d54-454e-4038-88e7-ce33e0809d5a 1073741824 Aug 05 10:33:26 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:26 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c6850aa4-295e-444b-9898-e2ac55cf67e5 tempest-ProjectReaderTests-1836518789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c6d1500-4ea5-443c-b957-6beafff2f73d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:26 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-0ab26f10-a225-4211-a935-9faaa61385b9 tempest-ProjectReaderTests-75358439 None] Acquiring lock "cinder-290e0b36-5336-44ef-aafc-5c4d7de23688-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:26 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-c6850aa4-295e-444b-9898-e2ac55cf67e5 tempest-ProjectReaderTests-1836518789 None] Volume volume-320aee6a-a809-4fd3-8e8d-60cac3b79afc (320aee6a-a809-4fd3-8e8d-60cac3b79afc): created successfully Aug 05 10:33:26 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c6850aa4-295e-444b-9898-e2ac55cf67e5 tempest-ProjectReaderTests-1836518789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c6d1500-4ea5-443c-b957-6beafff2f73d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:26 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c6850aa4-295e-444b-9898-e2ac55cf67e5 tempest-ProjectReaderTests-1836518789 None] Flow 'volume_create_manager' (f565eb8a-c129-4a04-9420-8547c3d37add) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:33:26 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-0ab26f10-a225-4211-a935-9faaa61385b9 tempest-ProjectReaderTests-75358439 None] Lock "cinder-290e0b36-5336-44ef-aafc-5c4d7de23688-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:26 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-6cbd82d1-fe80-479d-b540-b4e02f7b8ff2 tempest-VolumeDependencyTests-1689696164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:26 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-6cbd82d1-fe80-479d-b540-b4e02f7b8ff2 tempest-VolumeDependencyTests-1689696164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:26 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-6cbd82d1-fe80-479d-b540-b4e02f7b8ff2 tempest-VolumeDependencyTests-1689696164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:33:26 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-6cbd82d1-fe80-479d-b540-b4e02f7b8ff2 tempest-VolumeDependencyTests-1689696164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:33:26 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-6cbd82d1-fe80-479d-b540-b4e02f7b8ff2 tempest-VolumeDependencyTests-1689696164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:26 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6cbd82d1-fe80-479d-b540-b4e02f7b8ff2 tempest-VolumeDependencyTests-1689696164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:26 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-c6850aa4-295e-444b-9898-e2ac55cf67e5 tempest-ProjectReaderTests-1836518789 None] Created volume successfully. Aug 05 10:33:26 devstack sudo[106872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:33:26 devstack sudo[106872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:26 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-0ab26f10-a225-4211-a935-9faaa61385b9 tempest-ProjectReaderTests-75358439 None] Acquiring lock "cinder-quobyte-290e0b36-5336-44ef-aafc-5c4d7de23688" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:26 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-0ab26f10-a225-4211-a935-9faaa61385b9 tempest-ProjectReaderTests-75358439 None] Lock "cinder-quobyte-290e0b36-5336-44ef-aafc-5c4d7de23688" acquired by "delete_volume" :: waited 0.020s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:26 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7096730-4fe2-41c7-b34b-dfa7c1f4f68d]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:33:26 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-0ab26f10-a225-4211-a935-9faaa61385b9 tempest-ProjectReaderTests-75358439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-290e0b36-5336-44ef-aafc-5c4d7de23688 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:26 devstack sudo[106874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-290e0b36-5336-44ef-aafc-5c4d7de23688 Aug 05 10:33:26 devstack sudo[106874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:26 devstack sudo[106872]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:26 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6cbd82d1-fe80-479d-b540-b4e02f7b8ff2 tempest-VolumeDependencyTests-1689696164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.278s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:26 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-6cbd82d1-fe80-479d-b540-b4e02f7b8ff2 tempest-VolumeDependencyTests-1689696164 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:33:26 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-6cbd82d1-fe80-479d-b540-b4e02f7b8ff2 tempest-VolumeDependencyTests-1689696164 None] Deleted volume successfully. Aug 05 10:33:26 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-6cbd82d1-fe80-479d-b540-b4e02f7b8ff2 tempest-VolumeDependencyTests-1689696164 None] Lock "cinder-61c6357f-66c1-41e5-b846-a48b69fe84c3-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:26 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:26 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3ebbb89e-fb30-4e13-b88a-4eee8e466664 tempest-CinderUnicodeTest-319058763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-46410d54-454e-4038-88e7-ce33e0809d5a 1073741824" returned: 0 in 0.509s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:26 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3ebbb89e-fb30-4e13-b88a-4eee8e466664 tempest-CinderUnicodeTest-319058763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-46410d54-454e-4038-88e7-ce33e0809d5a {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:27 devstack sudo[106883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-46410d54-454e-4038-88e7-ce33e0809d5a Aug 05 10:33:27 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:27 devstack sudo[106874]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:27 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-0ab26f10-a225-4211-a935-9faaa61385b9 tempest-ProjectReaderTests-75358439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-290e0b36-5336-44ef-aafc-5c4d7de23688" returned: 0 in 0.403s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:27 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-0ab26f10-a225-4211-a935-9faaa61385b9 tempest-ProjectReaderTests-75358439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-290e0b36-5336-44ef-aafc-5c4d7de23688 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:27 devstack sudo[106887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-290e0b36-5336-44ef-aafc-5c4d7de23688 Aug 05 10:33:27 devstack sudo[106887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:27 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:27 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3ebbb89e-fb30-4e13-b88a-4eee8e466664 tempest-CinderUnicodeTest-319058763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-46410d54-454e-4038-88e7-ce33e0809d5a" returned: 0 in 0.261s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:27 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-3ebbb89e-fb30-4e13-b88a-4eee8e466664 tempest-CinderUnicodeTest-319058763 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:33:27 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-3ebbb89e-fb30-4e13-b88a-4eee8e466664 tempest-CinderUnicodeTest-319058763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:27 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3ebbb89e-fb30-4e13-b88a-4eee8e466664 tempest-CinderUnicodeTest-319058763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3794b4d8-563e-4c10-83d5-debeae75605f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46410d54-454e-4038-88e7-ce33e0809d5a', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:27 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3ebbb89e-fb30-4e13-b88a-4eee8e466664 tempest-CinderUnicodeTest-319058763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4520ef59-def7-475e-bccf-2f58b15aafc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:27 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-3ebbb89e-fb30-4e13-b88a-4eee8e466664 tempest-CinderUnicodeTest-319058763 None] Volume volume-46410d54-454e-4038-88e7-ce33e0809d5a (46410d54-454e-4038-88e7-ce33e0809d5a): created successfully Aug 05 10:33:27 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3ebbb89e-fb30-4e13-b88a-4eee8e466664 tempest-CinderUnicodeTest-319058763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4520ef59-def7-475e-bccf-2f58b15aafc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:27 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3ebbb89e-fb30-4e13-b88a-4eee8e466664 tempest-CinderUnicodeTest-319058763 None] Flow 'volume_create_manager' (9c6b1752-4760-4edc-9d69-24b7eaf7ef96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:33:27 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-3ebbb89e-fb30-4e13-b88a-4eee8e466664 tempest-CinderUnicodeTest-319058763 None] Created volume successfully. Aug 05 10:33:27 devstack sudo[106887]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:27 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-0ab26f10-a225-4211-a935-9faaa61385b9 tempest-ProjectReaderTests-75358439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-290e0b36-5336-44ef-aafc-5c4d7de23688" returned: 0 in 0.279s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:27 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-0ab26f10-a225-4211-a935-9faaa61385b9 tempest-ProjectReaderTests-75358439 None] Lock "cinder-quobyte-290e0b36-5336-44ef-aafc-5c4d7de23688" released by "delete_volume" :: held 0.739s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:27 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-0ab26f10-a225-4211-a935-9faaa61385b9 tempest-ProjectReaderTests-75358439 None] Created reservations ['44d69f08-dfa0-450c-b213-2ecef158b65d', '367548f0-44b7-4edf-a4ec-30d720ba2a54', '1042f1dc-94be-44d1-b86b-6accd0e5de5e', 'a76edb1b-e07a-44d6-828e-e362e3126909'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:33:27 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-3469218a-5ae6-4900-94c2-14081f50a7e3 tempest-ProjectReaderTests-1836518789 None] Acquiring lock "cinder-320aee6a-a809-4fd3-8e8d-60cac3b79afc-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:27 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-3469218a-5ae6-4900-94c2-14081f50a7e3 tempest-ProjectReaderTests-1836518789 None] Lock "cinder-320aee6a-a809-4fd3-8e8d-60cac3b79afc-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:27 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-0ab26f10-a225-4211-a935-9faaa61385b9 tempest-ProjectReaderTests-75358439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:27 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-0ab26f10-a225-4211-a935-9faaa61385b9 tempest-ProjectReaderTests-75358439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:27 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-0ab26f10-a225-4211-a935-9faaa61385b9 tempest-ProjectReaderTests-75358439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:33:27 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-0ab26f10-a225-4211-a935-9faaa61385b9 tempest-ProjectReaderTests-75358439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:33:27 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-0ab26f10-a225-4211-a935-9faaa61385b9 tempest-ProjectReaderTests-75358439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:27 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-0ab26f10-a225-4211-a935-9faaa61385b9 tempest-ProjectReaderTests-75358439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:27 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-3469218a-5ae6-4900-94c2-14081f50a7e3 tempest-ProjectReaderTests-1836518789 None] Acquiring lock "cinder-quobyte-320aee6a-a809-4fd3-8e8d-60cac3b79afc" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:27 devstack sudo[106891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:33:27 devstack sudo[106891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:27 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-3469218a-5ae6-4900-94c2-14081f50a7e3 tempest-ProjectReaderTests-1836518789 None] Lock "cinder-quobyte-320aee6a-a809-4fd3-8e8d-60cac3b79afc" acquired by "delete_volume" :: waited 0.033s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:27 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[129b0292-cf67-4b27-8bf3-4837513e12fb]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:33:27 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3469218a-5ae6-4900-94c2-14081f50a7e3 tempest-ProjectReaderTests-1836518789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-320aee6a-a809-4fd3-8e8d-60cac3b79afc {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:27 devstack sudo[106893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-320aee6a-a809-4fd3-8e8d-60cac3b79afc Aug 05 10:33:27 devstack sudo[106893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:27 devstack sudo[106891]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:27 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-0ab26f10-a225-4211-a935-9faaa61385b9 tempest-ProjectReaderTests-75358439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.382s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:27 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-0ab26f10-a225-4211-a935-9faaa61385b9 tempest-ProjectReaderTests-75358439 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:33:27 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-0ab26f10-a225-4211-a935-9faaa61385b9 tempest-ProjectReaderTests-75358439 None] Deleted volume successfully. Aug 05 10:33:27 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-0ab26f10-a225-4211-a935-9faaa61385b9 tempest-ProjectReaderTests-75358439 None] Lock "cinder-290e0b36-5336-44ef-aafc-5c4d7de23688-delete_volume" released by "delete_volume" :: held 1.461s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:28 devstack sudo[106893]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:28 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3469218a-5ae6-4900-94c2-14081f50a7e3 tempest-ProjectReaderTests-1836518789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-320aee6a-a809-4fd3-8e8d-60cac3b79afc" returned: 0 in 0.630s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:28 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3469218a-5ae6-4900-94c2-14081f50a7e3 tempest-ProjectReaderTests-1836518789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-320aee6a-a809-4fd3-8e8d-60cac3b79afc {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:28 devstack sudo[106899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-320aee6a-a809-4fd3-8e8d-60cac3b79afc Aug 05 10:33:28 devstack sudo[106899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:28 devstack sudo[106899]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:28 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3469218a-5ae6-4900-94c2-14081f50a7e3 tempest-ProjectReaderTests-1836518789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-320aee6a-a809-4fd3-8e8d-60cac3b79afc" returned: 0 in 0.288s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:28 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-3469218a-5ae6-4900-94c2-14081f50a7e3 tempest-ProjectReaderTests-1836518789 None] Lock "cinder-quobyte-320aee6a-a809-4fd3-8e8d-60cac3b79afc" released by "delete_volume" :: held 0.985s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:28 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-3469218a-5ae6-4900-94c2-14081f50a7e3 tempest-ProjectReaderTests-1836518789 None] Created reservations ['b1a48d28-cce8-42eb-bba7-45ab831dd1de', 'c66ea057-8237-4e3d-9f9c-4cd88e798aee', '19f4bcce-8ae2-48f1-88e9-b088ac794eb4', '64aec465-079a-4e24-829e-280e1058b377'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:33:28 devstack cinder-volume[88613]: DEBUG dbcounter [-] [88613] Writing DB stats cinder:SELECT=201,cinder:UPDATE=290,cinder:INSERT=84,cinder:DELETE=30 {{(pid=88613) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:33:28 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa5c8395-96c8-4bff-8b4e-d4ce025fa161 tempest-ProjectReaderTests-75358439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:33:28 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-aa5c8395-96c8-4bff-8b4e-d4ce025fa161 tempest-ProjectReaderTests-75358439 None] Flow 'volume_create_manager' (77b515ce-94bb-4426-9f8a-8d02fe0e1084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:33:28 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-aa5c8395-96c8-4bff-8b4e-d4ce025fa161 tempest-ProjectReaderTests-75358439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84658336-9593-4f75-a880-2129f498fc58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:28 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-aa5c8395-96c8-4bff-8b4e-d4ce025fa161 tempest-ProjectReaderTests-75358439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84658336-9593-4f75-a880-2129f498fc58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:33:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-371914024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65768419-5517-4030-88d1-cfe4f61dbec8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9b5160d951e4a2a96ce9b3e8fdeea1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:33:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:33:29Z,use_quota=True,user_id='933aa00d66fc4d42adc58da2c963056c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:28 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-aa5c8395-96c8-4bff-8b4e-d4ce025fa161 tempest-ProjectReaderTests-75358439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd2f6a3d-5c73-4844-89a5-80e74768e625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:28 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-aa5c8395-96c8-4bff-8b4e-d4ce025fa161 tempest-ProjectReaderTests-75358439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd2f6a3d-5c73-4844-89a5-80e74768e625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:28 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-aa5c8395-96c8-4bff-8b4e-d4ce025fa161 tempest-ProjectReaderTests-75358439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5d9a96e-8a5b-4ec9-8f50-c4d3c3b16463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:28 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-aa5c8395-96c8-4bff-8b4e-d4ce025fa161 tempest-ProjectReaderTests-75358439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5d9a96e-8a5b-4ec9-8f50-c4d3c3b16463) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65768419-5517-4030-88d1-cfe4f61dbec8', 'volume_name': 'volume-65768419-5517-4030-88d1-cfe4f61dbec8', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:28 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-aa5c8395-96c8-4bff-8b4e-d4ce025fa161 tempest-ProjectReaderTests-75358439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b8d7841-51db-4e65-a1bb-988d0e04b8a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:28 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-aa5c8395-96c8-4bff-8b4e-d4ce025fa161 tempest-ProjectReaderTests-75358439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b8d7841-51db-4e65-a1bb-988d0e04b8a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:28 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-aa5c8395-96c8-4bff-8b4e-d4ce025fa161 tempest-ProjectReaderTests-75358439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f16cde9-f552-47f2-b1c7-65ce97450a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:28 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-aa5c8395-96c8-4bff-8b4e-d4ce025fa161 tempest-ProjectReaderTests-75358439 None] Volume 65768419-5517-4030-88d1-cfe4f61dbec8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65768419-5517-4030-88d1-cfe4f61dbec8', 'volume_size': 1} Aug 05 10:33:28 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-aa5c8395-96c8-4bff-8b4e-d4ce025fa161 tempest-ProjectReaderTests-75358439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:28 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-aa5c8395-96c8-4bff-8b4e-d4ce025fa161 tempest-ProjectReaderTests-75358439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:28 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-aa5c8395-96c8-4bff-8b4e-d4ce025fa161 tempest-ProjectReaderTests-75358439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:33:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-371914024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65768419-5517-4030-88d1-cfe4f61dbec8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9b5160d951e4a2a96ce9b3e8fdeea1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:33:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:33:29Z,use_quota=True,user_id='933aa00d66fc4d42adc58da2c963056c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:33:28 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-aa5c8395-96c8-4bff-8b4e-d4ce025fa161 tempest-ProjectReaderTests-75358439 None] Creating volume 65768419-5517-4030-88d1-cfe4f61dbec8 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:33:28 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-aa5c8395-96c8-4bff-8b4e-d4ce025fa161 tempest-ProjectReaderTests-75358439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:28 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-aa5c8395-96c8-4bff-8b4e-d4ce025fa161 tempest-ProjectReaderTests-75358439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:28 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-aa5c8395-96c8-4bff-8b4e-d4ce025fa161 tempest-ProjectReaderTests-75358439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:33:28 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-aa5c8395-96c8-4bff-8b4e-d4ce025fa161 tempest-ProjectReaderTests-75358439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:33:28 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-aa5c8395-96c8-4bff-8b4e-d4ce025fa161 tempest-ProjectReaderTests-75358439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:28 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-aa5c8395-96c8-4bff-8b4e-d4ce025fa161 tempest-ProjectReaderTests-75358439 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:33:28 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-aa5c8395-96c8-4bff-8b4e-d4ce025fa161 tempest-ProjectReaderTests-75358439 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:33:28 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-aa5c8395-96c8-4bff-8b4e-d4ce025fa161 tempest-ProjectReaderTests-75358439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-65768419-5517-4030-88d1-cfe4f61dbec8 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:28 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-bad73b67-c52a-4fc6-be04-338eb88ca0b2 tempest-CinderUnicodeTest-319058763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:33:28 devstack sudo[106902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-65768419-5517-4030-88d1-cfe4f61dbec8 1073741824 Aug 05 10:33:28 devstack sudo[106902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:28 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-bad73b67-c52a-4fc6-be04-338eb88ca0b2 tempest-CinderUnicodeTest-319058763 None] Flow 'volume_create_manager' (822d23c8-b935-4018-9edc-30d8f4feea10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:33:28 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-bad73b67-c52a-4fc6-be04-338eb88ca0b2 tempest-CinderUnicodeTest-319058763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cce13ee-d9f7-4afd-b4f2-4de246994ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:28 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-bad73b67-c52a-4fc6-be04-338eb88ca0b2 tempest-CinderUnicodeTest-319058763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cce13ee-d9f7-4afd-b4f2-4de246994ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:33:28Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-353929508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=704ed8df-561e-400b-957a-13f68f53429c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='779579e0fb1d496f866c2b7311dd5d0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:33:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:33:29Z,use_quota=True,user_id='7c46e651c30541cf8d7393b9b81d3e09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:28 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-bad73b67-c52a-4fc6-be04-338eb88ca0b2 tempest-CinderUnicodeTest-319058763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc647881-78ce-400b-8231-ecc54159e2e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:28 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-bad73b67-c52a-4fc6-be04-338eb88ca0b2 tempest-CinderUnicodeTest-319058763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc647881-78ce-400b-8231-ecc54159e2e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:28 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-bad73b67-c52a-4fc6-be04-338eb88ca0b2 tempest-CinderUnicodeTest-319058763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d628f35a-7f33-4613-aadf-e0149b23fa00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:28 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-bad73b67-c52a-4fc6-be04-338eb88ca0b2 tempest-CinderUnicodeTest-319058763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d628f35a-7f33-4613-aadf-e0149b23fa00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '704ed8df-561e-400b-957a-13f68f53429c', 'volume_name': 'volume-704ed8df-561e-400b-957a-13f68f53429c', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:28 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-bad73b67-c52a-4fc6-be04-338eb88ca0b2 tempest-CinderUnicodeTest-319058763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d29d11d4-1292-4ffb-9aa7-c54252c13438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:28 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-bad73b67-c52a-4fc6-be04-338eb88ca0b2 tempest-CinderUnicodeTest-319058763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d29d11d4-1292-4ffb-9aa7-c54252c13438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:28 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-bad73b67-c52a-4fc6-be04-338eb88ca0b2 tempest-CinderUnicodeTest-319058763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (826db27c-7271-4da7-b85e-1fb9a293a627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:28 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-bad73b67-c52a-4fc6-be04-338eb88ca0b2 tempest-CinderUnicodeTest-319058763 None] Volume 704ed8df-561e-400b-957a-13f68f53429c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-704ed8df-561e-400b-957a-13f68f53429c', 'volume_size': 1} Aug 05 10:33:28 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-bad73b67-c52a-4fc6-be04-338eb88ca0b2 tempest-CinderUnicodeTest-319058763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:28 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-3469218a-5ae6-4900-94c2-14081f50a7e3 tempest-ProjectReaderTests-1836518789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:28 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-3469218a-5ae6-4900-94c2-14081f50a7e3 tempest-ProjectReaderTests-1836518789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:28 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-3469218a-5ae6-4900-94c2-14081f50a7e3 tempest-ProjectReaderTests-1836518789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:33:28 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-3469218a-5ae6-4900-94c2-14081f50a7e3 tempest-ProjectReaderTests-1836518789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:33:28 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-3469218a-5ae6-4900-94c2-14081f50a7e3 tempest-ProjectReaderTests-1836518789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:28 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3469218a-5ae6-4900-94c2-14081f50a7e3 tempest-ProjectReaderTests-1836518789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:28 devstack sudo[106904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:33:28 devstack sudo[106904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:29 devstack sudo[106904]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:29 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3469218a-5ae6-4900-94c2-14081f50a7e3 tempest-ProjectReaderTests-1836518789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.318s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:29 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-3469218a-5ae6-4900-94c2-14081f50a7e3 tempest-ProjectReaderTests-1836518789 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:33:29 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-3469218a-5ae6-4900-94c2-14081f50a7e3 tempest-ProjectReaderTests-1836518789 None] Deleted volume successfully. Aug 05 10:33:29 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-3469218a-5ae6-4900-94c2-14081f50a7e3 tempest-ProjectReaderTests-1836518789 None] Lock "cinder-320aee6a-a809-4fd3-8e8d-60cac3b79afc-delete_volume" released by "delete_volume" :: held 1.860s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:29 devstack sudo[106902]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:29 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-aa5c8395-96c8-4bff-8b4e-d4ce025fa161 tempest-ProjectReaderTests-75358439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-65768419-5517-4030-88d1-cfe4f61dbec8 1073741824" returned: 0 in 0.541s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:29 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-aa5c8395-96c8-4bff-8b4e-d4ce025fa161 tempest-ProjectReaderTests-75358439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-65768419-5517-4030-88d1-cfe4f61dbec8 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:29 devstack sudo[106910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-65768419-5517-4030-88d1-cfe4f61dbec8 Aug 05 10:33:29 devstack sudo[106910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:29 devstack sudo[106910]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:29 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-aa5c8395-96c8-4bff-8b4e-d4ce025fa161 tempest-ProjectReaderTests-75358439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-65768419-5517-4030-88d1-cfe4f61dbec8" returned: 0 in 0.257s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:29 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-aa5c8395-96c8-4bff-8b4e-d4ce025fa161 tempest-ProjectReaderTests-75358439 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:33:29 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-aa5c8395-96c8-4bff-8b4e-d4ce025fa161 tempest-ProjectReaderTests-75358439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:29 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-bad73b67-c52a-4fc6-be04-338eb88ca0b2 tempest-CinderUnicodeTest-319058763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.722s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:29 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-bad73b67-c52a-4fc6-be04-338eb88ca0b2 tempest-CinderUnicodeTest-319058763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:33:28Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-353929508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=704ed8df-561e-400b-957a-13f68f53429c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='779579e0fb1d496f866c2b7311dd5d0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:33:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:33:29Z,use_quota=True,user_id='7c46e651c30541cf8d7393b9b81d3e09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:33:29 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-bad73b67-c52a-4fc6-be04-338eb88ca0b2 tempest-CinderUnicodeTest-319058763 None] Creating volume 704ed8df-561e-400b-957a-13f68f53429c {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:33:29 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-bad73b67-c52a-4fc6-be04-338eb88ca0b2 tempest-CinderUnicodeTest-319058763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:29 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-bad73b67-c52a-4fc6-be04-338eb88ca0b2 tempest-CinderUnicodeTest-319058763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:29 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-bad73b67-c52a-4fc6-be04-338eb88ca0b2 tempest-CinderUnicodeTest-319058763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:33:29 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-bad73b67-c52a-4fc6-be04-338eb88ca0b2 tempest-CinderUnicodeTest-319058763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:33:29 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-bad73b67-c52a-4fc6-be04-338eb88ca0b2 tempest-CinderUnicodeTest-319058763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:29 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-bad73b67-c52a-4fc6-be04-338eb88ca0b2 tempest-CinderUnicodeTest-319058763 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:33:29 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-bad73b67-c52a-4fc6-be04-338eb88ca0b2 tempest-CinderUnicodeTest-319058763 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:33:29 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-bad73b67-c52a-4fc6-be04-338eb88ca0b2 tempest-CinderUnicodeTest-319058763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-704ed8df-561e-400b-957a-13f68f53429c 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:29 devstack sudo[106913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-704ed8df-561e-400b-957a-13f68f53429c 1073741824 Aug 05 10:33:29 devstack sudo[106913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:29 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-aa5c8395-96c8-4bff-8b4e-d4ce025fa161 tempest-ProjectReaderTests-75358439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f16cde9-f552-47f2-b1c7-65ce97450a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65768419-5517-4030-88d1-cfe4f61dbec8', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:29 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-aa5c8395-96c8-4bff-8b4e-d4ce025fa161 tempest-ProjectReaderTests-75358439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (320b2219-6a51-49e6-92f2-5c87ef3ce376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:29 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-aa5c8395-96c8-4bff-8b4e-d4ce025fa161 tempest-ProjectReaderTests-75358439 None] Volume volume-65768419-5517-4030-88d1-cfe4f61dbec8 (65768419-5517-4030-88d1-cfe4f61dbec8): created successfully Aug 05 10:33:29 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-aa5c8395-96c8-4bff-8b4e-d4ce025fa161 tempest-ProjectReaderTests-75358439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (320b2219-6a51-49e6-92f2-5c87ef3ce376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:29 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-aa5c8395-96c8-4bff-8b4e-d4ce025fa161 tempest-ProjectReaderTests-75358439 None] Flow 'volume_create_manager' (77b515ce-94bb-4426-9f8a-8d02fe0e1084) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:33:29 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-aa5c8395-96c8-4bff-8b4e-d4ce025fa161 tempest-ProjectReaderTests-75358439 None] Created volume successfully. Aug 05 10:33:30 devstack sudo[106913]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:30 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-bad73b67-c52a-4fc6-be04-338eb88ca0b2 tempest-CinderUnicodeTest-319058763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-704ed8df-561e-400b-957a-13f68f53429c 1073741824" returned: 0 in 0.594s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:30 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e40574b-e69f-4a9e-9c27-41c4a29bbd8a tempest-ProjectReaderTests-1836518789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:33:30 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0e40574b-e69f-4a9e-9c27-41c4a29bbd8a tempest-ProjectReaderTests-1836518789 None] Flow 'volume_create_manager' (57677437-a705-40ca-a84a-b85642d10c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:33:30 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0e40574b-e69f-4a9e-9c27-41c4a29bbd8a tempest-ProjectReaderTests-1836518789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edb9840e-6038-43de-813b-95f0960372ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:30 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-bad73b67-c52a-4fc6-be04-338eb88ca0b2 tempest-CinderUnicodeTest-319058763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-704ed8df-561e-400b-957a-13f68f53429c {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:30 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0e40574b-e69f-4a9e-9c27-41c4a29bbd8a tempest-ProjectReaderTests-1836518789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edb9840e-6038-43de-813b-95f0960372ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:33:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1224972689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c3d2944-35b8-4fb5-be3d-4c999f677652,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1b086e408b44e5ea0ed7bdf81eaf277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:33:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:33:30Z,use_quota=True,user_id='b9819babf0b14d119e0f77d557379f60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:30 devstack sudo[106919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-704ed8df-561e-400b-957a-13f68f53429c Aug 05 10:33:30 devstack sudo[106919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:30 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0e40574b-e69f-4a9e-9c27-41c4a29bbd8a tempest-ProjectReaderTests-1836518789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69c2ffbe-152e-4a78-a22d-0cbdc194ad39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:30 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0e40574b-e69f-4a9e-9c27-41c4a29bbd8a tempest-ProjectReaderTests-1836518789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69c2ffbe-152e-4a78-a22d-0cbdc194ad39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:30 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0e40574b-e69f-4a9e-9c27-41c4a29bbd8a tempest-ProjectReaderTests-1836518789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fab7258-a652-4d31-8a4d-ff2c45b1e79a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:30 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0e40574b-e69f-4a9e-9c27-41c4a29bbd8a tempest-ProjectReaderTests-1836518789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fab7258-a652-4d31-8a4d-ff2c45b1e79a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c3d2944-35b8-4fb5-be3d-4c999f677652', 'volume_name': 'volume-0c3d2944-35b8-4fb5-be3d-4c999f677652', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:30 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0e40574b-e69f-4a9e-9c27-41c4a29bbd8a tempest-ProjectReaderTests-1836518789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40281a52-7af1-4ea1-923c-49524b6d0035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:30 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0e40574b-e69f-4a9e-9c27-41c4a29bbd8a tempest-ProjectReaderTests-1836518789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40281a52-7af1-4ea1-923c-49524b6d0035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:30 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0e40574b-e69f-4a9e-9c27-41c4a29bbd8a tempest-ProjectReaderTests-1836518789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (684fec2b-7b20-4760-9d57-c27014fa183e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:30 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-0e40574b-e69f-4a9e-9c27-41c4a29bbd8a tempest-ProjectReaderTests-1836518789 None] Volume 0c3d2944-35b8-4fb5-be3d-4c999f677652: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c3d2944-35b8-4fb5-be3d-4c999f677652', 'volume_size': 1} Aug 05 10:33:30 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-0e40574b-e69f-4a9e-9c27-41c4a29bbd8a tempest-ProjectReaderTests-1836518789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:30 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-6c1e2be4-e89f-4e44-833a-0e2820c2d18e tempest-ProjectReaderTests-75358439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:30 devstack sudo[106919]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:30 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-bad73b67-c52a-4fc6-be04-338eb88ca0b2 tempest-CinderUnicodeTest-319058763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-704ed8df-561e-400b-957a-13f68f53429c" returned: 0 in 0.329s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:30 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-bad73b67-c52a-4fc6-be04-338eb88ca0b2 tempest-CinderUnicodeTest-319058763 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:33:30 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-bad73b67-c52a-4fc6-be04-338eb88ca0b2 tempest-CinderUnicodeTest-319058763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:30 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-0e40574b-e69f-4a9e-9c27-41c4a29bbd8a tempest-ProjectReaderTests-1836518789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.232s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:30 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-0e40574b-e69f-4a9e-9c27-41c4a29bbd8a tempest-ProjectReaderTests-1836518789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:33:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1224972689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c3d2944-35b8-4fb5-be3d-4c999f677652,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1b086e408b44e5ea0ed7bdf81eaf277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:33:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:33:30Z,use_quota=True,user_id='b9819babf0b14d119e0f77d557379f60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:33:30 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-0e40574b-e69f-4a9e-9c27-41c4a29bbd8a tempest-ProjectReaderTests-1836518789 None] Creating volume 0c3d2944-35b8-4fb5-be3d-4c999f677652 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:33:30 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-0e40574b-e69f-4a9e-9c27-41c4a29bbd8a tempest-ProjectReaderTests-1836518789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:30 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-0e40574b-e69f-4a9e-9c27-41c4a29bbd8a tempest-ProjectReaderTests-1836518789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:30 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-0e40574b-e69f-4a9e-9c27-41c4a29bbd8a tempest-ProjectReaderTests-1836518789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:33:30 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-0e40574b-e69f-4a9e-9c27-41c4a29bbd8a tempest-ProjectReaderTests-1836518789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:33:30 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-0e40574b-e69f-4a9e-9c27-41c4a29bbd8a tempest-ProjectReaderTests-1836518789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:30 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-0e40574b-e69f-4a9e-9c27-41c4a29bbd8a tempest-ProjectReaderTests-1836518789 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:33:30 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-0e40574b-e69f-4a9e-9c27-41c4a29bbd8a tempest-ProjectReaderTests-1836518789 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:33:30 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-0e40574b-e69f-4a9e-9c27-41c4a29bbd8a tempest-ProjectReaderTests-1836518789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0c3d2944-35b8-4fb5-be3d-4c999f677652 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:30 devstack sudo[106922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0c3d2944-35b8-4fb5-be3d-4c999f677652 1073741824 Aug 05 10:33:30 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-bad73b67-c52a-4fc6-be04-338eb88ca0b2 tempest-CinderUnicodeTest-319058763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (826db27c-7271-4da7-b85e-1fb9a293a627) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-704ed8df-561e-400b-957a-13f68f53429c', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:30 devstack sudo[106922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:30 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-bad73b67-c52a-4fc6-be04-338eb88ca0b2 tempest-CinderUnicodeTest-319058763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab95e859-8140-48d0-92b6-9ab1e80338eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:30 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-bad73b67-c52a-4fc6-be04-338eb88ca0b2 tempest-CinderUnicodeTest-319058763 None] Volume volume-704ed8df-561e-400b-957a-13f68f53429c (704ed8df-561e-400b-957a-13f68f53429c): created successfully Aug 05 10:33:30 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-bad73b67-c52a-4fc6-be04-338eb88ca0b2 tempest-CinderUnicodeTest-319058763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab95e859-8140-48d0-92b6-9ab1e80338eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:30 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-bad73b67-c52a-4fc6-be04-338eb88ca0b2 tempest-CinderUnicodeTest-319058763 None] Flow 'volume_create_manager' (822d23c8-b935-4018-9edc-30d8f4feea10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:33:30 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-bad73b67-c52a-4fc6-be04-338eb88ca0b2 tempest-CinderUnicodeTest-319058763 None] Created volume successfully. Aug 05 10:33:31 devstack sudo[106922]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:31 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-0e40574b-e69f-4a9e-9c27-41c4a29bbd8a tempest-ProjectReaderTests-1836518789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0c3d2944-35b8-4fb5-be3d-4c999f677652 1073741824" returned: 0 in 0.509s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:31 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-0e40574b-e69f-4a9e-9c27-41c4a29bbd8a tempest-ProjectReaderTests-1836518789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0c3d2944-35b8-4fb5-be3d-4c999f677652 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:31 devstack sudo[106928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0c3d2944-35b8-4fb5-be3d-4c999f677652 Aug 05 10:33:31 devstack sudo[106928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:31 devstack sudo[106928]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:31 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-0e40574b-e69f-4a9e-9c27-41c4a29bbd8a tempest-ProjectReaderTests-1836518789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0c3d2944-35b8-4fb5-be3d-4c999f677652" returned: 0 in 0.268s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:31 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-0e40574b-e69f-4a9e-9c27-41c4a29bbd8a tempest-ProjectReaderTests-1836518789 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:33:31 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-0e40574b-e69f-4a9e-9c27-41c4a29bbd8a tempest-ProjectReaderTests-1836518789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:31 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-6c1e2be4-e89f-4e44-833a-0e2820c2d18e tempest-ProjectReaderTests-75358439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.875s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:31 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-6c1e2be4-e89f-4e44-833a-0e2820c2d18e tempest-ProjectReaderTests-75358439 None] Creating offline snapshot ca53096f-84ee-4a70-8038-34cbcdf18f60 of volume 65768419-5517-4030-88d1-cfe4f61dbec8 {{(pid=88613) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:33:31 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0e40574b-e69f-4a9e-9c27-41c4a29bbd8a tempest-ProjectReaderTests-1836518789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (684fec2b-7b20-4760-9d57-c27014fa183e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c3d2944-35b8-4fb5-be3d-4c999f677652', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:31 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0e40574b-e69f-4a9e-9c27-41c4a29bbd8a tempest-ProjectReaderTests-1836518789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6596483e-f318-4144-98ea-c27e88697280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:31 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[e44596f0-d722-4e02-8e5b-6f90ba757912]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:33:31 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6c1e2be4-e89f-4e44-833a-0e2820c2d18e tempest-ProjectReaderTests-75358439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-65768419-5517-4030-88d1-cfe4f61dbec8 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:31 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-0e40574b-e69f-4a9e-9c27-41c4a29bbd8a tempest-ProjectReaderTests-1836518789 None] Volume volume-0c3d2944-35b8-4fb5-be3d-4c999f677652 (0c3d2944-35b8-4fb5-be3d-4c999f677652): created successfully Aug 05 10:33:31 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0e40574b-e69f-4a9e-9c27-41c4a29bbd8a tempest-ProjectReaderTests-1836518789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6596483e-f318-4144-98ea-c27e88697280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:31 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-0e40574b-e69f-4a9e-9c27-41c4a29bbd8a tempest-ProjectReaderTests-1836518789 None] Flow 'volume_create_manager' (57677437-a705-40ca-a84a-b85642d10c90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:33:31 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-0e40574b-e69f-4a9e-9c27-41c4a29bbd8a tempest-ProjectReaderTests-1836518789 None] Created volume successfully. Aug 05 10:33:31 devstack sudo[106931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-65768419-5517-4030-88d1-cfe4f61dbec8 Aug 05 10:33:31 devstack sudo[106931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:31 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-88d7a339-c9e7-4262-a29b-165e28d9c141 tempest-ProjectMemberTests-188752871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:33:31 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-88d7a339-c9e7-4262-a29b-165e28d9c141 tempest-ProjectMemberTests-188752871 None] Flow 'volume_create_manager' (7841fb1a-c3ef-4274-a6de-ed594827ced5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:33:31 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-88d7a339-c9e7-4262-a29b-165e28d9c141 tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95553571-29c9-4b53-8286-32212ca41015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:31 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-88d7a339-c9e7-4262-a29b-165e28d9c141 tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95553571-29c9-4b53-8286-32212ca41015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:33:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1008056672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=349a3669-414b-474f-bd46-96f4dca03633,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8da1a4df661e48a896791cae706d962d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:33:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:33:32Z,use_quota=True,user_id='7390514821a74358b20ac932df9a2ce2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:31 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-88d7a339-c9e7-4262-a29b-165e28d9c141 tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4467521-965a-4791-8d73-92ba8d53266c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:31 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-88d7a339-c9e7-4262-a29b-165e28d9c141 tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4467521-965a-4791-8d73-92ba8d53266c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:31 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-88d7a339-c9e7-4262-a29b-165e28d9c141 tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48428631-1379-400c-b964-5331597d6e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:31 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-88d7a339-c9e7-4262-a29b-165e28d9c141 tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48428631-1379-400c-b964-5331597d6e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '349a3669-414b-474f-bd46-96f4dca03633', 'volume_name': 'volume-349a3669-414b-474f-bd46-96f4dca03633', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:31 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-88d7a339-c9e7-4262-a29b-165e28d9c141 tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c364fd0e-65ec-4535-96d6-d4bedd724e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:31 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-88d7a339-c9e7-4262-a29b-165e28d9c141 tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c364fd0e-65ec-4535-96d6-d4bedd724e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:31 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-88d7a339-c9e7-4262-a29b-165e28d9c141 tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b99f4ac-0725-4019-8ef0-6f01b939a0ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:31 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-88d7a339-c9e7-4262-a29b-165e28d9c141 tempest-ProjectMemberTests-188752871 None] Volume 349a3669-414b-474f-bd46-96f4dca03633: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-349a3669-414b-474f-bd46-96f4dca03633', 'volume_size': 1} Aug 05 10:33:31 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-88d7a339-c9e7-4262-a29b-165e28d9c141 tempest-ProjectMemberTests-188752871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:31 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-4a0ceff8-430a-4754-afa5-e16bdd09aba0 tempest-CinderUnicodeTest-319058763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:32 devstack sudo[106931]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:32 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6c1e2be4-e89f-4e44-833a-0e2820c2d18e tempest-ProjectReaderTests-75358439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-65768419-5517-4030-88d1-cfe4f61dbec8" returned: 0 in 0.470s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:32 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6c1e2be4-e89f-4e44-833a-0e2820c2d18e tempest-ProjectReaderTests-75358439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-65768419-5517-4030-88d1-cfe4f61dbec8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-65768419-5517-4030-88d1-cfe4f61dbec8.ca53096f-84ee-4a70-8038-34cbcdf18f60 1G {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:32 devstack sudo[106936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-65768419-5517-4030-88d1-cfe4f61dbec8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-65768419-5517-4030-88d1-cfe4f61dbec8.ca53096f-84ee-4a70-8038-34cbcdf18f60 1G Aug 05 10:33:32 devstack sudo[106936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:32 devstack sudo[106936]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:32 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-50af5761-5abd-4427-870a-6f2aad332128 tempest-ProjectReaderTests-1836518789 None] Acquiring lock "cinder-0c3d2944-35b8-4fb5-be3d-4c999f677652-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:32 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6c1e2be4-e89f-4e44-833a-0e2820c2d18e tempest-ProjectReaderTests-75358439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-65768419-5517-4030-88d1-cfe4f61dbec8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-65768419-5517-4030-88d1-cfe4f61dbec8.ca53096f-84ee-4a70-8038-34cbcdf18f60 1G" returned: 0 in 0.424s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:32 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6c1e2be4-e89f-4e44-833a-0e2820c2d18e tempest-ProjectReaderTests-75358439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65768419-5517-4030-88d1-cfe4f61dbec8 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-65768419-5517-4030-88d1-cfe4f61dbec8.ca53096f-84ee-4a70-8038-34cbcdf18f60 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:32 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-50af5761-5abd-4427-870a-6f2aad332128 tempest-ProjectReaderTests-1836518789 None] Lock "cinder-0c3d2944-35b8-4fb5-be3d-4c999f677652-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:32 devstack sudo[106942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65768419-5517-4030-88d1-cfe4f61dbec8 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-65768419-5517-4030-88d1-cfe4f61dbec8.ca53096f-84ee-4a70-8038-34cbcdf18f60 Aug 05 10:33:32 devstack sudo[106942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:32 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-50af5761-5abd-4427-870a-6f2aad332128 tempest-ProjectReaderTests-1836518789 None] Acquiring lock "cinder-quobyte-0c3d2944-35b8-4fb5-be3d-4c999f677652" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:32 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-50af5761-5abd-4427-870a-6f2aad332128 tempest-ProjectReaderTests-1836518789 None] Lock "cinder-quobyte-0c3d2944-35b8-4fb5-be3d-4c999f677652" acquired by "delete_volume" :: waited 0.016s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:32 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb6e1e10-9e3a-427c-9dbd-25f51cee4093]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:33:32 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-50af5761-5abd-4427-870a-6f2aad332128 tempest-ProjectReaderTests-1836518789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0c3d2944-35b8-4fb5-be3d-4c999f677652 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:32 devstack sudo[106944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0c3d2944-35b8-4fb5-be3d-4c999f677652 Aug 05 10:33:32 devstack sudo[106944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:32 devstack sudo[106942]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:32 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6c1e2be4-e89f-4e44-833a-0e2820c2d18e tempest-ProjectReaderTests-75358439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65768419-5517-4030-88d1-cfe4f61dbec8 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-65768419-5517-4030-88d1-cfe4f61dbec8.ca53096f-84ee-4a70-8038-34cbcdf18f60" returned: 0 in 0.325s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:32 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-6c1e2be4-e89f-4e44-833a-0e2820c2d18e tempest-ProjectReaderTests-75358439 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-65768419-5517-4030-88d1-cfe4f61dbec8.ca53096f-84ee-4a70-8038-34cbcdf18f60 is being set with open permissions: ugo+rw Aug 05 10:33:32 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6c1e2be4-e89f-4e44-833a-0e2820c2d18e tempest-ProjectReaderTests-75358439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-65768419-5517-4030-88d1-cfe4f61dbec8.ca53096f-84ee-4a70-8038-34cbcdf18f60 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:32 devstack sudo[106950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-65768419-5517-4030-88d1-cfe4f61dbec8.ca53096f-84ee-4a70-8038-34cbcdf18f60 Aug 05 10:33:32 devstack sudo[106950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:32 devstack sudo[106944]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:32 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-50af5761-5abd-4427-870a-6f2aad332128 tempest-ProjectReaderTests-1836518789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0c3d2944-35b8-4fb5-be3d-4c999f677652" returned: 0 in 0.363s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:32 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-50af5761-5abd-4427-870a-6f2aad332128 tempest-ProjectReaderTests-1836518789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0c3d2944-35b8-4fb5-be3d-4c999f677652 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:32 devstack sudo[106955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0c3d2944-35b8-4fb5-be3d-4c999f677652 Aug 05 10:33:32 devstack sudo[106955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:33 devstack sudo[106950]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:33 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6c1e2be4-e89f-4e44-833a-0e2820c2d18e tempest-ProjectReaderTests-75358439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-65768419-5517-4030-88d1-cfe4f61dbec8.ca53096f-84ee-4a70-8038-34cbcdf18f60" returned: 0 in 0.247s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:33 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6c1e2be4-e89f-4e44-833a-0e2820c2d18e tempest-ProjectReaderTests-75358439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-65768419-5517-4030-88d1-cfe4f61dbec8.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:33 devstack sudo[106958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-65768419-5517-4030-88d1-cfe4f61dbec8.info Aug 05 10:33:33 devstack sudo[106958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:33 devstack sudo[106955]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:33 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-50af5761-5abd-4427-870a-6f2aad332128 tempest-ProjectReaderTests-1836518789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-0c3d2944-35b8-4fb5-be3d-4c999f677652" returned: 0 in 0.260s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:33 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-50af5761-5abd-4427-870a-6f2aad332128 tempest-ProjectReaderTests-1836518789 None] Lock "cinder-quobyte-0c3d2944-35b8-4fb5-be3d-4c999f677652" released by "delete_volume" :: held 0.661s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:33 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-50af5761-5abd-4427-870a-6f2aad332128 tempest-ProjectReaderTests-1836518789 None] Created reservations ['1d38b2a8-6034-45e3-9716-2590ff4dc7e8', 'c4e2362e-3588-4482-af3f-1ed5b5b99265', 'ddc44e8b-ee88-4e36-a871-4465da57cd3d', '7519d1f4-0e16-4045-9806-91804b09eef8'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:33:33 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-50af5761-5abd-4427-870a-6f2aad332128 tempest-ProjectReaderTests-1836518789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:33 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-50af5761-5abd-4427-870a-6f2aad332128 tempest-ProjectReaderTests-1836518789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:33 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-50af5761-5abd-4427-870a-6f2aad332128 tempest-ProjectReaderTests-1836518789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:33:33 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-50af5761-5abd-4427-870a-6f2aad332128 tempest-ProjectReaderTests-1836518789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:33:33 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-50af5761-5abd-4427-870a-6f2aad332128 tempest-ProjectReaderTests-1836518789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:33 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-50af5761-5abd-4427-870a-6f2aad332128 tempest-ProjectReaderTests-1836518789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:33 devstack sudo[106958]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:33 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6c1e2be4-e89f-4e44-833a-0e2820c2d18e tempest-ProjectReaderTests-75358439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-65768419-5517-4030-88d1-cfe4f61dbec8.info" returned: 0 in 0.259s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:33 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-6c1e2be4-e89f-4e44-833a-0e2820c2d18e tempest-ProjectReaderTests-75358439 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-65768419-5517-4030-88d1-cfe4f61dbec8.info is being set with open permissions: ugo+rw Aug 05 10:33:33 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6c1e2be4-e89f-4e44-833a-0e2820c2d18e tempest-ProjectReaderTests-75358439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-65768419-5517-4030-88d1-cfe4f61dbec8.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:33 devstack sudo[106962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:33:33 devstack sudo[106962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:33 devstack sudo[106963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-65768419-5517-4030-88d1-cfe4f61dbec8.info Aug 05 10:33:33 devstack sudo[106963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:33 devstack sudo[106962]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:33 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-50af5761-5abd-4427-870a-6f2aad332128 tempest-ProjectReaderTests-1836518789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.250s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:33 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-50af5761-5abd-4427-870a-6f2aad332128 tempest-ProjectReaderTests-1836518789 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:33:33 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-50af5761-5abd-4427-870a-6f2aad332128 tempest-ProjectReaderTests-1836518789 None] Deleted volume successfully. Aug 05 10:33:33 devstack sudo[106963]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:33 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6c1e2be4-e89f-4e44-833a-0e2820c2d18e tempest-ProjectReaderTests-75358439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-65768419-5517-4030-88d1-cfe4f61dbec8.info" returned: 0 in 0.259s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:33 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-6c1e2be4-e89f-4e44-833a-0e2820c2d18e tempest-ProjectReaderTests-75358439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.089s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:33 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-88d7a339-c9e7-4262-a29b-165e28d9c141 tempest-ProjectMemberTests-188752871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.728s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:33 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-88d7a339-c9e7-4262-a29b-165e28d9c141 tempest-ProjectMemberTests-188752871 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:33:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1008056672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=349a3669-414b-474f-bd46-96f4dca03633,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8da1a4df661e48a896791cae706d962d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:33:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:33:32Z,use_quota=True,user_id='7390514821a74358b20ac932df9a2ce2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:33:33 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-88d7a339-c9e7-4262-a29b-165e28d9c141 tempest-ProjectMemberTests-188752871 None] Creating volume 349a3669-414b-474f-bd46-96f4dca03633 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:33:33 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-88d7a339-c9e7-4262-a29b-165e28d9c141 tempest-ProjectMemberTests-188752871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:33 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-88d7a339-c9e7-4262-a29b-165e28d9c141 tempest-ProjectMemberTests-188752871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:33 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-88d7a339-c9e7-4262-a29b-165e28d9c141 tempest-ProjectMemberTests-188752871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:33:33 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-88d7a339-c9e7-4262-a29b-165e28d9c141 tempest-ProjectMemberTests-188752871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:33:33 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-88d7a339-c9e7-4262-a29b-165e28d9c141 tempest-ProjectMemberTests-188752871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:33 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-88d7a339-c9e7-4262-a29b-165e28d9c141 tempest-ProjectMemberTests-188752871 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:33:33 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-88d7a339-c9e7-4262-a29b-165e28d9c141 tempest-ProjectMemberTests-188752871 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:33:33 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-88d7a339-c9e7-4262-a29b-165e28d9c141 tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-349a3669-414b-474f-bd46-96f4dca03633 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:33 devstack sudo[106968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-349a3669-414b-474f-bd46-96f4dca03633 1073741824 Aug 05 10:33:33 devstack sudo[106968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:33 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-50af5761-5abd-4427-870a-6f2aad332128 tempest-ProjectReaderTests-1836518789 None] Lock "cinder-0c3d2944-35b8-4fb5-be3d-4c999f677652-delete_volume" released by "delete_volume" :: held 1.168s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:33 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-6c1e2be4-e89f-4e44-833a-0e2820c2d18e tempest-ProjectReaderTests-75358439 None] Create snapshot completed successfully Aug 05 10:33:33 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-347ace88-6cac-4d49-bc16-2690c684a7a4 tempest-ProjectReaderTests-75358439 None] Acquiring lock "cinder-ca53096f-84ee-4a70-8038-34cbcdf18f60-delete_snapshot" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:33 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-347ace88-6cac-4d49-bc16-2690c684a7a4 tempest-ProjectReaderTests-75358439 None] Lock "cinder-ca53096f-84ee-4a70-8038-34cbcdf18f60-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:33 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-347ace88-6cac-4d49-bc16-2690c684a7a4 tempest-ProjectReaderTests-75358439 None] Acquiring lock "cinder-quobyte-65768419-5517-4030-88d1-cfe4f61dbec8" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:33 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-347ace88-6cac-4d49-bc16-2690c684a7a4 tempest-ProjectReaderTests-75358439 None] Lock "cinder-quobyte-65768419-5517-4030-88d1-cfe4f61dbec8" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:33 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-347ace88-6cac-4d49-bc16-2690c684a7a4 tempest-ProjectReaderTests-75358439 None] Acquiring lock "cinder-quobyte-ca53096f-84ee-4a70-8038-34cbcdf18f60" by "_delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:33 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-347ace88-6cac-4d49-bc16-2690c684a7a4 tempest-ProjectReaderTests-75358439 None] Lock "cinder-quobyte-ca53096f-84ee-4a70-8038-34cbcdf18f60" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:33 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-347ace88-6cac-4d49-bc16-2690c684a7a4 tempest-ProjectReaderTests-75358439 None] Deleting offline snapshot ca53096f-84ee-4a70-8038-34cbcdf18f60 of volume 65768419-5517-4030-88d1-cfe4f61dbec8 {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:33:33 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-347ace88-6cac-4d49-bc16-2690c684a7a4 tempest-ProjectReaderTests-75358439 None] snapshot_file for this snap is: volume-65768419-5517-4030-88d1-cfe4f61dbec8.ca53096f-84ee-4a70-8038-34cbcdf18f60 {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:33:33 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eaa8a3b-a91d-4ab7-b925-872b12e6a18a]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:33:33 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-347ace88-6cac-4d49-bc16-2690c684a7a4 tempest-ProjectReaderTests-75358439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-65768419-5517-4030-88d1-cfe4f61dbec8.ca53096f-84ee-4a70-8038-34cbcdf18f60 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:34 devstack sudo[106973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-65768419-5517-4030-88d1-cfe4f61dbec8.ca53096f-84ee-4a70-8038-34cbcdf18f60 Aug 05 10:33:34 devstack sudo[106973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:34 devstack sudo[106968]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:34 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-88d7a339-c9e7-4262-a29b-165e28d9c141 tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-349a3669-414b-474f-bd46-96f4dca03633 1073741824" returned: 0 in 0.529s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:34 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-e36a435f-14be-473c-9f86-720cc29737a2 tempest-ProjectReaderTests-1836518789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:33:34 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-e36a435f-14be-473c-9f86-720cc29737a2 tempest-ProjectReaderTests-1836518789 None] Flow 'volume_create_manager' (23739138-0d64-44aa-bc7b-730b8df706da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:33:34 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-e36a435f-14be-473c-9f86-720cc29737a2 tempest-ProjectReaderTests-1836518789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7161b36-fa17-4570-aab1-7326be5d2338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:34 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-88d7a339-c9e7-4262-a29b-165e28d9c141 tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-349a3669-414b-474f-bd46-96f4dca03633 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:34 devstack sudo[106976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-349a3669-414b-474f-bd46-96f4dca03633 Aug 05 10:33:34 devstack sudo[106976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:34 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-e36a435f-14be-473c-9f86-720cc29737a2 tempest-ProjectReaderTests-1836518789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7161b36-fa17-4570-aab1-7326be5d2338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:33:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-268637643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18464a19-080c-4836-8367-3d1eb21f3a1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1b086e408b44e5ea0ed7bdf81eaf277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:33:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:33:34Z,use_quota=True,user_id='b9819babf0b14d119e0f77d557379f60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:34 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-e36a435f-14be-473c-9f86-720cc29737a2 tempest-ProjectReaderTests-1836518789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5348fe0c-a0ca-429d-b462-cd96d38a0412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:34 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-e36a435f-14be-473c-9f86-720cc29737a2 tempest-ProjectReaderTests-1836518789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5348fe0c-a0ca-429d-b462-cd96d38a0412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:34 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-e36a435f-14be-473c-9f86-720cc29737a2 tempest-ProjectReaderTests-1836518789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f483297c-2c93-4a28-9085-4aa1c6e4fc68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:34 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-e36a435f-14be-473c-9f86-720cc29737a2 tempest-ProjectReaderTests-1836518789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f483297c-2c93-4a28-9085-4aa1c6e4fc68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18464a19-080c-4836-8367-3d1eb21f3a1d', 'volume_name': 'volume-18464a19-080c-4836-8367-3d1eb21f3a1d', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:34 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-e36a435f-14be-473c-9f86-720cc29737a2 tempest-ProjectReaderTests-1836518789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77a9b228-b353-43a2-871d-4281051c49aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:34 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-e36a435f-14be-473c-9f86-720cc29737a2 tempest-ProjectReaderTests-1836518789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77a9b228-b353-43a2-871d-4281051c49aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:34 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-e36a435f-14be-473c-9f86-720cc29737a2 tempest-ProjectReaderTests-1836518789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6722f98-c9d4-4b3e-bd5a-82b53a655120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:34 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-e36a435f-14be-473c-9f86-720cc29737a2 tempest-ProjectReaderTests-1836518789 None] Volume 18464a19-080c-4836-8367-3d1eb21f3a1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18464a19-080c-4836-8367-3d1eb21f3a1d', 'volume_size': 1} Aug 05 10:33:34 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-e36a435f-14be-473c-9f86-720cc29737a2 tempest-ProjectReaderTests-1836518789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:34 devstack sudo[106973]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:34 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-347ace88-6cac-4d49-bc16-2690c684a7a4 tempest-ProjectReaderTests-75358439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-65768419-5517-4030-88d1-cfe4f61dbec8.ca53096f-84ee-4a70-8038-34cbcdf18f60" returned: 0 in 0.391s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:34 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-347ace88-6cac-4d49-bc16-2690c684a7a4 tempest-ProjectReaderTests-75358439 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65768419-5517-4030-88d1-cfe4f61dbec8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88613) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:33:34 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e2bfa3-09fc-4d4a-bbb2-47b0864e10d2]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:33:34 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-347ace88-6cac-4d49-bc16-2690c684a7a4 tempest-ProjectReaderTests-75358439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-65768419-5517-4030-88d1-cfe4f61dbec8 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:34 devstack sudo[106981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-65768419-5517-4030-88d1-cfe4f61dbec8 Aug 05 10:33:34 devstack sudo[106981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:34 devstack sudo[106976]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:34 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-88d7a339-c9e7-4262-a29b-165e28d9c141 tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-349a3669-414b-474f-bd46-96f4dca03633" returned: 0 in 0.259s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:34 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-88d7a339-c9e7-4262-a29b-165e28d9c141 tempest-ProjectMemberTests-188752871 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:33:34 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-88d7a339-c9e7-4262-a29b-165e28d9c141 tempest-ProjectMemberTests-188752871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:34 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-4a0ceff8-430a-4754-afa5-e16bdd09aba0 tempest-CinderUnicodeTest-319058763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.568s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:34 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-88d7a339-c9e7-4262-a29b-165e28d9c141 tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b99f4ac-0725-4019-8ef0-6f01b939a0ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-349a3669-414b-474f-bd46-96f4dca03633', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:34 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-88d7a339-c9e7-4262-a29b-165e28d9c141 tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5393f23-4f78-4bf5-9e5f-e360c15d0b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:34 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-4a0ceff8-430a-4754-afa5-e16bdd09aba0 tempest-CinderUnicodeTest-319058763 None] Creating offline snapshot 2203a29d-9b20-42d3-939b-30d023510a84 of volume 704ed8df-561e-400b-957a-13f68f53429c {{(pid=88613) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:33:34 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-88d7a339-c9e7-4262-a29b-165e28d9c141 tempest-ProjectMemberTests-188752871 None] Volume volume-349a3669-414b-474f-bd46-96f4dca03633 (349a3669-414b-474f-bd46-96f4dca03633): created successfully Aug 05 10:33:34 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-88d7a339-c9e7-4262-a29b-165e28d9c141 tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5393f23-4f78-4bf5-9e5f-e360c15d0b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:34 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-88d7a339-c9e7-4262-a29b-165e28d9c141 tempest-ProjectMemberTests-188752871 None] Flow 'volume_create_manager' (7841fb1a-c3ef-4274-a6de-ed594827ced5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:33:34 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f65532-ff9e-486b-aae5-0bcc628c800b]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:33:34 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4a0ceff8-430a-4754-afa5-e16bdd09aba0 tempest-CinderUnicodeTest-319058763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-704ed8df-561e-400b-957a-13f68f53429c {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:34 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-88d7a339-c9e7-4262-a29b-165e28d9c141 tempest-ProjectMemberTests-188752871 None] Created volume successfully. Aug 05 10:33:34 devstack sudo[106984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-704ed8df-561e-400b-957a-13f68f53429c Aug 05 10:33:34 devstack sudo[106984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:34 devstack sudo[106981]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:34 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-347ace88-6cac-4d49-bc16-2690c684a7a4 tempest-ProjectReaderTests-75358439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-65768419-5517-4030-88d1-cfe4f61dbec8" returned: 0 in 0.369s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:34 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-347ace88-6cac-4d49-bc16-2690c684a7a4 tempest-ProjectReaderTests-75358439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-65768419-5517-4030-88d1-cfe4f61dbec8.ca53096f-84ee-4a70-8038-34cbcdf18f60 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:34 devstack sudo[106989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-65768419-5517-4030-88d1-cfe4f61dbec8.ca53096f-84ee-4a70-8038-34cbcdf18f60 Aug 05 10:33:34 devstack sudo[106989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:34 devstack sudo[106984]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:34 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4a0ceff8-430a-4754-afa5-e16bdd09aba0 tempest-CinderUnicodeTest-319058763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-704ed8df-561e-400b-957a-13f68f53429c" returned: 0 in 0.386s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:34 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4a0ceff8-430a-4754-afa5-e16bdd09aba0 tempest-CinderUnicodeTest-319058763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-704ed8df-561e-400b-957a-13f68f53429c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-704ed8df-561e-400b-957a-13f68f53429c.2203a29d-9b20-42d3-939b-30d023510a84 1G {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:34 devstack sudo[106997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-704ed8df-561e-400b-957a-13f68f53429c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-704ed8df-561e-400b-957a-13f68f53429c.2203a29d-9b20-42d3-939b-30d023510a84 1G Aug 05 10:33:34 devstack sudo[106997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:35 devstack sudo[106989]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:35 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-347ace88-6cac-4d49-bc16-2690c684a7a4 tempest-ProjectReaderTests-75358439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-65768419-5517-4030-88d1-cfe4f61dbec8.ca53096f-84ee-4a70-8038-34cbcdf18f60" returned: 0 in 0.391s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:35 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-347ace88-6cac-4d49-bc16-2690c684a7a4 tempest-ProjectReaderTests-75358439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-65768419-5517-4030-88d1-cfe4f61dbec8.ca53096f-84ee-4a70-8038-34cbcdf18f60 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:35 devstack sudo[107000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-65768419-5517-4030-88d1-cfe4f61dbec8.ca53096f-84ee-4a70-8038-34cbcdf18f60 Aug 05 10:33:35 devstack sudo[107000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:35 devstack sudo[107000]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:35 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-347ace88-6cac-4d49-bc16-2690c684a7a4 tempest-ProjectReaderTests-75358439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-65768419-5517-4030-88d1-cfe4f61dbec8.ca53096f-84ee-4a70-8038-34cbcdf18f60" returned: 0 in 0.282s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:35 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-347ace88-6cac-4d49-bc16-2690c684a7a4 tempest-ProjectReaderTests-75358439 None] Lock "cinder-quobyte-ca53096f-84ee-4a70-8038-34cbcdf18f60" released by "_delete_snapshot" :: held 1.534s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:35 devstack sudo[106997]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:35 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4a0ceff8-430a-4754-afa5-e16bdd09aba0 tempest-CinderUnicodeTest-319058763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-704ed8df-561e-400b-957a-13f68f53429c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-704ed8df-561e-400b-957a-13f68f53429c.2203a29d-9b20-42d3-939b-30d023510a84 1G" returned: 0 in 0.493s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:35 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4a0ceff8-430a-4754-afa5-e16bdd09aba0 tempest-CinderUnicodeTest-319058763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-704ed8df-561e-400b-957a-13f68f53429c -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-704ed8df-561e-400b-957a-13f68f53429c.2203a29d-9b20-42d3-939b-30d023510a84 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:35 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-347ace88-6cac-4d49-bc16-2690c684a7a4 tempest-ProjectReaderTests-75358439 None] Lock "cinder-quobyte-65768419-5517-4030-88d1-cfe4f61dbec8" released by "delete_snapshot" :: held 1.575s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:35 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-f1dfce41-1073-40a0-87a7-80d40e95092d tempest-ProjectMemberTests-188752871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:35 devstack sudo[107007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-704ed8df-561e-400b-957a-13f68f53429c -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-704ed8df-561e-400b-957a-13f68f53429c.2203a29d-9b20-42d3-939b-30d023510a84 Aug 05 10:33:35 devstack sudo[107007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:35 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-347ace88-6cac-4d49-bc16-2690c684a7a4 tempest-ProjectReaderTests-75358439 None] Created reservations ['1007864e-2d45-4b55-b64d-1f1f10a48812', '55a93282-a425-4e87-8088-bc215305e84f', 'ede5d668-f495-4190-93db-ae3d5233a4fb', '5d7f0fad-f86e-4ad5-8dbe-5ae965a1b8a3'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:33:35 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-347ace88-6cac-4d49-bc16-2690c684a7a4 tempest-ProjectReaderTests-75358439 None] Delete snapshot completed successfully. Aug 05 10:33:35 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-347ace88-6cac-4d49-bc16-2690c684a7a4 tempest-ProjectReaderTests-75358439 None] Lock "cinder-ca53096f-84ee-4a70-8038-34cbcdf18f60-delete_snapshot" released by "delete_snapshot" :: held 1.728s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:35 devstack sudo[107007]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:35 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4a0ceff8-430a-4754-afa5-e16bdd09aba0 tempest-CinderUnicodeTest-319058763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-704ed8df-561e-400b-957a-13f68f53429c -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-704ed8df-561e-400b-957a-13f68f53429c.2203a29d-9b20-42d3-939b-30d023510a84" returned: 0 in 0.297s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:35 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-4a0ceff8-430a-4754-afa5-e16bdd09aba0 tempest-CinderUnicodeTest-319058763 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-704ed8df-561e-400b-957a-13f68f53429c.2203a29d-9b20-42d3-939b-30d023510a84 is being set with open permissions: ugo+rw Aug 05 10:33:35 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4a0ceff8-430a-4754-afa5-e16bdd09aba0 tempest-CinderUnicodeTest-319058763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-704ed8df-561e-400b-957a-13f68f53429c.2203a29d-9b20-42d3-939b-30d023510a84 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:35 devstack sudo[107012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-704ed8df-561e-400b-957a-13f68f53429c.2203a29d-9b20-42d3-939b-30d023510a84 Aug 05 10:33:35 devstack sudo[107012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:35 devstack sudo[107012]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:35 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4a0ceff8-430a-4754-afa5-e16bdd09aba0 tempest-CinderUnicodeTest-319058763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-704ed8df-561e-400b-957a-13f68f53429c.2203a29d-9b20-42d3-939b-30d023510a84" returned: 0 in 0.256s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:36 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4a0ceff8-430a-4754-afa5-e16bdd09aba0 tempest-CinderUnicodeTest-319058763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-704ed8df-561e-400b-957a-13f68f53429c.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:36 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-f456fa3a-6ec8-483c-98f0-ef4efafaa659 tempest-ProjectReaderTests-75358439 None] Acquiring lock "cinder-65768419-5517-4030-88d1-cfe4f61dbec8-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:36 devstack sudo[107015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-704ed8df-561e-400b-957a-13f68f53429c.info Aug 05 10:33:36 devstack sudo[107015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:36 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-f456fa3a-6ec8-483c-98f0-ef4efafaa659 tempest-ProjectReaderTests-75358439 None] Lock "cinder-65768419-5517-4030-88d1-cfe4f61dbec8-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:36 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-f456fa3a-6ec8-483c-98f0-ef4efafaa659 tempest-ProjectReaderTests-75358439 None] Acquiring lock "cinder-quobyte-65768419-5517-4030-88d1-cfe4f61dbec8" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:36 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-f456fa3a-6ec8-483c-98f0-ef4efafaa659 tempest-ProjectReaderTests-75358439 None] Lock "cinder-quobyte-65768419-5517-4030-88d1-cfe4f61dbec8" acquired by "delete_volume" :: waited 0.016s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:36 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[e29ace12-a8cc-4e69-a608-cc61eb599bae]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:33:36 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f456fa3a-6ec8-483c-98f0-ef4efafaa659 tempest-ProjectReaderTests-75358439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-65768419-5517-4030-88d1-cfe4f61dbec8 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:36 devstack sudo[107017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-65768419-5517-4030-88d1-cfe4f61dbec8 Aug 05 10:33:36 devstack sudo[107017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:36 devstack sudo[107015]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:36 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4a0ceff8-430a-4754-afa5-e16bdd09aba0 tempest-CinderUnicodeTest-319058763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-704ed8df-561e-400b-957a-13f68f53429c.info" returned: 0 in 0.277s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:36 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-4a0ceff8-430a-4754-afa5-e16bdd09aba0 tempest-CinderUnicodeTest-319058763 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-704ed8df-561e-400b-957a-13f68f53429c.info is being set with open permissions: ugo+rw Aug 05 10:33:36 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4a0ceff8-430a-4754-afa5-e16bdd09aba0 tempest-CinderUnicodeTest-319058763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-704ed8df-561e-400b-957a-13f68f53429c.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:36 devstack sudo[107020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-704ed8df-561e-400b-957a-13f68f53429c.info Aug 05 10:33:36 devstack sudo[107020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:36 devstack sudo[107017]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:36 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f456fa3a-6ec8-483c-98f0-ef4efafaa659 tempest-ProjectReaderTests-75358439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-65768419-5517-4030-88d1-cfe4f61dbec8" returned: 0 in 0.354s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:36 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f456fa3a-6ec8-483c-98f0-ef4efafaa659 tempest-ProjectReaderTests-75358439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-65768419-5517-4030-88d1-cfe4f61dbec8 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:36 devstack sudo[107025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-65768419-5517-4030-88d1-cfe4f61dbec8 Aug 05 10:33:36 devstack sudo[107025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:36 devstack sudo[107020]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:36 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4a0ceff8-430a-4754-afa5-e16bdd09aba0 tempest-CinderUnicodeTest-319058763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-704ed8df-561e-400b-957a-13f68f53429c.info" returned: 0 in 0.273s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:36 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-4a0ceff8-430a-4754-afa5-e16bdd09aba0 tempest-CinderUnicodeTest-319058763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.133s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:36 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-e36a435f-14be-473c-9f86-720cc29737a2 tempest-ProjectReaderTests-1836518789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.331s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:36 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-e36a435f-14be-473c-9f86-720cc29737a2 tempest-ProjectReaderTests-1836518789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:33:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-268637643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18464a19-080c-4836-8367-3d1eb21f3a1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1b086e408b44e5ea0ed7bdf81eaf277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:33:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:33:34Z,use_quota=True,user_id='b9819babf0b14d119e0f77d557379f60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:33:36 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-e36a435f-14be-473c-9f86-720cc29737a2 tempest-ProjectReaderTests-1836518789 None] Creating volume 18464a19-080c-4836-8367-3d1eb21f3a1d {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:33:36 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-e36a435f-14be-473c-9f86-720cc29737a2 tempest-ProjectReaderTests-1836518789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:36 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-e36a435f-14be-473c-9f86-720cc29737a2 tempest-ProjectReaderTests-1836518789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:36 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-e36a435f-14be-473c-9f86-720cc29737a2 tempest-ProjectReaderTests-1836518789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:33:36 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-e36a435f-14be-473c-9f86-720cc29737a2 tempest-ProjectReaderTests-1836518789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:33:36 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-e36a435f-14be-473c-9f86-720cc29737a2 tempest-ProjectReaderTests-1836518789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:36 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-e36a435f-14be-473c-9f86-720cc29737a2 tempest-ProjectReaderTests-1836518789 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:33:36 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-e36a435f-14be-473c-9f86-720cc29737a2 tempest-ProjectReaderTests-1836518789 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:33:36 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e36a435f-14be-473c-9f86-720cc29737a2 tempest-ProjectReaderTests-1836518789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-18464a19-080c-4836-8367-3d1eb21f3a1d 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:36 devstack sudo[107028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-18464a19-080c-4836-8367-3d1eb21f3a1d 1073741824 Aug 05 10:33:36 devstack sudo[107028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:36 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-4a0ceff8-430a-4754-afa5-e16bdd09aba0 tempest-CinderUnicodeTest-319058763 None] Create snapshot completed successfully Aug 05 10:33:36 devstack sudo[107025]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:36 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f456fa3a-6ec8-483c-98f0-ef4efafaa659 tempest-ProjectReaderTests-75358439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-65768419-5517-4030-88d1-cfe4f61dbec8" returned: 0 in 0.252s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:36 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-f456fa3a-6ec8-483c-98f0-ef4efafaa659 tempest-ProjectReaderTests-75358439 None] Lock "cinder-quobyte-65768419-5517-4030-88d1-cfe4f61dbec8" released by "delete_volume" :: held 0.672s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:36 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-f456fa3a-6ec8-483c-98f0-ef4efafaa659 tempest-ProjectReaderTests-75358439 None] Created reservations ['877ae861-0512-4091-bb44-ca450b81bf02', 'dbb7e972-b9d3-4912-9ee6-3b1dbc620945', 'b0224ee0-8da9-42a1-9ce9-3c728d7ec838', '236d1443-6ef2-4133-98fc-dc7e8ebff0e7'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:33:36 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-f456fa3a-6ec8-483c-98f0-ef4efafaa659 tempest-ProjectReaderTests-75358439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:36 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-f456fa3a-6ec8-483c-98f0-ef4efafaa659 tempest-ProjectReaderTests-75358439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:36 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-f456fa3a-6ec8-483c-98f0-ef4efafaa659 tempest-ProjectReaderTests-75358439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:33:36 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-f456fa3a-6ec8-483c-98f0-ef4efafaa659 tempest-ProjectReaderTests-75358439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:33:36 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-f456fa3a-6ec8-483c-98f0-ef4efafaa659 tempest-ProjectReaderTests-75358439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:36 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f456fa3a-6ec8-483c-98f0-ef4efafaa659 tempest-ProjectReaderTests-75358439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:36 devstack sudo[107034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:33:36 devstack sudo[107034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:37 devstack sudo[107028]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e36a435f-14be-473c-9f86-720cc29737a2 tempest-ProjectReaderTests-1836518789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-18464a19-080c-4836-8367-3d1eb21f3a1d 1073741824" returned: 0 in 0.467s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e36a435f-14be-473c-9f86-720cc29737a2 tempest-ProjectReaderTests-1836518789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-18464a19-080c-4836-8367-3d1eb21f3a1d {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:37 devstack sudo[107037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-18464a19-080c-4836-8367-3d1eb21f3a1d Aug 05 10:33:37 devstack sudo[107037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:37 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-16b10f78-6734-43ae-9c41-e8f0974b9f4f tempest-CinderUnicodeTest-319058763 None] Acquiring lock "cinder-2203a29d-9b20-42d3-939b-30d023510a84-delete_snapshot" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:37 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-16b10f78-6734-43ae-9c41-e8f0974b9f4f tempest-CinderUnicodeTest-319058763 None] Lock "cinder-2203a29d-9b20-42d3-939b-30d023510a84-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:37 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-16b10f78-6734-43ae-9c41-e8f0974b9f4f tempest-CinderUnicodeTest-319058763 None] Acquiring lock "cinder-quobyte-704ed8df-561e-400b-957a-13f68f53429c" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:37 devstack sudo[107034]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f456fa3a-6ec8-483c-98f0-ef4efafaa659 tempest-ProjectReaderTests-75358439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.331s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:37 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-f456fa3a-6ec8-483c-98f0-ef4efafaa659 tempest-ProjectReaderTests-75358439 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:33:37 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-f456fa3a-6ec8-483c-98f0-ef4efafaa659 tempest-ProjectReaderTests-75358439 None] Deleted volume successfully. Aug 05 10:33:37 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-16b10f78-6734-43ae-9c41-e8f0974b9f4f tempest-CinderUnicodeTest-319058763 None] Lock "cinder-quobyte-704ed8df-561e-400b-957a-13f68f53429c" acquired by "delete_snapshot" :: waited 0.043s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:37 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-16b10f78-6734-43ae-9c41-e8f0974b9f4f tempest-CinderUnicodeTest-319058763 None] Acquiring lock "cinder-quobyte-2203a29d-9b20-42d3-939b-30d023510a84" by "_delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:37 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-16b10f78-6734-43ae-9c41-e8f0974b9f4f tempest-CinderUnicodeTest-319058763 None] Lock "cinder-quobyte-2203a29d-9b20-42d3-939b-30d023510a84" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:37 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-16b10f78-6734-43ae-9c41-e8f0974b9f4f tempest-CinderUnicodeTest-319058763 None] Deleting offline snapshot 2203a29d-9b20-42d3-939b-30d023510a84 of volume 704ed8df-561e-400b-957a-13f68f53429c {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:33:37 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-16b10f78-6734-43ae-9c41-e8f0974b9f4f tempest-CinderUnicodeTest-319058763 None] snapshot_file for this snap is: volume-704ed8df-561e-400b-957a-13f68f53429c.2203a29d-9b20-42d3-939b-30d023510a84 {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:33:37 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-f456fa3a-6ec8-483c-98f0-ef4efafaa659 tempest-ProjectReaderTests-75358439 None] Lock "cinder-65768419-5517-4030-88d1-cfe4f61dbec8-delete_volume" released by "delete_volume" :: held 1.258s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:37 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[a11a1631-fd4a-4d0b-a6e3-52fb552a3b2d]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:33:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-16b10f78-6734-43ae-9c41-e8f0974b9f4f tempest-CinderUnicodeTest-319058763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-704ed8df-561e-400b-957a-13f68f53429c.2203a29d-9b20-42d3-939b-30d023510a84 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:37 devstack sudo[107037]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e36a435f-14be-473c-9f86-720cc29737a2 tempest-ProjectReaderTests-1836518789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-18464a19-080c-4836-8367-3d1eb21f3a1d" returned: 0 in 0.313s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:37 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-e36a435f-14be-473c-9f86-720cc29737a2 tempest-ProjectReaderTests-1836518789 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:33:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-e36a435f-14be-473c-9f86-720cc29737a2 tempest-ProjectReaderTests-1836518789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-f1dfce41-1073-40a0-87a7-80d40e95092d tempest-ProjectMemberTests-188752871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.020s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:37 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-e36a435f-14be-473c-9f86-720cc29737a2 tempest-ProjectReaderTests-1836518789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6722f98-c9d4-4b3e-bd5a-82b53a655120) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18464a19-080c-4836-8367-3d1eb21f3a1d', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:37 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-e36a435f-14be-473c-9f86-720cc29737a2 tempest-ProjectReaderTests-1836518789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52b4b651-e5c0-4614-bb49-586a84576fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:37 devstack sudo[107040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-704ed8df-561e-400b-957a-13f68f53429c.2203a29d-9b20-42d3-939b-30d023510a84 Aug 05 10:33:37 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:37 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-f1dfce41-1073-40a0-87a7-80d40e95092d tempest-ProjectMemberTests-188752871 None] Creating offline snapshot 5b83ea48-2345-4e29-b492-34e7e92c7b3f of volume 349a3669-414b-474f-bd46-96f4dca03633 {{(pid=88613) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:33:37 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-e36a435f-14be-473c-9f86-720cc29737a2 tempest-ProjectReaderTests-1836518789 None] Volume volume-18464a19-080c-4836-8367-3d1eb21f3a1d (18464a19-080c-4836-8367-3d1eb21f3a1d): created successfully Aug 05 10:33:37 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-e36a435f-14be-473c-9f86-720cc29737a2 tempest-ProjectReaderTests-1836518789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52b4b651-e5c0-4614-bb49-586a84576fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:37 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-e36a435f-14be-473c-9f86-720cc29737a2 tempest-ProjectReaderTests-1836518789 None] Flow 'volume_create_manager' (23739138-0d64-44aa-bc7b-730b8df706da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:33:37 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4258d72-ce5a-4726-b7ea-76411d35711d]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:33:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f1dfce41-1073-40a0-87a7-80d40e95092d tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-349a3669-414b-474f-bd46-96f4dca03633 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:37 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-e36a435f-14be-473c-9f86-720cc29737a2 tempest-ProjectReaderTests-1836518789 None] Created volume successfully. Aug 05 10:33:37 devstack sudo[107043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-349a3669-414b-474f-bd46-96f4dca03633 Aug 05 10:33:37 devstack sudo[107043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:37 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-16b10f78-6734-43ae-9c41-e8f0974b9f4f tempest-CinderUnicodeTest-319058763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-704ed8df-561e-400b-957a-13f68f53429c.2203a29d-9b20-42d3-939b-30d023510a84" returned: 0 in 0.451s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:37 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-16b10f78-6734-43ae-9c41-e8f0974b9f4f tempest-CinderUnicodeTest-319058763 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-704ed8df-561e-400b-957a-13f68f53429c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88613) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:33:37 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[601c7e6c-546c-4d77-b5c4-7cc2059281a9]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:33:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-16b10f78-6734-43ae-9c41-e8f0974b9f4f tempest-CinderUnicodeTest-319058763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-704ed8df-561e-400b-957a-13f68f53429c {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:37 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fcfb43f-dc5b-4f03-ad30-05b18ce07820 tempest-ProjectReaderTests-75358439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:33:37 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5fcfb43f-dc5b-4f03-ad30-05b18ce07820 tempest-ProjectReaderTests-75358439 None] Flow 'volume_create_manager' (8033d38b-3d26-4dd7-bc44-37847569c0fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:33:37 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5fcfb43f-dc5b-4f03-ad30-05b18ce07820 tempest-ProjectReaderTests-75358439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fab3682-c489-4eb9-aab4-5e1832f362ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:37 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5fcfb43f-dc5b-4f03-ad30-05b18ce07820 tempest-ProjectReaderTests-75358439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fab3682-c489-4eb9-aab4-5e1832f362ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:33:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1978250207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ead2a5d-a022-442b-bfcd-5fe3c7ed1ab3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9b5160d951e4a2a96ce9b3e8fdeea1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:33:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:33:38Z,use_quota=True,user_id='933aa00d66fc4d42adc58da2c963056c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:37 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5fcfb43f-dc5b-4f03-ad30-05b18ce07820 tempest-ProjectReaderTests-75358439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9d8f6d3-2a02-4a2d-bebf-d8abad9053db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:37 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5fcfb43f-dc5b-4f03-ad30-05b18ce07820 tempest-ProjectReaderTests-75358439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9d8f6d3-2a02-4a2d-bebf-d8abad9053db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:37 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5fcfb43f-dc5b-4f03-ad30-05b18ce07820 tempest-ProjectReaderTests-75358439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (416dbb2d-97d6-4ea7-a003-51b5b02e3b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:37 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5fcfb43f-dc5b-4f03-ad30-05b18ce07820 tempest-ProjectReaderTests-75358439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (416dbb2d-97d6-4ea7-a003-51b5b02e3b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ead2a5d-a022-442b-bfcd-5fe3c7ed1ab3', 'volume_name': 'volume-8ead2a5d-a022-442b-bfcd-5fe3c7ed1ab3', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:37 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5fcfb43f-dc5b-4f03-ad30-05b18ce07820 tempest-ProjectReaderTests-75358439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ace4b886-0696-4f52-93a2-7b3e6d6ad312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:37 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5fcfb43f-dc5b-4f03-ad30-05b18ce07820 tempest-ProjectReaderTests-75358439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ace4b886-0696-4f52-93a2-7b3e6d6ad312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:37 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5fcfb43f-dc5b-4f03-ad30-05b18ce07820 tempest-ProjectReaderTests-75358439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85bd90c3-b49c-432f-9101-f53003b7c948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:37 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-5fcfb43f-dc5b-4f03-ad30-05b18ce07820 tempest-ProjectReaderTests-75358439 None] Volume 8ead2a5d-a022-442b-bfcd-5fe3c7ed1ab3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ead2a5d-a022-442b-bfcd-5fe3c7ed1ab3', 'volume_size': 1} Aug 05 10:33:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5fcfb43f-dc5b-4f03-ad30-05b18ce07820 tempest-ProjectReaderTests-75358439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:37 devstack sudo[107043]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f1dfce41-1073-40a0-87a7-80d40e95092d tempest-ProjectMemberTests-188752871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-349a3669-414b-474f-bd46-96f4dca03633" returned: 0 in 0.438s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f1dfce41-1073-40a0-87a7-80d40e95092d tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-349a3669-414b-474f-bd46-96f4dca03633,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-349a3669-414b-474f-bd46-96f4dca03633.5b83ea48-2345-4e29-b492-34e7e92c7b3f 1G {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:37 devstack sudo[107048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-704ed8df-561e-400b-957a-13f68f53429c Aug 05 10:33:37 devstack sudo[107048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:38 devstack sudo[107053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-349a3669-414b-474f-bd46-96f4dca03633,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-349a3669-414b-474f-bd46-96f4dca03633.5b83ea48-2345-4e29-b492-34e7e92c7b3f 1G Aug 05 10:33:38 devstack sudo[107053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:38 devstack sudo[107048]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:38 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-16b10f78-6734-43ae-9c41-e8f0974b9f4f tempest-CinderUnicodeTest-319058763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-704ed8df-561e-400b-957a-13f68f53429c" returned: 0 in 0.407s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:38 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-16b10f78-6734-43ae-9c41-e8f0974b9f4f tempest-CinderUnicodeTest-319058763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-704ed8df-561e-400b-957a-13f68f53429c.2203a29d-9b20-42d3-939b-30d023510a84 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:38 devstack sudo[107061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-704ed8df-561e-400b-957a-13f68f53429c.2203a29d-9b20-42d3-939b-30d023510a84 Aug 05 10:33:38 devstack sudo[107061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:38 devstack sudo[107053]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:38 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f1dfce41-1073-40a0-87a7-80d40e95092d tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-349a3669-414b-474f-bd46-96f4dca03633,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-349a3669-414b-474f-bd46-96f4dca03633.5b83ea48-2345-4e29-b492-34e7e92c7b3f 1G" returned: 0 in 0.450s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:38 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f1dfce41-1073-40a0-87a7-80d40e95092d tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-349a3669-414b-474f-bd46-96f4dca03633 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-349a3669-414b-474f-bd46-96f4dca03633.5b83ea48-2345-4e29-b492-34e7e92c7b3f {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:38 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-a15aef22-532d-4bdf-9799-c15a30dffea8 tempest-ProjectReaderTests-1836518789 None] Acquiring lock "cinder-18464a19-080c-4836-8367-3d1eb21f3a1d-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:38 devstack sudo[107064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-349a3669-414b-474f-bd46-96f4dca03633 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-349a3669-414b-474f-bd46-96f4dca03633.5b83ea48-2345-4e29-b492-34e7e92c7b3f Aug 05 10:33:38 devstack sudo[107064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:38 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-a15aef22-532d-4bdf-9799-c15a30dffea8 tempest-ProjectReaderTests-1836518789 None] Lock "cinder-18464a19-080c-4836-8367-3d1eb21f3a1d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:38 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-a15aef22-532d-4bdf-9799-c15a30dffea8 tempest-ProjectReaderTests-1836518789 None] Acquiring lock "cinder-quobyte-18464a19-080c-4836-8367-3d1eb21f3a1d" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:38 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-a15aef22-532d-4bdf-9799-c15a30dffea8 tempest-ProjectReaderTests-1836518789 None] Lock "cinder-quobyte-18464a19-080c-4836-8367-3d1eb21f3a1d" acquired by "delete_volume" :: waited 0.028s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:38 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ddd7a1f-c8e2-4dd8-9129-8048f5102f90]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:33:38 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a15aef22-532d-4bdf-9799-c15a30dffea8 tempest-ProjectReaderTests-1836518789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-18464a19-080c-4836-8367-3d1eb21f3a1d {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:38 devstack sudo[107061]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:38 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-16b10f78-6734-43ae-9c41-e8f0974b9f4f tempest-CinderUnicodeTest-319058763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-704ed8df-561e-400b-957a-13f68f53429c.2203a29d-9b20-42d3-939b-30d023510a84" returned: 0 in 0.414s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:38 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-16b10f78-6734-43ae-9c41-e8f0974b9f4f tempest-CinderUnicodeTest-319058763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-704ed8df-561e-400b-957a-13f68f53429c.2203a29d-9b20-42d3-939b-30d023510a84 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:38 devstack sudo[107070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-704ed8df-561e-400b-957a-13f68f53429c.2203a29d-9b20-42d3-939b-30d023510a84 Aug 05 10:33:38 devstack sudo[107070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:38 devstack sudo[107069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-18464a19-080c-4836-8367-3d1eb21f3a1d Aug 05 10:33:38 devstack sudo[107069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:38 devstack sudo[107064]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:38 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f1dfce41-1073-40a0-87a7-80d40e95092d tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-349a3669-414b-474f-bd46-96f4dca03633 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-349a3669-414b-474f-bd46-96f4dca03633.5b83ea48-2345-4e29-b492-34e7e92c7b3f" returned: 0 in 0.394s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:38 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-f1dfce41-1073-40a0-87a7-80d40e95092d tempest-ProjectMemberTests-188752871 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-349a3669-414b-474f-bd46-96f4dca03633.5b83ea48-2345-4e29-b492-34e7e92c7b3f is being set with open permissions: ugo+rw Aug 05 10:33:38 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f1dfce41-1073-40a0-87a7-80d40e95092d tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-349a3669-414b-474f-bd46-96f4dca03633.5b83ea48-2345-4e29-b492-34e7e92c7b3f {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:38 devstack sudo[107076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-349a3669-414b-474f-bd46-96f4dca03633.5b83ea48-2345-4e29-b492-34e7e92c7b3f Aug 05 10:33:38 devstack sudo[107076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:38 devstack sudo[107070]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:38 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-16b10f78-6734-43ae-9c41-e8f0974b9f4f tempest-CinderUnicodeTest-319058763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-704ed8df-561e-400b-957a-13f68f53429c.2203a29d-9b20-42d3-939b-30d023510a84" returned: 0 in 0.296s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:38 devstack sudo[107069]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:39 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a15aef22-532d-4bdf-9799-c15a30dffea8 tempest-ProjectReaderTests-1836518789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-18464a19-080c-4836-8367-3d1eb21f3a1d" returned: 0 in 0.421s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:39 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a15aef22-532d-4bdf-9799-c15a30dffea8 tempest-ProjectReaderTests-1836518789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-18464a19-080c-4836-8367-3d1eb21f3a1d {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:39 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-16b10f78-6734-43ae-9c41-e8f0974b9f4f tempest-CinderUnicodeTest-319058763 None] Lock "cinder-quobyte-2203a29d-9b20-42d3-939b-30d023510a84" released by "_delete_snapshot" :: held 1.698s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:39 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-16b10f78-6734-43ae-9c41-e8f0974b9f4f tempest-CinderUnicodeTest-319058763 None] Lock "cinder-quobyte-704ed8df-561e-400b-957a-13f68f53429c" released by "delete_snapshot" :: held 1.727s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:39 devstack sudo[107082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-18464a19-080c-4836-8367-3d1eb21f3a1d Aug 05 10:33:39 devstack sudo[107082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:39 devstack sudo[107076]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:39 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-16b10f78-6734-43ae-9c41-e8f0974b9f4f tempest-CinderUnicodeTest-319058763 None] Created reservations ['70ed7c2b-ceeb-441f-9e48-468e42a289c2', 'bf786fb7-99a3-423c-8492-e21baab20c11', '4fd5a7f5-81b9-4c34-8109-570d087e01e4', 'aa2cf344-9b4f-4edc-90bc-1e923a65d866'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:33:39 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f1dfce41-1073-40a0-87a7-80d40e95092d tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-349a3669-414b-474f-bd46-96f4dca03633.5b83ea48-2345-4e29-b492-34e7e92c7b3f" returned: 0 in 0.284s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:39 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f1dfce41-1073-40a0-87a7-80d40e95092d tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-349a3669-414b-474f-bd46-96f4dca03633.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:39 devstack sudo[107085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-349a3669-414b-474f-bd46-96f4dca03633.info Aug 05 10:33:39 devstack sudo[107085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:39 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-16b10f78-6734-43ae-9c41-e8f0974b9f4f tempest-CinderUnicodeTest-319058763 None] Delete snapshot completed successfully. Aug 05 10:33:39 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-16b10f78-6734-43ae-9c41-e8f0974b9f4f tempest-CinderUnicodeTest-319058763 None] Lock "cinder-2203a29d-9b20-42d3-939b-30d023510a84-delete_snapshot" released by "delete_snapshot" :: held 1.946s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:39 devstack sudo[107082]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:39 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a15aef22-532d-4bdf-9799-c15a30dffea8 tempest-ProjectReaderTests-1836518789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-18464a19-080c-4836-8367-3d1eb21f3a1d" returned: 0 in 0.261s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:39 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-a15aef22-532d-4bdf-9799-c15a30dffea8 tempest-ProjectReaderTests-1836518789 None] Lock "cinder-quobyte-18464a19-080c-4836-8367-3d1eb21f3a1d" released by "delete_volume" :: held 0.726s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:39 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-a15aef22-532d-4bdf-9799-c15a30dffea8 tempest-ProjectReaderTests-1836518789 None] Created reservations ['a43ddefa-f5d1-4457-b9bf-fddc907e98b9', '4220c005-fbee-445d-9e8d-cd7534d21c46', '2686d48b-e922-4974-b4f8-375fdf9e8991', 'c949ea24-259b-4c53-be74-12eb68a98963'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:33:39 devstack sudo[107085]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:39 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f1dfce41-1073-40a0-87a7-80d40e95092d tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-349a3669-414b-474f-bd46-96f4dca03633.info" returned: 0 in 0.266s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:39 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-f1dfce41-1073-40a0-87a7-80d40e95092d tempest-ProjectMemberTests-188752871 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-349a3669-414b-474f-bd46-96f4dca03633.info is being set with open permissions: ugo+rw Aug 05 10:33:39 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f1dfce41-1073-40a0-87a7-80d40e95092d tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-349a3669-414b-474f-bd46-96f4dca03633.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:39 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a15aef22-532d-4bdf-9799-c15a30dffea8 tempest-ProjectReaderTests-1836518789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:39 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a15aef22-532d-4bdf-9799-c15a30dffea8 tempest-ProjectReaderTests-1836518789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:39 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-a15aef22-532d-4bdf-9799-c15a30dffea8 tempest-ProjectReaderTests-1836518789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:33:39 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-a15aef22-532d-4bdf-9799-c15a30dffea8 tempest-ProjectReaderTests-1836518789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:33:39 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a15aef22-532d-4bdf-9799-c15a30dffea8 tempest-ProjectReaderTests-1836518789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:39 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a15aef22-532d-4bdf-9799-c15a30dffea8 tempest-ProjectReaderTests-1836518789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:39 devstack sudo[107089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-349a3669-414b-474f-bd46-96f4dca03633.info Aug 05 10:33:39 devstack sudo[107089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:39 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-9e04d665-9c18-4ba9-b954-70e42b7910c1 tempest-CinderUnicodeTest-319058763 None] Acquiring lock "cinder-704ed8df-561e-400b-957a-13f68f53429c-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:39 devstack sudo[107091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:33:39 devstack sudo[107091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:39 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-9e04d665-9c18-4ba9-b954-70e42b7910c1 tempest-CinderUnicodeTest-319058763 None] Lock "cinder-704ed8df-561e-400b-957a-13f68f53429c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:39 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-9e04d665-9c18-4ba9-b954-70e42b7910c1 tempest-CinderUnicodeTest-319058763 None] Acquiring lock "cinder-quobyte-704ed8df-561e-400b-957a-13f68f53429c" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:39 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-9e04d665-9c18-4ba9-b954-70e42b7910c1 tempest-CinderUnicodeTest-319058763 None] Lock "cinder-quobyte-704ed8df-561e-400b-957a-13f68f53429c" acquired by "delete_volume" :: waited 0.025s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:39 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee86d0c1-f1d5-4f14-833c-f01fd3bbcafc]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:33:39 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9e04d665-9c18-4ba9-b954-70e42b7910c1 tempest-CinderUnicodeTest-319058763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-704ed8df-561e-400b-957a-13f68f53429c {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:39 devstack sudo[107089]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:39 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f1dfce41-1073-40a0-87a7-80d40e95092d tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-349a3669-414b-474f-bd46-96f4dca03633.info" returned: 0 in 0.300s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:39 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-f1dfce41-1073-40a0-87a7-80d40e95092d tempest-ProjectMemberTests-188752871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.266s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:39 devstack sudo[107093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-704ed8df-561e-400b-957a-13f68f53429c Aug 05 10:33:39 devstack sudo[107093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:39 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5fcfb43f-dc5b-4f03-ad30-05b18ce07820 tempest-ProjectReaderTests-75358439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.791s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:39 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-5fcfb43f-dc5b-4f03-ad30-05b18ce07820 tempest-ProjectReaderTests-75358439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:33:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1978250207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ead2a5d-a022-442b-bfcd-5fe3c7ed1ab3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9b5160d951e4a2a96ce9b3e8fdeea1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:33:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:33:38Z,use_quota=True,user_id='933aa00d66fc4d42adc58da2c963056c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:33:39 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-5fcfb43f-dc5b-4f03-ad30-05b18ce07820 tempest-ProjectReaderTests-75358439 None] Creating volume 8ead2a5d-a022-442b-bfcd-5fe3c7ed1ab3 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:33:39 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5fcfb43f-dc5b-4f03-ad30-05b18ce07820 tempest-ProjectReaderTests-75358439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:39 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5fcfb43f-dc5b-4f03-ad30-05b18ce07820 tempest-ProjectReaderTests-75358439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:39 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-5fcfb43f-dc5b-4f03-ad30-05b18ce07820 tempest-ProjectReaderTests-75358439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:33:39 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-5fcfb43f-dc5b-4f03-ad30-05b18ce07820 tempest-ProjectReaderTests-75358439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:33:39 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5fcfb43f-dc5b-4f03-ad30-05b18ce07820 tempest-ProjectReaderTests-75358439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:39 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-5fcfb43f-dc5b-4f03-ad30-05b18ce07820 tempest-ProjectReaderTests-75358439 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:33:39 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-5fcfb43f-dc5b-4f03-ad30-05b18ce07820 tempest-ProjectReaderTests-75358439 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:33:39 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5fcfb43f-dc5b-4f03-ad30-05b18ce07820 tempest-ProjectReaderTests-75358439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8ead2a5d-a022-442b-bfcd-5fe3c7ed1ab3 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:39 devstack sudo[107091]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:39 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a15aef22-532d-4bdf-9799-c15a30dffea8 tempest-ProjectReaderTests-1836518789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.380s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:39 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-a15aef22-532d-4bdf-9799-c15a30dffea8 tempest-ProjectReaderTests-1836518789 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:33:39 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-a15aef22-532d-4bdf-9799-c15a30dffea8 tempest-ProjectReaderTests-1836518789 None] Deleted volume successfully. Aug 05 10:33:39 devstack sudo[107097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8ead2a5d-a022-442b-bfcd-5fe3c7ed1ab3 1073741824 Aug 05 10:33:39 devstack sudo[107097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:39 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-f1dfce41-1073-40a0-87a7-80d40e95092d tempest-ProjectMemberTests-188752871 None] Create snapshot completed successfully Aug 05 10:33:39 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-a15aef22-532d-4bdf-9799-c15a30dffea8 tempest-ProjectReaderTests-1836518789 None] Lock "cinder-18464a19-080c-4836-8367-3d1eb21f3a1d-delete_volume" released by "delete_volume" :: held 1.384s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:40 devstack sudo[107093]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:40 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9e04d665-9c18-4ba9-b954-70e42b7910c1 tempest-CinderUnicodeTest-319058763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-704ed8df-561e-400b-957a-13f68f53429c" returned: 0 in 0.426s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:40 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9e04d665-9c18-4ba9-b954-70e42b7910c1 tempest-CinderUnicodeTest-319058763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-704ed8df-561e-400b-957a-13f68f53429c {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:40 devstack sudo[107103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-704ed8df-561e-400b-957a-13f68f53429c Aug 05 10:33:40 devstack sudo[107103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:40 devstack sudo[107097]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:40 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5fcfb43f-dc5b-4f03-ad30-05b18ce07820 tempest-ProjectReaderTests-75358439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8ead2a5d-a022-442b-bfcd-5fe3c7ed1ab3 1073741824" returned: 0 in 0.517s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:40 devstack sudo[107103]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:40 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9e04d665-9c18-4ba9-b954-70e42b7910c1 tempest-CinderUnicodeTest-319058763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-704ed8df-561e-400b-957a-13f68f53429c" returned: 0 in 0.286s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:40 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5fcfb43f-dc5b-4f03-ad30-05b18ce07820 tempest-ProjectReaderTests-75358439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8ead2a5d-a022-442b-bfcd-5fe3c7ed1ab3 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:40 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-9e04d665-9c18-4ba9-b954-70e42b7910c1 tempest-CinderUnicodeTest-319058763 None] Lock "cinder-quobyte-704ed8df-561e-400b-957a-13f68f53429c" released by "delete_volume" :: held 0.810s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:40 devstack sudo[107108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8ead2a5d-a022-442b-bfcd-5fe3c7ed1ab3 Aug 05 10:33:40 devstack sudo[107108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:40 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-9e04d665-9c18-4ba9-b954-70e42b7910c1 tempest-CinderUnicodeTest-319058763 None] Created reservations ['6efdc1fb-77b9-4c85-a1d4-277e55f9b51a', 'a794f4df-0d29-4ced-8793-0796e3558ce5', '47cbd877-edda-4c68-8658-964edda383bc', '0f4a5ebc-adc4-4b8c-a81c-03f4dde47f1a'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:33:40 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-9e04d665-9c18-4ba9-b954-70e42b7910c1 tempest-CinderUnicodeTest-319058763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:40 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-9e04d665-9c18-4ba9-b954-70e42b7910c1 tempest-CinderUnicodeTest-319058763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:40 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-9e04d665-9c18-4ba9-b954-70e42b7910c1 tempest-CinderUnicodeTest-319058763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:33:40 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-9e04d665-9c18-4ba9-b954-70e42b7910c1 tempest-CinderUnicodeTest-319058763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:33:40 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-9e04d665-9c18-4ba9-b954-70e42b7910c1 tempest-CinderUnicodeTest-319058763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:40 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9e04d665-9c18-4ba9-b954-70e42b7910c1 tempest-CinderUnicodeTest-319058763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:40 devstack sudo[107110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:33:40 devstack sudo[107110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:40 devstack sudo[107108]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:40 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-151fd725-b80a-44f6-828d-e5227a1a847d tempest-ProjectMemberTests-188752871 None] Acquiring lock "cinder-5b83ea48-2345-4e29-b492-34e7e92c7b3f-delete_snapshot" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:40 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5fcfb43f-dc5b-4f03-ad30-05b18ce07820 tempest-ProjectReaderTests-75358439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8ead2a5d-a022-442b-bfcd-5fe3c7ed1ab3" returned: 0 in 0.390s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:40 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-5fcfb43f-dc5b-4f03-ad30-05b18ce07820 tempest-ProjectReaderTests-75358439 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:33:40 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5fcfb43f-dc5b-4f03-ad30-05b18ce07820 tempest-ProjectReaderTests-75358439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:40 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-c2b1caea-79a1-47b4-a806-ef9b53668644 tempest-CinderUnicodeTest-319058763 None] Acquiring lock "cinder-46410d54-454e-4038-88e7-ce33e0809d5a-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:40 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-151fd725-b80a-44f6-828d-e5227a1a847d tempest-ProjectMemberTests-188752871 None] Lock "cinder-5b83ea48-2345-4e29-b492-34e7e92c7b3f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.083s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:40 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-151fd725-b80a-44f6-828d-e5227a1a847d tempest-ProjectMemberTests-188752871 None] Acquiring lock "cinder-quobyte-349a3669-414b-474f-bd46-96f4dca03633" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:40 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5fcfb43f-dc5b-4f03-ad30-05b18ce07820 tempest-ProjectReaderTests-75358439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85bd90c3-b49c-432f-9101-f53003b7c948) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ead2a5d-a022-442b-bfcd-5fe3c7ed1ab3', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:40 devstack sudo[107110]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:40 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5fcfb43f-dc5b-4f03-ad30-05b18ce07820 tempest-ProjectReaderTests-75358439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2d14c7b-9402-4a7b-8f9d-25b5c989cc95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:40 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9e04d665-9c18-4ba9-b954-70e42b7910c1 tempest-CinderUnicodeTest-319058763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.338s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:40 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-9e04d665-9c18-4ba9-b954-70e42b7910c1 tempest-CinderUnicodeTest-319058763 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:33:40 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-c2b1caea-79a1-47b4-a806-ef9b53668644 tempest-CinderUnicodeTest-319058763 None] Lock "cinder-46410d54-454e-4038-88e7-ce33e0809d5a-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:40 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-9e04d665-9c18-4ba9-b954-70e42b7910c1 tempest-CinderUnicodeTest-319058763 None] Deleted volume successfully. Aug 05 10:33:40 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-5fcfb43f-dc5b-4f03-ad30-05b18ce07820 tempest-ProjectReaderTests-75358439 None] Volume volume-8ead2a5d-a022-442b-bfcd-5fe3c7ed1ab3 (8ead2a5d-a022-442b-bfcd-5fe3c7ed1ab3): created successfully Aug 05 10:33:40 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5fcfb43f-dc5b-4f03-ad30-05b18ce07820 tempest-ProjectReaderTests-75358439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2d14c7b-9402-4a7b-8f9d-25b5c989cc95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:40 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-5fcfb43f-dc5b-4f03-ad30-05b18ce07820 tempest-ProjectReaderTests-75358439 None] Flow 'volume_create_manager' (8033d38b-3d26-4dd7-bc44-37847569c0fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:33:40 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-151fd725-b80a-44f6-828d-e5227a1a847d tempest-ProjectMemberTests-188752871 None] Lock "cinder-quobyte-349a3669-414b-474f-bd46-96f4dca03633" acquired by "delete_snapshot" :: waited 0.059s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:40 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-151fd725-b80a-44f6-828d-e5227a1a847d tempest-ProjectMemberTests-188752871 None] Acquiring lock "cinder-quobyte-5b83ea48-2345-4e29-b492-34e7e92c7b3f" by "_delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:40 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-5fcfb43f-dc5b-4f03-ad30-05b18ce07820 tempest-ProjectReaderTests-75358439 None] Created volume successfully. Aug 05 10:33:40 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-151fd725-b80a-44f6-828d-e5227a1a847d tempest-ProjectMemberTests-188752871 None] Lock "cinder-quobyte-5b83ea48-2345-4e29-b492-34e7e92c7b3f" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:40 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-151fd725-b80a-44f6-828d-e5227a1a847d tempest-ProjectMemberTests-188752871 None] Deleting offline snapshot 5b83ea48-2345-4e29-b492-34e7e92c7b3f of volume 349a3669-414b-474f-bd46-96f4dca03633 {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:33:40 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-151fd725-b80a-44f6-828d-e5227a1a847d tempest-ProjectMemberTests-188752871 None] snapshot_file for this snap is: volume-349a3669-414b-474f-bd46-96f4dca03633.5b83ea48-2345-4e29-b492-34e7e92c7b3f {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:33:40 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca412144-df0a-4ffd-8c5f-26946e517f7b]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:33:40 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-151fd725-b80a-44f6-828d-e5227a1a847d tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-349a3669-414b-474f-bd46-96f4dca03633.5b83ea48-2345-4e29-b492-34e7e92c7b3f {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:40 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-9e04d665-9c18-4ba9-b954-70e42b7910c1 tempest-CinderUnicodeTest-319058763 None] Lock "cinder-704ed8df-561e-400b-957a-13f68f53429c-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:40 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-c2b1caea-79a1-47b4-a806-ef9b53668644 tempest-CinderUnicodeTest-319058763 None] Acquiring lock "cinder-quobyte-46410d54-454e-4038-88e7-ce33e0809d5a" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:41 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-c2b1caea-79a1-47b4-a806-ef9b53668644 tempest-CinderUnicodeTest-319058763 None] Lock "cinder-quobyte-46410d54-454e-4038-88e7-ce33e0809d5a" acquired by "delete_volume" :: waited 0.017s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:41 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[acfd8610-fb48-49ea-b77b-b7e508757671]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:33:41 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c2b1caea-79a1-47b4-a806-ef9b53668644 tempest-CinderUnicodeTest-319058763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-46410d54-454e-4038-88e7-ce33e0809d5a {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:41 devstack sudo[107114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-349a3669-414b-474f-bd46-96f4dca03633.5b83ea48-2345-4e29-b492-34e7e92c7b3f Aug 05 10:33:41 devstack sudo[107114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:41 devstack sudo[107115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-46410d54-454e-4038-88e7-ce33e0809d5a Aug 05 10:33:41 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:41 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-f28837ba-98f4-4107-b930-310a8c7783c0 tempest-ProjectReaderTests-75358439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:41 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-f28837ba-98f4-4107-b930-310a8c7783c0 tempest-ProjectReaderTests-75358439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:41 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-f28837ba-98f4-4107-b930-310a8c7783c0 tempest-ProjectReaderTests-75358439 None] Creating offline snapshot e41c8788-8749-4d97-bfec-7520fd1875bd of volume 8ead2a5d-a022-442b-bfcd-5fe3c7ed1ab3 {{(pid=88613) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:33:41 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e2c5a79-7494-4a80-b322-bec76a451ff5]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:33:41 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f28837ba-98f4-4107-b930-310a8c7783c0 tempest-ProjectReaderTests-75358439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8ead2a5d-a022-442b-bfcd-5fe3c7ed1ab3 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:41 devstack sudo[107118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8ead2a5d-a022-442b-bfcd-5fe3c7ed1ab3 Aug 05 10:33:41 devstack sudo[107114]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:41 devstack sudo[107118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:41 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-151fd725-b80a-44f6-828d-e5227a1a847d tempest-ProjectMemberTests-188752871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-349a3669-414b-474f-bd46-96f4dca03633.5b83ea48-2345-4e29-b492-34e7e92c7b3f" returned: 0 in 0.469s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:41 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-151fd725-b80a-44f6-828d-e5227a1a847d tempest-ProjectMemberTests-188752871 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-349a3669-414b-474f-bd46-96f4dca03633(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88613) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:33:41 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[caca2b48-1bfb-448d-a5f8-b42523cc2e14]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:33:41 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-151fd725-b80a-44f6-828d-e5227a1a847d tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-349a3669-414b-474f-bd46-96f4dca03633 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:41 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:41 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c2b1caea-79a1-47b4-a806-ef9b53668644 tempest-CinderUnicodeTest-319058763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-46410d54-454e-4038-88e7-ce33e0809d5a" returned: 0 in 0.489s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:41 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c2b1caea-79a1-47b4-a806-ef9b53668644 tempest-CinderUnicodeTest-319058763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-46410d54-454e-4038-88e7-ce33e0809d5a {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:41 devstack sudo[107127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-46410d54-454e-4038-88e7-ce33e0809d5a Aug 05 10:33:41 devstack sudo[107127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:41 devstack sudo[107126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-349a3669-414b-474f-bd46-96f4dca03633 Aug 05 10:33:41 devstack sudo[107126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:41 devstack sudo[107118]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:41 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f28837ba-98f4-4107-b930-310a8c7783c0 tempest-ProjectReaderTests-75358439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8ead2a5d-a022-442b-bfcd-5fe3c7ed1ab3" returned: 0 in 0.464s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:41 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f28837ba-98f4-4107-b930-310a8c7783c0 tempest-ProjectReaderTests-75358439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8ead2a5d-a022-442b-bfcd-5fe3c7ed1ab3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8ead2a5d-a022-442b-bfcd-5fe3c7ed1ab3.e41c8788-8749-4d97-bfec-7520fd1875bd 1G {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:41 devstack sudo[107134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8ead2a5d-a022-442b-bfcd-5fe3c7ed1ab3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8ead2a5d-a022-442b-bfcd-5fe3c7ed1ab3.e41c8788-8749-4d97-bfec-7520fd1875bd 1G Aug 05 10:33:41 devstack sudo[107134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:41 devstack sudo[107127]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:41 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c2b1caea-79a1-47b4-a806-ef9b53668644 tempest-CinderUnicodeTest-319058763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-46410d54-454e-4038-88e7-ce33e0809d5a" returned: 0 in 0.311s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:41 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-c2b1caea-79a1-47b4-a806-ef9b53668644 tempest-CinderUnicodeTest-319058763 None] Lock "cinder-quobyte-46410d54-454e-4038-88e7-ce33e0809d5a" released by "delete_volume" :: held 0.859s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:41 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-c2b1caea-79a1-47b4-a806-ef9b53668644 tempest-CinderUnicodeTest-319058763 None] Created reservations ['ee46a10c-5013-4b6d-9a8d-3d7f54434689', '197ab653-6220-43e3-8692-fe73f9ed24f9', '92214035-cd51-4126-a8e8-44d224873254', 'b0d84867-5e33-480a-bb59-861bb4957500'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:33:41 devstack sudo[107126]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:41 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-151fd725-b80a-44f6-828d-e5227a1a847d tempest-ProjectMemberTests-188752871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-349a3669-414b-474f-bd46-96f4dca03633" returned: 0 in 0.470s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:41 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-151fd725-b80a-44f6-828d-e5227a1a847d tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-349a3669-414b-474f-bd46-96f4dca03633.5b83ea48-2345-4e29-b492-34e7e92c7b3f {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:41 devstack sudo[107140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-349a3669-414b-474f-bd46-96f4dca03633.5b83ea48-2345-4e29-b492-34e7e92c7b3f Aug 05 10:33:41 devstack sudo[107140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:42 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c2b1caea-79a1-47b4-a806-ef9b53668644 tempest-CinderUnicodeTest-319058763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:42 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c2b1caea-79a1-47b4-a806-ef9b53668644 tempest-CinderUnicodeTest-319058763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:42 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-c2b1caea-79a1-47b4-a806-ef9b53668644 tempest-CinderUnicodeTest-319058763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:33:42 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-c2b1caea-79a1-47b4-a806-ef9b53668644 tempest-CinderUnicodeTest-319058763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:33:42 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c2b1caea-79a1-47b4-a806-ef9b53668644 tempest-CinderUnicodeTest-319058763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:42 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c2b1caea-79a1-47b4-a806-ef9b53668644 tempest-CinderUnicodeTest-319058763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:42 devstack sudo[107144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:33:42 devstack sudo[107144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:42 devstack sudo[107134]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:42 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f28837ba-98f4-4107-b930-310a8c7783c0 tempest-ProjectReaderTests-75358439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8ead2a5d-a022-442b-bfcd-5fe3c7ed1ab3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8ead2a5d-a022-442b-bfcd-5fe3c7ed1ab3.e41c8788-8749-4d97-bfec-7520fd1875bd 1G" returned: 0 in 0.439s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:42 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f28837ba-98f4-4107-b930-310a8c7783c0 tempest-ProjectReaderTests-75358439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ead2a5d-a022-442b-bfcd-5fe3c7ed1ab3 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8ead2a5d-a022-442b-bfcd-5fe3c7ed1ab3.e41c8788-8749-4d97-bfec-7520fd1875bd {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:42 devstack sudo[107149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ead2a5d-a022-442b-bfcd-5fe3c7ed1ab3 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8ead2a5d-a022-442b-bfcd-5fe3c7ed1ab3.e41c8788-8749-4d97-bfec-7520fd1875bd Aug 05 10:33:42 devstack sudo[107149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:42 devstack sudo[107144]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:42 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c2b1caea-79a1-47b4-a806-ef9b53668644 tempest-CinderUnicodeTest-319058763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.265s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:42 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-c2b1caea-79a1-47b4-a806-ef9b53668644 tempest-CinderUnicodeTest-319058763 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:33:42 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-c2b1caea-79a1-47b4-a806-ef9b53668644 tempest-CinderUnicodeTest-319058763 None] Deleted volume successfully. Aug 05 10:33:42 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-c2b1caea-79a1-47b4-a806-ef9b53668644 tempest-CinderUnicodeTest-319058763 None] Lock "cinder-46410d54-454e-4038-88e7-ce33e0809d5a-delete_volume" released by "delete_volume" :: held 1.470s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:42 devstack sudo[107140]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:42 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-151fd725-b80a-44f6-828d-e5227a1a847d tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-349a3669-414b-474f-bd46-96f4dca03633.5b83ea48-2345-4e29-b492-34e7e92c7b3f" returned: 0 in 0.415s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:42 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-151fd725-b80a-44f6-828d-e5227a1a847d tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-349a3669-414b-474f-bd46-96f4dca03633.5b83ea48-2345-4e29-b492-34e7e92c7b3f {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:42 devstack sudo[107153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-349a3669-414b-474f-bd46-96f4dca03633.5b83ea48-2345-4e29-b492-34e7e92c7b3f Aug 05 10:33:42 devstack sudo[107153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:42 devstack sudo[107149]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:42 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f28837ba-98f4-4107-b930-310a8c7783c0 tempest-ProjectReaderTests-75358439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ead2a5d-a022-442b-bfcd-5fe3c7ed1ab3 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8ead2a5d-a022-442b-bfcd-5fe3c7ed1ab3.e41c8788-8749-4d97-bfec-7520fd1875bd" returned: 0 in 0.313s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:42 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-f28837ba-98f4-4107-b930-310a8c7783c0 tempest-ProjectReaderTests-75358439 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8ead2a5d-a022-442b-bfcd-5fe3c7ed1ab3.e41c8788-8749-4d97-bfec-7520fd1875bd is being set with open permissions: ugo+rw Aug 05 10:33:42 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f28837ba-98f4-4107-b930-310a8c7783c0 tempest-ProjectReaderTests-75358439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8ead2a5d-a022-442b-bfcd-5fe3c7ed1ab3.e41c8788-8749-4d97-bfec-7520fd1875bd {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:42 devstack sudo[107158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8ead2a5d-a022-442b-bfcd-5fe3c7ed1ab3.e41c8788-8749-4d97-bfec-7520fd1875bd Aug 05 10:33:42 devstack sudo[107158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:42 devstack sudo[107153]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:42 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-151fd725-b80a-44f6-828d-e5227a1a847d tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-349a3669-414b-474f-bd46-96f4dca03633.5b83ea48-2345-4e29-b492-34e7e92c7b3f" returned: 0 in 0.271s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:42 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-151fd725-b80a-44f6-828d-e5227a1a847d tempest-ProjectMemberTests-188752871 None] Lock "cinder-quobyte-5b83ea48-2345-4e29-b492-34e7e92c7b3f" released by "_delete_snapshot" :: held 1.754s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:42 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-151fd725-b80a-44f6-828d-e5227a1a847d tempest-ProjectMemberTests-188752871 None] Lock "cinder-quobyte-349a3669-414b-474f-bd46-96f4dca03633" released by "delete_snapshot" :: held 1.798s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:42 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-151fd725-b80a-44f6-828d-e5227a1a847d tempest-ProjectMemberTests-188752871 None] Created reservations ['5029f7de-934a-4bfb-970a-99f6bc292d60', '6db61267-eb88-4587-abbb-b8e1548b17f9', 'c91a39f6-2906-486a-9873-ae3282d95e93', '4ec42a34-5866-4a96-8b16-3ea924cef67b'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:33:42 devstack sudo[107158]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:42 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f28837ba-98f4-4107-b930-310a8c7783c0 tempest-ProjectReaderTests-75358439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8ead2a5d-a022-442b-bfcd-5fe3c7ed1ab3.e41c8788-8749-4d97-bfec-7520fd1875bd" returned: 0 in 0.263s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:42 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f28837ba-98f4-4107-b930-310a8c7783c0 tempest-ProjectReaderTests-75358439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8ead2a5d-a022-442b-bfcd-5fe3c7ed1ab3.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:42 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-151fd725-b80a-44f6-828d-e5227a1a847d tempest-ProjectMemberTests-188752871 None] Delete snapshot completed successfully. Aug 05 10:33:42 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-151fd725-b80a-44f6-828d-e5227a1a847d tempest-ProjectMemberTests-188752871 None] Lock "cinder-5b83ea48-2345-4e29-b492-34e7e92c7b3f-delete_snapshot" released by "delete_snapshot" :: held 2.005s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:42 devstack sudo[107162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8ead2a5d-a022-442b-bfcd-5fe3c7ed1ab3.info Aug 05 10:33:42 devstack sudo[107162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:42 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-212aee54-b061-45bd-8540-3af5314010f5 tempest-ProjectMemberTests-188752871 None] Acquiring lock "cinder-349a3669-414b-474f-bd46-96f4dca03633-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:42 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-212aee54-b061-45bd-8540-3af5314010f5 tempest-ProjectMemberTests-188752871 None] Lock "cinder-349a3669-414b-474f-bd46-96f4dca03633-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:43 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-212aee54-b061-45bd-8540-3af5314010f5 tempest-ProjectMemberTests-188752871 None] Acquiring lock "cinder-quobyte-349a3669-414b-474f-bd46-96f4dca03633" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:43 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-212aee54-b061-45bd-8540-3af5314010f5 tempest-ProjectMemberTests-188752871 None] Lock "cinder-quobyte-349a3669-414b-474f-bd46-96f4dca03633" acquired by "delete_volume" :: waited 0.021s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:43 devstack sudo[107162]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:43 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f28837ba-98f4-4107-b930-310a8c7783c0 tempest-ProjectReaderTests-75358439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8ead2a5d-a022-442b-bfcd-5fe3c7ed1ab3.info" returned: 0 in 0.275s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:43 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-f28837ba-98f4-4107-b930-310a8c7783c0 tempest-ProjectReaderTests-75358439 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8ead2a5d-a022-442b-bfcd-5fe3c7ed1ab3.info is being set with open permissions: ugo+rw Aug 05 10:33:43 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f28837ba-98f4-4107-b930-310a8c7783c0 tempest-ProjectReaderTests-75358439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8ead2a5d-a022-442b-bfcd-5fe3c7ed1ab3.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:43 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c90d4e-a5c9-4273-a590-4c57148ccf2e]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:33:43 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-212aee54-b061-45bd-8540-3af5314010f5 tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-349a3669-414b-474f-bd46-96f4dca03633 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:43 devstack sudo[107165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8ead2a5d-a022-442b-bfcd-5fe3c7ed1ab3.info Aug 05 10:33:43 devstack sudo[107165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:43 devstack sudo[107166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-349a3669-414b-474f-bd46-96f4dca03633 Aug 05 10:33:43 devstack sudo[107166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:43 devstack sudo[107165]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:43 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-f28837ba-98f4-4107-b930-310a8c7783c0 tempest-ProjectReaderTests-75358439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8ead2a5d-a022-442b-bfcd-5fe3c7ed1ab3.info" returned: 0 in 0.292s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:43 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-f28837ba-98f4-4107-b930-310a8c7783c0 tempest-ProjectReaderTests-75358439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.157s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:43 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-f28837ba-98f4-4107-b930-310a8c7783c0 tempest-ProjectReaderTests-75358439 None] Create snapshot completed successfully Aug 05 10:33:43 devstack sudo[107166]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:43 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-212aee54-b061-45bd-8540-3af5314010f5 tempest-ProjectMemberTests-188752871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-349a3669-414b-474f-bd46-96f4dca03633" returned: 0 in 0.468s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:43 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-212aee54-b061-45bd-8540-3af5314010f5 tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-349a3669-414b-474f-bd46-96f4dca03633 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:43 devstack sudo[107174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-349a3669-414b-474f-bd46-96f4dca03633 Aug 05 10:33:43 devstack sudo[107174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:43 devstack sudo[107174]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:43 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-212aee54-b061-45bd-8540-3af5314010f5 tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-349a3669-414b-474f-bd46-96f4dca03633" returned: 0 in 0.286s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:43 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-212aee54-b061-45bd-8540-3af5314010f5 tempest-ProjectMemberTests-188752871 None] Lock "cinder-quobyte-349a3669-414b-474f-bd46-96f4dca03633" released by "delete_volume" :: held 0.837s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:43 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-212aee54-b061-45bd-8540-3af5314010f5 tempest-ProjectMemberTests-188752871 None] Created reservations ['c6599251-2b0c-4cf9-8bec-373f1ba004cb', '5b714f61-b1d5-450c-af14-f3d199e53309', '68c71b69-3a5f-4479-8813-ea865a2f9856', 'd1447df0-d319-4ce7-b2c6-3a1110a23207'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:33:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-212aee54-b061-45bd-8540-3af5314010f5 tempest-ProjectMemberTests-188752871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-212aee54-b061-45bd-8540-3af5314010f5 tempest-ProjectMemberTests-188752871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:44 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-212aee54-b061-45bd-8540-3af5314010f5 tempest-ProjectMemberTests-188752871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:33:44 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-212aee54-b061-45bd-8540-3af5314010f5 tempest-ProjectMemberTests-188752871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:33:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-212aee54-b061-45bd-8540-3af5314010f5 tempest-ProjectMemberTests-188752871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-212aee54-b061-45bd-8540-3af5314010f5 tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:44 devstack sudo[107177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:33:44 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:44 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-212aee54-b061-45bd-8540-3af5314010f5 tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.285s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:44 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-212aee54-b061-45bd-8540-3af5314010f5 tempest-ProjectMemberTests-188752871 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:33:44 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-212aee54-b061-45bd-8540-3af5314010f5 tempest-ProjectMemberTests-188752871 None] Deleted volume successfully. Aug 05 10:33:44 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-212aee54-b061-45bd-8540-3af5314010f5 tempest-ProjectMemberTests-188752871 None] Lock "cinder-349a3669-414b-474f-bd46-96f4dca03633-delete_volume" released by "delete_volume" :: held 1.413s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:44 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e17b46f0-95ff-40e7-84f9-0a8e4bd762e8 tempest-ProjectReaderTests-75358439 None] Acquiring lock "cinder-e41c8788-8749-4d97-bfec-7520fd1875bd-delete_snapshot" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:44 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e17b46f0-95ff-40e7-84f9-0a8e4bd762e8 tempest-ProjectReaderTests-75358439 None] Lock "cinder-e41c8788-8749-4d97-bfec-7520fd1875bd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:44 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e17b46f0-95ff-40e7-84f9-0a8e4bd762e8 tempest-ProjectReaderTests-75358439 None] Acquiring lock "cinder-quobyte-8ead2a5d-a022-442b-bfcd-5fe3c7ed1ab3" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:44 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e17b46f0-95ff-40e7-84f9-0a8e4bd762e8 tempest-ProjectReaderTests-75358439 None] Lock "cinder-quobyte-8ead2a5d-a022-442b-bfcd-5fe3c7ed1ab3" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:44 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e17b46f0-95ff-40e7-84f9-0a8e4bd762e8 tempest-ProjectReaderTests-75358439 None] Acquiring lock "cinder-quobyte-e41c8788-8749-4d97-bfec-7520fd1875bd" by "_delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:44 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e17b46f0-95ff-40e7-84f9-0a8e4bd762e8 tempest-ProjectReaderTests-75358439 None] Lock "cinder-quobyte-e41c8788-8749-4d97-bfec-7520fd1875bd" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:44 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-e17b46f0-95ff-40e7-84f9-0a8e4bd762e8 tempest-ProjectReaderTests-75358439 None] Deleting offline snapshot e41c8788-8749-4d97-bfec-7520fd1875bd of volume 8ead2a5d-a022-442b-bfcd-5fe3c7ed1ab3 {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:33:44 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-e17b46f0-95ff-40e7-84f9-0a8e4bd762e8 tempest-ProjectReaderTests-75358439 None] snapshot_file for this snap is: volume-8ead2a5d-a022-442b-bfcd-5fe3c7ed1ab3.e41c8788-8749-4d97-bfec-7520fd1875bd {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:33:44 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a7cdd13-ae54-4903-9830-be604ba2ccd3]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:33:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e17b46f0-95ff-40e7-84f9-0a8e4bd762e8 tempest-ProjectReaderTests-75358439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8ead2a5d-a022-442b-bfcd-5fe3c7ed1ab3.e41c8788-8749-4d97-bfec-7520fd1875bd {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:44 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e3bce60-2c5a-4e6d-b063-93719177a211 tempest-ProjectMemberTests-188752871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:33:44 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-8e3bce60-2c5a-4e6d-b063-93719177a211 tempest-ProjectMemberTests-188752871 None] Flow 'volume_create_manager' (e89b14d8-72b6-4d63-962d-5abacd5039f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:33:44 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-8e3bce60-2c5a-4e6d-b063-93719177a211 tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21fd94d1-6006-4def-b065-06c7aca41e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:44 devstack sudo[107181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8ead2a5d-a022-442b-bfcd-5fe3c7ed1ab3.e41c8788-8749-4d97-bfec-7520fd1875bd Aug 05 10:33:44 devstack sudo[107181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:44 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-8e3bce60-2c5a-4e6d-b063-93719177a211 tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21fd94d1-6006-4def-b065-06c7aca41e4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:33:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2036644847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ec24ec2-4f2e-4b94-a6de-2e3fc24c15c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8da1a4df661e48a896791cae706d962d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:33:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:33:45Z,use_quota=True,user_id='7390514821a74358b20ac932df9a2ce2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:44 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-8e3bce60-2c5a-4e6d-b063-93719177a211 tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aef5021-fdcc-45ba-bfa4-f005e697d578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:44 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-8e3bce60-2c5a-4e6d-b063-93719177a211 tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aef5021-fdcc-45ba-bfa4-f005e697d578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:44 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-8e3bce60-2c5a-4e6d-b063-93719177a211 tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fb42265-bd8a-4e1c-a4dd-87eb70a3ee64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:44 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-8e3bce60-2c5a-4e6d-b063-93719177a211 tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fb42265-bd8a-4e1c-a4dd-87eb70a3ee64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ec24ec2-4f2e-4b94-a6de-2e3fc24c15c8', 'volume_name': 'volume-7ec24ec2-4f2e-4b94-a6de-2e3fc24c15c8', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:44 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-8e3bce60-2c5a-4e6d-b063-93719177a211 tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (528e98d4-2714-4a6d-a9e9-88f2827585d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:44 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-8e3bce60-2c5a-4e6d-b063-93719177a211 tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (528e98d4-2714-4a6d-a9e9-88f2827585d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:44 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-8e3bce60-2c5a-4e6d-b063-93719177a211 tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e7db145-8ccc-423e-a9b8-d7968036c97c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:44 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-8e3bce60-2c5a-4e6d-b063-93719177a211 tempest-ProjectMemberTests-188752871 None] Volume 7ec24ec2-4f2e-4b94-a6de-2e3fc24c15c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ec24ec2-4f2e-4b94-a6de-2e3fc24c15c8', 'volume_size': 1} Aug 05 10:33:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-8e3bce60-2c5a-4e6d-b063-93719177a211 tempest-ProjectMemberTests-188752871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-8e3bce60-2c5a-4e6d-b063-93719177a211 tempest-ProjectMemberTests-188752871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:44 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-8e3bce60-2c5a-4e6d-b063-93719177a211 tempest-ProjectMemberTests-188752871 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:33:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2036644847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ec24ec2-4f2e-4b94-a6de-2e3fc24c15c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8da1a4df661e48a896791cae706d962d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:33:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:33:45Z,use_quota=True,user_id='7390514821a74358b20ac932df9a2ce2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:33:44 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-8e3bce60-2c5a-4e6d-b063-93719177a211 tempest-ProjectMemberTests-188752871 None] Creating volume 7ec24ec2-4f2e-4b94-a6de-2e3fc24c15c8 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:33:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-8e3bce60-2c5a-4e6d-b063-93719177a211 tempest-ProjectMemberTests-188752871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-8e3bce60-2c5a-4e6d-b063-93719177a211 tempest-ProjectMemberTests-188752871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:44 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-8e3bce60-2c5a-4e6d-b063-93719177a211 tempest-ProjectMemberTests-188752871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:33:44 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-8e3bce60-2c5a-4e6d-b063-93719177a211 tempest-ProjectMemberTests-188752871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:33:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-8e3bce60-2c5a-4e6d-b063-93719177a211 tempest-ProjectMemberTests-188752871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:44 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-8e3bce60-2c5a-4e6d-b063-93719177a211 tempest-ProjectMemberTests-188752871 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:33:44 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-8e3bce60-2c5a-4e6d-b063-93719177a211 tempest-ProjectMemberTests-188752871 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:33:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-8e3bce60-2c5a-4e6d-b063-93719177a211 tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7ec24ec2-4f2e-4b94-a6de-2e3fc24c15c8 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:44 devstack sudo[107185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7ec24ec2-4f2e-4b94-a6de-2e3fc24c15c8 1073741824 Aug 05 10:33:44 devstack sudo[107185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:45 devstack sudo[107181]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:45 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e17b46f0-95ff-40e7-84f9-0a8e4bd762e8 tempest-ProjectReaderTests-75358439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8ead2a5d-a022-442b-bfcd-5fe3c7ed1ab3.e41c8788-8749-4d97-bfec-7520fd1875bd" returned: 0 in 0.480s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:45 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-e17b46f0-95ff-40e7-84f9-0a8e4bd762e8 tempest-ProjectReaderTests-75358439 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ead2a5d-a022-442b-bfcd-5fe3c7ed1ab3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88613) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:33:45 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dcee8c8-d36a-420f-ba12-640d9e6364a0]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:33:45 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e17b46f0-95ff-40e7-84f9-0a8e4bd762e8 tempest-ProjectReaderTests-75358439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8ead2a5d-a022-442b-bfcd-5fe3c7ed1ab3 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:45 devstack sudo[107193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8ead2a5d-a022-442b-bfcd-5fe3c7ed1ab3 Aug 05 10:33:45 devstack sudo[107193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:45 devstack sudo[107185]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:45 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-8e3bce60-2c5a-4e6d-b063-93719177a211 tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7ec24ec2-4f2e-4b94-a6de-2e3fc24c15c8 1073741824" returned: 0 in 0.521s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:45 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-8e3bce60-2c5a-4e6d-b063-93719177a211 tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7ec24ec2-4f2e-4b94-a6de-2e3fc24c15c8 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:45 devstack sudo[107198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7ec24ec2-4f2e-4b94-a6de-2e3fc24c15c8 Aug 05 10:33:45 devstack sudo[107198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:45 devstack sudo[107193]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:45 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e17b46f0-95ff-40e7-84f9-0a8e4bd762e8 tempest-ProjectReaderTests-75358439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8ead2a5d-a022-442b-bfcd-5fe3c7ed1ab3" returned: 0 in 0.419s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:45 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e17b46f0-95ff-40e7-84f9-0a8e4bd762e8 tempest-ProjectReaderTests-75358439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8ead2a5d-a022-442b-bfcd-5fe3c7ed1ab3.e41c8788-8749-4d97-bfec-7520fd1875bd {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:45 devstack sudo[107203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8ead2a5d-a022-442b-bfcd-5fe3c7ed1ab3.e41c8788-8749-4d97-bfec-7520fd1875bd Aug 05 10:33:45 devstack sudo[107203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:45 devstack sudo[107198]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:45 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-8e3bce60-2c5a-4e6d-b063-93719177a211 tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7ec24ec2-4f2e-4b94-a6de-2e3fc24c15c8" returned: 0 in 0.293s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:45 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-8e3bce60-2c5a-4e6d-b063-93719177a211 tempest-ProjectMemberTests-188752871 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:33:45 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-8e3bce60-2c5a-4e6d-b063-93719177a211 tempest-ProjectMemberTests-188752871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:45 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-8e3bce60-2c5a-4e6d-b063-93719177a211 tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e7db145-8ccc-423e-a9b8-d7968036c97c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ec24ec2-4f2e-4b94-a6de-2e3fc24c15c8', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:45 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-8e3bce60-2c5a-4e6d-b063-93719177a211 tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf14b17c-8b6c-4f07-a82c-35dd7dc34b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:45 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-8e3bce60-2c5a-4e6d-b063-93719177a211 tempest-ProjectMemberTests-188752871 None] Volume volume-7ec24ec2-4f2e-4b94-a6de-2e3fc24c15c8 (7ec24ec2-4f2e-4b94-a6de-2e3fc24c15c8): created successfully Aug 05 10:33:45 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-8e3bce60-2c5a-4e6d-b063-93719177a211 tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf14b17c-8b6c-4f07-a82c-35dd7dc34b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:45 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-8e3bce60-2c5a-4e6d-b063-93719177a211 tempest-ProjectMemberTests-188752871 None] Flow 'volume_create_manager' (e89b14d8-72b6-4d63-962d-5abacd5039f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:33:45 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-8e3bce60-2c5a-4e6d-b063-93719177a211 tempest-ProjectMemberTests-188752871 None] Created volume successfully. Aug 05 10:33:45 devstack sudo[107203]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:45 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e17b46f0-95ff-40e7-84f9-0a8e4bd762e8 tempest-ProjectReaderTests-75358439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8ead2a5d-a022-442b-bfcd-5fe3c7ed1ab3.e41c8788-8749-4d97-bfec-7520fd1875bd" returned: 0 in 0.396s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:45 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e17b46f0-95ff-40e7-84f9-0a8e4bd762e8 tempest-ProjectReaderTests-75358439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8ead2a5d-a022-442b-bfcd-5fe3c7ed1ab3.e41c8788-8749-4d97-bfec-7520fd1875bd {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:45 devstack sudo[107210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8ead2a5d-a022-442b-bfcd-5fe3c7ed1ab3.e41c8788-8749-4d97-bfec-7520fd1875bd Aug 05 10:33:45 devstack sudo[107210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:46 devstack sudo[107210]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e17b46f0-95ff-40e7-84f9-0a8e4bd762e8 tempest-ProjectReaderTests-75358439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8ead2a5d-a022-442b-bfcd-5fe3c7ed1ab3.e41c8788-8749-4d97-bfec-7520fd1875bd" returned: 0 in 0.280s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:46 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e17b46f0-95ff-40e7-84f9-0a8e4bd762e8 tempest-ProjectReaderTests-75358439 None] Lock "cinder-quobyte-e41c8788-8749-4d97-bfec-7520fd1875bd" released by "_delete_snapshot" :: held 1.716s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:46 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e17b46f0-95ff-40e7-84f9-0a8e4bd762e8 tempest-ProjectReaderTests-75358439 None] Lock "cinder-quobyte-8ead2a5d-a022-442b-bfcd-5fe3c7ed1ab3" released by "delete_snapshot" :: held 1.749s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:46 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-e17b46f0-95ff-40e7-84f9-0a8e4bd762e8 tempest-ProjectReaderTests-75358439 None] Created reservations ['5bfbd1e7-1aae-424c-b033-fa52ce0ba41c', '86bbcef6-b542-46c1-964d-b516ad794d9e', '4c04d0fa-03d4-4deb-ab02-db3e17ffbbb4', 'b3dcbcd1-1a28-4dbf-95d3-75d212b70aec'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:33:46 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-e17b46f0-95ff-40e7-84f9-0a8e4bd762e8 tempest-ProjectReaderTests-75358439 None] Delete snapshot completed successfully. Aug 05 10:33:46 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e17b46f0-95ff-40e7-84f9-0a8e4bd762e8 tempest-ProjectReaderTests-75358439 None] Lock "cinder-e41c8788-8749-4d97-bfec-7520fd1875bd-delete_snapshot" released by "delete_snapshot" :: held 1.886s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:46 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-5028bf5a-15cb-431b-aa31-a38127a9a044 tempest-ProjectReaderTests-75358439 None] Acquiring lock "cinder-8ead2a5d-a022-442b-bfcd-5fe3c7ed1ab3-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:46 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-5028bf5a-15cb-431b-aa31-a38127a9a044 tempest-ProjectReaderTests-75358439 None] Lock "cinder-8ead2a5d-a022-442b-bfcd-5fe3c7ed1ab3-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:46 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-5028bf5a-15cb-431b-aa31-a38127a9a044 tempest-ProjectReaderTests-75358439 None] Acquiring lock "cinder-quobyte-8ead2a5d-a022-442b-bfcd-5fe3c7ed1ab3" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:46 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-5028bf5a-15cb-431b-aa31-a38127a9a044 tempest-ProjectReaderTests-75358439 None] Lock "cinder-quobyte-8ead2a5d-a022-442b-bfcd-5fe3c7ed1ab3" acquired by "delete_volume" :: waited 0.021s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:46 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[f907ea71-cd54-4497-914d-6b31d8aca9be]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:33:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5028bf5a-15cb-431b-aa31-a38127a9a044 tempest-ProjectReaderTests-75358439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8ead2a5d-a022-442b-bfcd-5fe3c7ed1ab3 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:46 devstack sudo[107213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8ead2a5d-a022-442b-bfcd-5fe3c7ed1ab3 Aug 05 10:33:46 devstack sudo[107213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:47 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5d45e4f3-6534-41ec-9fc2-69f34dfc23b1 tempest-ProjectMemberTests-188752871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:47 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5d45e4f3-6534-41ec-9fc2-69f34dfc23b1 tempest-ProjectMemberTests-188752871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:47 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-5d45e4f3-6534-41ec-9fc2-69f34dfc23b1 tempest-ProjectMemberTests-188752871 None] Creating offline snapshot 08fc07bd-b832-458f-a0c0-3c0ced932b31 of volume 7ec24ec2-4f2e-4b94-a6de-2e3fc24c15c8 {{(pid=88613) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:33:47 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[15fdc9f5-d775-4365-b901-23819bece1d6]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:33:47 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5d45e4f3-6534-41ec-9fc2-69f34dfc23b1 tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7ec24ec2-4f2e-4b94-a6de-2e3fc24c15c8 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:47 devstack sudo[107215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7ec24ec2-4f2e-4b94-a6de-2e3fc24c15c8 Aug 05 10:33:47 devstack sudo[107215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:47 devstack sudo[107213]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:47 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5028bf5a-15cb-431b-aa31-a38127a9a044 tempest-ProjectReaderTests-75358439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8ead2a5d-a022-442b-bfcd-5fe3c7ed1ab3" returned: 0 in 0.424s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:47 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5028bf5a-15cb-431b-aa31-a38127a9a044 tempest-ProjectReaderTests-75358439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8ead2a5d-a022-442b-bfcd-5fe3c7ed1ab3 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:47 devstack sudo[107220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8ead2a5d-a022-442b-bfcd-5fe3c7ed1ab3 Aug 05 10:33:47 devstack sudo[107220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:47 devstack sudo[107215]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:47 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5d45e4f3-6534-41ec-9fc2-69f34dfc23b1 tempest-ProjectMemberTests-188752871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7ec24ec2-4f2e-4b94-a6de-2e3fc24c15c8" returned: 0 in 0.430s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:47 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5d45e4f3-6534-41ec-9fc2-69f34dfc23b1 tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7ec24ec2-4f2e-4b94-a6de-2e3fc24c15c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7ec24ec2-4f2e-4b94-a6de-2e3fc24c15c8.08fc07bd-b832-458f-a0c0-3c0ced932b31 1G {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:47 devstack sudo[107220]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:47 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5028bf5a-15cb-431b-aa31-a38127a9a044 tempest-ProjectReaderTests-75358439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8ead2a5d-a022-442b-bfcd-5fe3c7ed1ab3" returned: 0 in 0.263s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:47 devstack sudo[107226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7ec24ec2-4f2e-4b94-a6de-2e3fc24c15c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7ec24ec2-4f2e-4b94-a6de-2e3fc24c15c8.08fc07bd-b832-458f-a0c0-3c0ced932b31 1G Aug 05 10:33:47 devstack sudo[107226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:47 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-5028bf5a-15cb-431b-aa31-a38127a9a044 tempest-ProjectReaderTests-75358439 None] Lock "cinder-quobyte-8ead2a5d-a022-442b-bfcd-5fe3c7ed1ab3" released by "delete_volume" :: held 0.773s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:47 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-5028bf5a-15cb-431b-aa31-a38127a9a044 tempest-ProjectReaderTests-75358439 None] Created reservations ['326d7324-a4a5-43ae-b543-39cc953a22d5', '41190a7a-d43d-446d-9f1e-bef94565d6e2', '7beb4c42-aa1e-42e8-9b49-53f75571e554', '91f8719f-2d0b-4a38-9236-52ec8f4d1a6d'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:33:47 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5028bf5a-15cb-431b-aa31-a38127a9a044 tempest-ProjectReaderTests-75358439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:47 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5028bf5a-15cb-431b-aa31-a38127a9a044 tempest-ProjectReaderTests-75358439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:47 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-5028bf5a-15cb-431b-aa31-a38127a9a044 tempest-ProjectReaderTests-75358439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:33:47 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-5028bf5a-15cb-431b-aa31-a38127a9a044 tempest-ProjectReaderTests-75358439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:33:47 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5028bf5a-15cb-431b-aa31-a38127a9a044 tempest-ProjectReaderTests-75358439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:47 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5028bf5a-15cb-431b-aa31-a38127a9a044 tempest-ProjectReaderTests-75358439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:47 devstack sudo[107228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:33:47 devstack sudo[107228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:47 devstack sudo[107226]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:47 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5d45e4f3-6534-41ec-9fc2-69f34dfc23b1 tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7ec24ec2-4f2e-4b94-a6de-2e3fc24c15c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7ec24ec2-4f2e-4b94-a6de-2e3fc24c15c8.08fc07bd-b832-458f-a0c0-3c0ced932b31 1G" returned: 0 in 0.500s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:47 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5d45e4f3-6534-41ec-9fc2-69f34dfc23b1 tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ec24ec2-4f2e-4b94-a6de-2e3fc24c15c8 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7ec24ec2-4f2e-4b94-a6de-2e3fc24c15c8.08fc07bd-b832-458f-a0c0-3c0ced932b31 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:47 devstack sudo[107228]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:47 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5028bf5a-15cb-431b-aa31-a38127a9a044 tempest-ProjectReaderTests-75358439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.336s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:48 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-5028bf5a-15cb-431b-aa31-a38127a9a044 tempest-ProjectReaderTests-75358439 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:33:48 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-5028bf5a-15cb-431b-aa31-a38127a9a044 tempest-ProjectReaderTests-75358439 None] Deleted volume successfully. Aug 05 10:33:48 devstack sudo[107234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ec24ec2-4f2e-4b94-a6de-2e3fc24c15c8 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7ec24ec2-4f2e-4b94-a6de-2e3fc24c15c8.08fc07bd-b832-458f-a0c0-3c0ced932b31 Aug 05 10:33:48 devstack sudo[107234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:48 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-5028bf5a-15cb-431b-aa31-a38127a9a044 tempest-ProjectReaderTests-75358439 None] Lock "cinder-8ead2a5d-a022-442b-bfcd-5fe3c7ed1ab3-delete_volume" released by "delete_volume" :: held 1.373s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:48 devstack sudo[107234]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:48 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5d45e4f3-6534-41ec-9fc2-69f34dfc23b1 tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ec24ec2-4f2e-4b94-a6de-2e3fc24c15c8 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7ec24ec2-4f2e-4b94-a6de-2e3fc24c15c8.08fc07bd-b832-458f-a0c0-3c0ced932b31" returned: 0 in 0.368s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:48 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-5d45e4f3-6534-41ec-9fc2-69f34dfc23b1 tempest-ProjectMemberTests-188752871 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7ec24ec2-4f2e-4b94-a6de-2e3fc24c15c8.08fc07bd-b832-458f-a0c0-3c0ced932b31 is being set with open permissions: ugo+rw Aug 05 10:33:48 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5d45e4f3-6534-41ec-9fc2-69f34dfc23b1 tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7ec24ec2-4f2e-4b94-a6de-2e3fc24c15c8.08fc07bd-b832-458f-a0c0-3c0ced932b31 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:48 devstack sudo[107240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7ec24ec2-4f2e-4b94-a6de-2e3fc24c15c8.08fc07bd-b832-458f-a0c0-3c0ced932b31 Aug 05 10:33:48 devstack sudo[107240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:48 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-2445f754-45b6-44e8-b971-45c97e9da1e1 tempest-ProjectReaderTests-75358439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:33:48 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2445f754-45b6-44e8-b971-45c97e9da1e1 tempest-ProjectReaderTests-75358439 None] Flow 'volume_create_manager' (db641561-8b53-452f-b947-20975b1ce47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:33:48 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2445f754-45b6-44e8-b971-45c97e9da1e1 tempest-ProjectReaderTests-75358439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4c204e5-63c8-4889-a3be-81b418c71e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:48 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2445f754-45b6-44e8-b971-45c97e9da1e1 tempest-ProjectReaderTests-75358439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4c204e5-63c8-4889-a3be-81b418c71e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:33:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1588336840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=984ee01b-8adf-48db-a6ba-422650a3e2f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9b5160d951e4a2a96ce9b3e8fdeea1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:33:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:33:48Z,use_quota=True,user_id='933aa00d66fc4d42adc58da2c963056c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:48 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2445f754-45b6-44e8-b971-45c97e9da1e1 tempest-ProjectReaderTests-75358439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dd3f9db-5048-4e55-8ffc-1fc7bb35996f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:48 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2445f754-45b6-44e8-b971-45c97e9da1e1 tempest-ProjectReaderTests-75358439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dd3f9db-5048-4e55-8ffc-1fc7bb35996f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:48 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2445f754-45b6-44e8-b971-45c97e9da1e1 tempest-ProjectReaderTests-75358439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77abaea8-182a-4571-b33f-e9102f54b923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:48 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2445f754-45b6-44e8-b971-45c97e9da1e1 tempest-ProjectReaderTests-75358439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77abaea8-182a-4571-b33f-e9102f54b923) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '984ee01b-8adf-48db-a6ba-422650a3e2f7', 'volume_name': 'volume-984ee01b-8adf-48db-a6ba-422650a3e2f7', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:48 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2445f754-45b6-44e8-b971-45c97e9da1e1 tempest-ProjectReaderTests-75358439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe95b0fe-40ac-4677-89e9-38bd907ddbce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:48 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2445f754-45b6-44e8-b971-45c97e9da1e1 tempest-ProjectReaderTests-75358439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe95b0fe-40ac-4677-89e9-38bd907ddbce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:48 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2445f754-45b6-44e8-b971-45c97e9da1e1 tempest-ProjectReaderTests-75358439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b585ca0-3f69-4287-93f3-605945be7895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:48 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-2445f754-45b6-44e8-b971-45c97e9da1e1 tempest-ProjectReaderTests-75358439 None] Volume 984ee01b-8adf-48db-a6ba-422650a3e2f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-984ee01b-8adf-48db-a6ba-422650a3e2f7', 'volume_size': 1} Aug 05 10:33:48 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2445f754-45b6-44e8-b971-45c97e9da1e1 tempest-ProjectReaderTests-75358439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:48 devstack sudo[107240]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:48 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5d45e4f3-6534-41ec-9fc2-69f34dfc23b1 tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7ec24ec2-4f2e-4b94-a6de-2e3fc24c15c8.08fc07bd-b832-458f-a0c0-3c0ced932b31" returned: 0 in 0.277s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:48 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5d45e4f3-6534-41ec-9fc2-69f34dfc23b1 tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7ec24ec2-4f2e-4b94-a6de-2e3fc24c15c8.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:48 devstack sudo[107243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7ec24ec2-4f2e-4b94-a6de-2e3fc24c15c8.info Aug 05 10:33:48 devstack sudo[107243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:48 devstack sudo[107243]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:48 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5d45e4f3-6534-41ec-9fc2-69f34dfc23b1 tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7ec24ec2-4f2e-4b94-a6de-2e3fc24c15c8.info" returned: 0 in 0.298s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:48 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-5d45e4f3-6534-41ec-9fc2-69f34dfc23b1 tempest-ProjectMemberTests-188752871 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7ec24ec2-4f2e-4b94-a6de-2e3fc24c15c8.info is being set with open permissions: ugo+rw Aug 05 10:33:48 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5d45e4f3-6534-41ec-9fc2-69f34dfc23b1 tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7ec24ec2-4f2e-4b94-a6de-2e3fc24c15c8.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:48 devstack sudo[107246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7ec24ec2-4f2e-4b94-a6de-2e3fc24c15c8.info Aug 05 10:33:48 devstack sudo[107246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:49 devstack sudo[107246]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5d45e4f3-6534-41ec-9fc2-69f34dfc23b1 tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7ec24ec2-4f2e-4b94-a6de-2e3fc24c15c8.info" returned: 0 in 0.269s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5d45e4f3-6534-41ec-9fc2-69f34dfc23b1 tempest-ProjectMemberTests-188752871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.234s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2445f754-45b6-44e8-b971-45c97e9da1e1 tempest-ProjectReaderTests-75358439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.742s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:49 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-2445f754-45b6-44e8-b971-45c97e9da1e1 tempest-ProjectReaderTests-75358439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:33:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1588336840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=984ee01b-8adf-48db-a6ba-422650a3e2f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9b5160d951e4a2a96ce9b3e8fdeea1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:33:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:33:48Z,use_quota=True,user_id='933aa00d66fc4d42adc58da2c963056c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:33:49 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-2445f754-45b6-44e8-b971-45c97e9da1e1 tempest-ProjectReaderTests-75358439 None] Creating volume 984ee01b-8adf-48db-a6ba-422650a3e2f7 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:33:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2445f754-45b6-44e8-b971-45c97e9da1e1 tempest-ProjectReaderTests-75358439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2445f754-45b6-44e8-b971-45c97e9da1e1 tempest-ProjectReaderTests-75358439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:49 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-2445f754-45b6-44e8-b971-45c97e9da1e1 tempest-ProjectReaderTests-75358439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:33:49 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-2445f754-45b6-44e8-b971-45c97e9da1e1 tempest-ProjectReaderTests-75358439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:33:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2445f754-45b6-44e8-b971-45c97e9da1e1 tempest-ProjectReaderTests-75358439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:49 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-2445f754-45b6-44e8-b971-45c97e9da1e1 tempest-ProjectReaderTests-75358439 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:33:49 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-2445f754-45b6-44e8-b971-45c97e9da1e1 tempest-ProjectReaderTests-75358439 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:33:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2445f754-45b6-44e8-b971-45c97e9da1e1 tempest-ProjectReaderTests-75358439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-984ee01b-8adf-48db-a6ba-422650a3e2f7 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:49 devstack sudo[107249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-984ee01b-8adf-48db-a6ba-422650a3e2f7 1073741824 Aug 05 10:33:49 devstack sudo[107249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:49 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-5d45e4f3-6534-41ec-9fc2-69f34dfc23b1 tempest-ProjectMemberTests-188752871 None] Create snapshot completed successfully Aug 05 10:33:49 devstack sudo[107249]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2445f754-45b6-44e8-b971-45c97e9da1e1 tempest-ProjectReaderTests-75358439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-984ee01b-8adf-48db-a6ba-422650a3e2f7 1073741824" returned: 0 in 0.497s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2445f754-45b6-44e8-b971-45c97e9da1e1 tempest-ProjectReaderTests-75358439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-984ee01b-8adf-48db-a6ba-422650a3e2f7 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:49 devstack sudo[107255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-984ee01b-8adf-48db-a6ba-422650a3e2f7 Aug 05 10:33:49 devstack sudo[107255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:50 devstack sudo[107255]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2445f754-45b6-44e8-b971-45c97e9da1e1 tempest-ProjectReaderTests-75358439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-984ee01b-8adf-48db-a6ba-422650a3e2f7" returned: 0 in 0.304s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:50 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-2445f754-45b6-44e8-b971-45c97e9da1e1 tempest-ProjectReaderTests-75358439 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:33:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2445f754-45b6-44e8-b971-45c97e9da1e1 tempest-ProjectReaderTests-75358439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:50 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2445f754-45b6-44e8-b971-45c97e9da1e1 tempest-ProjectReaderTests-75358439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b585ca0-3f69-4287-93f3-605945be7895) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-984ee01b-8adf-48db-a6ba-422650a3e2f7', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:50 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2445f754-45b6-44e8-b971-45c97e9da1e1 tempest-ProjectReaderTests-75358439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15db93b9-3194-4e30-9cdd-4dedd4a28a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:50 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-2445f754-45b6-44e8-b971-45c97e9da1e1 tempest-ProjectReaderTests-75358439 None] Volume volume-984ee01b-8adf-48db-a6ba-422650a3e2f7 (984ee01b-8adf-48db-a6ba-422650a3e2f7): created successfully Aug 05 10:33:50 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2445f754-45b6-44e8-b971-45c97e9da1e1 tempest-ProjectReaderTests-75358439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15db93b9-3194-4e30-9cdd-4dedd4a28a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:50 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2445f754-45b6-44e8-b971-45c97e9da1e1 tempest-ProjectReaderTests-75358439 None] Flow 'volume_create_manager' (db641561-8b53-452f-b947-20975b1ce47d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:33:50 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-2445f754-45b6-44e8-b971-45c97e9da1e1 tempest-ProjectReaderTests-75358439 None] Created volume successfully. Aug 05 10:33:50 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-9f7aee68-9b0d-4c32-b12f-56c8a6e35d8d tempest-ProjectMemberTests-188752871 None] Acquiring lock "cinder-08fc07bd-b832-458f-a0c0-3c0ced932b31-delete_snapshot" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:50 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-9f7aee68-9b0d-4c32-b12f-56c8a6e35d8d tempest-ProjectMemberTests-188752871 None] Lock "cinder-08fc07bd-b832-458f-a0c0-3c0ced932b31-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:50 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-9f7aee68-9b0d-4c32-b12f-56c8a6e35d8d tempest-ProjectMemberTests-188752871 None] Acquiring lock "cinder-quobyte-7ec24ec2-4f2e-4b94-a6de-2e3fc24c15c8" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:50 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-9f7aee68-9b0d-4c32-b12f-56c8a6e35d8d tempest-ProjectMemberTests-188752871 None] Lock "cinder-quobyte-7ec24ec2-4f2e-4b94-a6de-2e3fc24c15c8" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:50 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-9f7aee68-9b0d-4c32-b12f-56c8a6e35d8d tempest-ProjectMemberTests-188752871 None] Acquiring lock "cinder-quobyte-08fc07bd-b832-458f-a0c0-3c0ced932b31" by "_delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:50 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-9f7aee68-9b0d-4c32-b12f-56c8a6e35d8d tempest-ProjectMemberTests-188752871 None] Lock "cinder-quobyte-08fc07bd-b832-458f-a0c0-3c0ced932b31" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:50 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-9f7aee68-9b0d-4c32-b12f-56c8a6e35d8d tempest-ProjectMemberTests-188752871 None] Deleting offline snapshot 08fc07bd-b832-458f-a0c0-3c0ced932b31 of volume 7ec24ec2-4f2e-4b94-a6de-2e3fc24c15c8 {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:33:50 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-9f7aee68-9b0d-4c32-b12f-56c8a6e35d8d tempest-ProjectMemberTests-188752871 None] snapshot_file for this snap is: volume-7ec24ec2-4f2e-4b94-a6de-2e3fc24c15c8.08fc07bd-b832-458f-a0c0-3c0ced932b31 {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:33:50 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[c88b1e91-8c47-4327-8176-10bd5a3140c6]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:33:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9f7aee68-9b0d-4c32-b12f-56c8a6e35d8d tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7ec24ec2-4f2e-4b94-a6de-2e3fc24c15c8.08fc07bd-b832-458f-a0c0-3c0ced932b31 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:50 devstack sudo[107258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7ec24ec2-4f2e-4b94-a6de-2e3fc24c15c8.08fc07bd-b832-458f-a0c0-3c0ced932b31 Aug 05 10:33:50 devstack sudo[107258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5bf45d21-9720-4bcc-ac1a-f968c0f28287 tempest-ProjectReaderTests-75358439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5bf45d21-9720-4bcc-ac1a-f968c0f28287 tempest-ProjectReaderTests-75358439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:50 devstack sudo[107258]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:50 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-5bf45d21-9720-4bcc-ac1a-f968c0f28287 tempest-ProjectReaderTests-75358439 None] Creating offline snapshot 9ef74463-2396-4bc9-a99a-bfab602e03a9 of volume 984ee01b-8adf-48db-a6ba-422650a3e2f7 {{(pid=88613) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:33:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9f7aee68-9b0d-4c32-b12f-56c8a6e35d8d tempest-ProjectMemberTests-188752871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7ec24ec2-4f2e-4b94-a6de-2e3fc24c15c8.08fc07bd-b832-458f-a0c0-3c0ced932b31" returned: 0 in 0.444s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:50 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-9f7aee68-9b0d-4c32-b12f-56c8a6e35d8d tempest-ProjectMemberTests-188752871 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ec24ec2-4f2e-4b94-a6de-2e3fc24c15c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88613) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:33:50 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[520b7f62-ce16-4e9a-8cc4-1c6ba6a5837c]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:33:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5bf45d21-9720-4bcc-ac1a-f968c0f28287 tempest-ProjectReaderTests-75358439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-984ee01b-8adf-48db-a6ba-422650a3e2f7 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:50 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[28480842-1c36-4086-89d1-706ab6932def]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:33:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9f7aee68-9b0d-4c32-b12f-56c8a6e35d8d tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7ec24ec2-4f2e-4b94-a6de-2e3fc24c15c8 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:50 devstack sudo[107263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-984ee01b-8adf-48db-a6ba-422650a3e2f7 Aug 05 10:33:50 devstack sudo[107263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:50 devstack sudo[107264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7ec24ec2-4f2e-4b94-a6de-2e3fc24c15c8 Aug 05 10:33:50 devstack sudo[107264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:51 devstack sudo[107263]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5bf45d21-9720-4bcc-ac1a-f968c0f28287 tempest-ProjectReaderTests-75358439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-984ee01b-8adf-48db-a6ba-422650a3e2f7" returned: 0 in 0.397s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5bf45d21-9720-4bcc-ac1a-f968c0f28287 tempest-ProjectReaderTests-75358439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-984ee01b-8adf-48db-a6ba-422650a3e2f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-984ee01b-8adf-48db-a6ba-422650a3e2f7.9ef74463-2396-4bc9-a99a-bfab602e03a9 1G {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:51 devstack sudo[107264]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9f7aee68-9b0d-4c32-b12f-56c8a6e35d8d tempest-ProjectMemberTests-188752871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7ec24ec2-4f2e-4b94-a6de-2e3fc24c15c8" returned: 0 in 0.396s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9f7aee68-9b0d-4c32-b12f-56c8a6e35d8d tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7ec24ec2-4f2e-4b94-a6de-2e3fc24c15c8.08fc07bd-b832-458f-a0c0-3c0ced932b31 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:51 devstack sudo[107274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-984ee01b-8adf-48db-a6ba-422650a3e2f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-984ee01b-8adf-48db-a6ba-422650a3e2f7.9ef74463-2396-4bc9-a99a-bfab602e03a9 1G Aug 05 10:33:51 devstack sudo[107274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:51 devstack sudo[107275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7ec24ec2-4f2e-4b94-a6de-2e3fc24c15c8.08fc07bd-b832-458f-a0c0-3c0ced932b31 Aug 05 10:33:51 devstack sudo[107275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:51 devstack sudo[107275]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9f7aee68-9b0d-4c32-b12f-56c8a6e35d8d tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7ec24ec2-4f2e-4b94-a6de-2e3fc24c15c8.08fc07bd-b832-458f-a0c0-3c0ced932b31" returned: 0 in 0.400s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9f7aee68-9b0d-4c32-b12f-56c8a6e35d8d tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7ec24ec2-4f2e-4b94-a6de-2e3fc24c15c8.08fc07bd-b832-458f-a0c0-3c0ced932b31 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:51 devstack sudo[107284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7ec24ec2-4f2e-4b94-a6de-2e3fc24c15c8.08fc07bd-b832-458f-a0c0-3c0ced932b31 Aug 05 10:33:51 devstack sudo[107284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:51 devstack sudo[107274]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5bf45d21-9720-4bcc-ac1a-f968c0f28287 tempest-ProjectReaderTests-75358439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-984ee01b-8adf-48db-a6ba-422650a3e2f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-984ee01b-8adf-48db-a6ba-422650a3e2f7.9ef74463-2396-4bc9-a99a-bfab602e03a9 1G" returned: 0 in 0.467s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5bf45d21-9720-4bcc-ac1a-f968c0f28287 tempest-ProjectReaderTests-75358439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-984ee01b-8adf-48db-a6ba-422650a3e2f7 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-984ee01b-8adf-48db-a6ba-422650a3e2f7.9ef74463-2396-4bc9-a99a-bfab602e03a9 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:51 devstack sudo[107286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-984ee01b-8adf-48db-a6ba-422650a3e2f7 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-984ee01b-8adf-48db-a6ba-422650a3e2f7.9ef74463-2396-4bc9-a99a-bfab602e03a9 Aug 05 10:33:51 devstack sudo[107286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:51 devstack sudo[107284]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9f7aee68-9b0d-4c32-b12f-56c8a6e35d8d tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7ec24ec2-4f2e-4b94-a6de-2e3fc24c15c8.08fc07bd-b832-458f-a0c0-3c0ced932b31" returned: 0 in 0.272s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:51 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-9f7aee68-9b0d-4c32-b12f-56c8a6e35d8d tempest-ProjectMemberTests-188752871 None] Lock "cinder-quobyte-08fc07bd-b832-458f-a0c0-3c0ced932b31" released by "_delete_snapshot" :: held 1.636s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:51 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-9f7aee68-9b0d-4c32-b12f-56c8a6e35d8d tempest-ProjectMemberTests-188752871 None] Lock "cinder-quobyte-7ec24ec2-4f2e-4b94-a6de-2e3fc24c15c8" released by "delete_snapshot" :: held 1.664s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:51 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-9f7aee68-9b0d-4c32-b12f-56c8a6e35d8d tempest-ProjectMemberTests-188752871 None] Created reservations ['2e04e3b3-4eac-42d9-9a33-df5cd7b96119', '63ba2260-ff37-4a92-b1fe-d617f216b883', '406e9d99-fdcf-4acb-8191-1ff6b6c64d59', 'd5bfff3a-b149-4697-ae78-08f6403e5ba0'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:33:51 devstack sudo[107286]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5bf45d21-9720-4bcc-ac1a-f968c0f28287 tempest-ProjectReaderTests-75358439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-984ee01b-8adf-48db-a6ba-422650a3e2f7 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-984ee01b-8adf-48db-a6ba-422650a3e2f7.9ef74463-2396-4bc9-a99a-bfab602e03a9" returned: 0 in 0.358s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:51 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-5bf45d21-9720-4bcc-ac1a-f968c0f28287 tempest-ProjectReaderTests-75358439 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-984ee01b-8adf-48db-a6ba-422650a3e2f7.9ef74463-2396-4bc9-a99a-bfab602e03a9 is being set with open permissions: ugo+rw Aug 05 10:33:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5bf45d21-9720-4bcc-ac1a-f968c0f28287 tempest-ProjectReaderTests-75358439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-984ee01b-8adf-48db-a6ba-422650a3e2f7.9ef74463-2396-4bc9-a99a-bfab602e03a9 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:52 devstack sudo[107293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-984ee01b-8adf-48db-a6ba-422650a3e2f7.9ef74463-2396-4bc9-a99a-bfab602e03a9 Aug 05 10:33:52 devstack sudo[107293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:52 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-9f7aee68-9b0d-4c32-b12f-56c8a6e35d8d tempest-ProjectMemberTests-188752871 None] Delete snapshot completed successfully. Aug 05 10:33:52 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-9f7aee68-9b0d-4c32-b12f-56c8a6e35d8d tempest-ProjectMemberTests-188752871 None] Lock "cinder-08fc07bd-b832-458f-a0c0-3c0ced932b31-delete_snapshot" released by "delete_snapshot" :: held 1.834s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:52 devstack sudo[107293]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5bf45d21-9720-4bcc-ac1a-f968c0f28287 tempest-ProjectReaderTests-75358439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-984ee01b-8adf-48db-a6ba-422650a3e2f7.9ef74463-2396-4bc9-a99a-bfab602e03a9" returned: 0 in 0.271s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5bf45d21-9720-4bcc-ac1a-f968c0f28287 tempest-ProjectReaderTests-75358439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-984ee01b-8adf-48db-a6ba-422650a3e2f7.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:52 devstack sudo[107296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-984ee01b-8adf-48db-a6ba-422650a3e2f7.info Aug 05 10:33:52 devstack sudo[107296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:52 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-6f54f544-d98b-43b0-bd05-1c2ae5d35b91 tempest-ProjectMemberTests-188752871 None] Acquiring lock "cinder-7ec24ec2-4f2e-4b94-a6de-2e3fc24c15c8-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:52 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-6f54f544-d98b-43b0-bd05-1c2ae5d35b91 tempest-ProjectMemberTests-188752871 None] Lock "cinder-7ec24ec2-4f2e-4b94-a6de-2e3fc24c15c8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:52 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-6f54f544-d98b-43b0-bd05-1c2ae5d35b91 tempest-ProjectMemberTests-188752871 None] Acquiring lock "cinder-quobyte-7ec24ec2-4f2e-4b94-a6de-2e3fc24c15c8" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:52 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-6f54f544-d98b-43b0-bd05-1c2ae5d35b91 tempest-ProjectMemberTests-188752871 None] Lock "cinder-quobyte-7ec24ec2-4f2e-4b94-a6de-2e3fc24c15c8" acquired by "delete_volume" :: waited 0.016s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:52 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[c71eb8fc-efdc-4130-a357-b08f8196216e]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:33:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6f54f544-d98b-43b0-bd05-1c2ae5d35b91 tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7ec24ec2-4f2e-4b94-a6de-2e3fc24c15c8 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:52 devstack sudo[107296]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5bf45d21-9720-4bcc-ac1a-f968c0f28287 tempest-ProjectReaderTests-75358439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-984ee01b-8adf-48db-a6ba-422650a3e2f7.info" returned: 0 in 0.296s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:52 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-5bf45d21-9720-4bcc-ac1a-f968c0f28287 tempest-ProjectReaderTests-75358439 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-984ee01b-8adf-48db-a6ba-422650a3e2f7.info is being set with open permissions: ugo+rw Aug 05 10:33:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5bf45d21-9720-4bcc-ac1a-f968c0f28287 tempest-ProjectReaderTests-75358439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-984ee01b-8adf-48db-a6ba-422650a3e2f7.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:52 devstack sudo[107300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-984ee01b-8adf-48db-a6ba-422650a3e2f7.info Aug 05 10:33:52 devstack sudo[107300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:52 devstack sudo[107299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7ec24ec2-4f2e-4b94-a6de-2e3fc24c15c8 Aug 05 10:33:52 devstack sudo[107299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:52 devstack sudo[107300]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5bf45d21-9720-4bcc-ac1a-f968c0f28287 tempest-ProjectReaderTests-75358439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-984ee01b-8adf-48db-a6ba-422650a3e2f7.info" returned: 0 in 0.285s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5bf45d21-9720-4bcc-ac1a-f968c0f28287 tempest-ProjectReaderTests-75358439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.183s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:52 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-5bf45d21-9720-4bcc-ac1a-f968c0f28287 tempest-ProjectReaderTests-75358439 None] Create snapshot completed successfully Aug 05 10:33:52 devstack sudo[107299]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6f54f544-d98b-43b0-bd05-1c2ae5d35b91 tempest-ProjectMemberTests-188752871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7ec24ec2-4f2e-4b94-a6de-2e3fc24c15c8" returned: 0 in 0.435s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6f54f544-d98b-43b0-bd05-1c2ae5d35b91 tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7ec24ec2-4f2e-4b94-a6de-2e3fc24c15c8 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:53 devstack sudo[107307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7ec24ec2-4f2e-4b94-a6de-2e3fc24c15c8 Aug 05 10:33:53 devstack sudo[107307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:53 devstack sudo[107307]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6f54f544-d98b-43b0-bd05-1c2ae5d35b91 tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-7ec24ec2-4f2e-4b94-a6de-2e3fc24c15c8" returned: 0 in 0.280s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:53 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-6f54f544-d98b-43b0-bd05-1c2ae5d35b91 tempest-ProjectMemberTests-188752871 None] Lock "cinder-quobyte-7ec24ec2-4f2e-4b94-a6de-2e3fc24c15c8" released by "delete_volume" :: held 0.784s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:53 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-6f54f544-d98b-43b0-bd05-1c2ae5d35b91 tempest-ProjectMemberTests-188752871 None] Created reservations ['fe3ae3d9-a3d8-48d4-8a28-888cdf0ea25b', 'b22df99c-3e60-4cde-a696-ce8203cf0ca1', '2116272e-6c26-4e9e-8ae0-7ac5db109498', '8065c850-f6a9-4849-ab2d-4ffb9bd734b9'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:33:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-6f54f544-d98b-43b0-bd05-1c2ae5d35b91 tempest-ProjectMemberTests-188752871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-6f54f544-d98b-43b0-bd05-1c2ae5d35b91 tempest-ProjectMemberTests-188752871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:53 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-6f54f544-d98b-43b0-bd05-1c2ae5d35b91 tempest-ProjectMemberTests-188752871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:33:53 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-6f54f544-d98b-43b0-bd05-1c2ae5d35b91 tempest-ProjectMemberTests-188752871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:33:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-6f54f544-d98b-43b0-bd05-1c2ae5d35b91 tempest-ProjectMemberTests-188752871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6f54f544-d98b-43b0-bd05-1c2ae5d35b91 tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:53 devstack sudo[107310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:33:53 devstack sudo[107310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:53 devstack sudo[107310]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6f54f544-d98b-43b0-bd05-1c2ae5d35b91 tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.272s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:53 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-6f54f544-d98b-43b0-bd05-1c2ae5d35b91 tempest-ProjectMemberTests-188752871 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:33:53 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-6f54f544-d98b-43b0-bd05-1c2ae5d35b91 tempest-ProjectMemberTests-188752871 None] Deleted volume successfully. Aug 05 10:33:53 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-6f54f544-d98b-43b0-bd05-1c2ae5d35b91 tempest-ProjectMemberTests-188752871 None] Lock "cinder-7ec24ec2-4f2e-4b94-a6de-2e3fc24c15c8-delete_volume" released by "delete_volume" :: held 1.305s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:53 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-4f89de01-5e67-45da-bf02-3f75686791a8 tempest-ProjectReaderTests-75358439 None] Acquiring lock "cinder-9ef74463-2396-4bc9-a99a-bfab602e03a9-delete_snapshot" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:53 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-4f89de01-5e67-45da-bf02-3f75686791a8 tempest-ProjectReaderTests-75358439 None] Lock "cinder-9ef74463-2396-4bc9-a99a-bfab602e03a9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:53 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-4f89de01-5e67-45da-bf02-3f75686791a8 tempest-ProjectReaderTests-75358439 None] Acquiring lock "cinder-quobyte-984ee01b-8adf-48db-a6ba-422650a3e2f7" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:53 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-4f89de01-5e67-45da-bf02-3f75686791a8 tempest-ProjectReaderTests-75358439 None] Lock "cinder-quobyte-984ee01b-8adf-48db-a6ba-422650a3e2f7" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:53 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-4f89de01-5e67-45da-bf02-3f75686791a8 tempest-ProjectReaderTests-75358439 None] Acquiring lock "cinder-quobyte-9ef74463-2396-4bc9-a99a-bfab602e03a9" by "_delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:53 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-4f89de01-5e67-45da-bf02-3f75686791a8 tempest-ProjectReaderTests-75358439 None] Lock "cinder-quobyte-9ef74463-2396-4bc9-a99a-bfab602e03a9" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:53 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-4f89de01-5e67-45da-bf02-3f75686791a8 tempest-ProjectReaderTests-75358439 None] Deleting offline snapshot 9ef74463-2396-4bc9-a99a-bfab602e03a9 of volume 984ee01b-8adf-48db-a6ba-422650a3e2f7 {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:33:53 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-4f89de01-5e67-45da-bf02-3f75686791a8 tempest-ProjectReaderTests-75358439 None] snapshot_file for this snap is: volume-984ee01b-8adf-48db-a6ba-422650a3e2f7.9ef74463-2396-4bc9-a99a-bfab602e03a9 {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:33:53 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a046f2-54fc-4833-91c5-46975fc84309]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:33:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4f89de01-5e67-45da-bf02-3f75686791a8 tempest-ProjectReaderTests-75358439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-984ee01b-8adf-48db-a6ba-422650a3e2f7.9ef74463-2396-4bc9-a99a-bfab602e03a9 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:54 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-c958bd49-ffa6-42c4-8032-8ebb76dcc9c0 tempest-ProjectMemberTests-188752871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:33:54 devstack sudo[107313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-984ee01b-8adf-48db-a6ba-422650a3e2f7.9ef74463-2396-4bc9-a99a-bfab602e03a9 Aug 05 10:33:54 devstack sudo[107313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:54 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c958bd49-ffa6-42c4-8032-8ebb76dcc9c0 tempest-ProjectMemberTests-188752871 None] Flow 'volume_create_manager' (d4698fd8-3daf-4b0e-9bcc-4e0f4235d8a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:33:54 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c958bd49-ffa6-42c4-8032-8ebb76dcc9c0 tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (706c087e-7ea2-43b9-8291-af0e44dcc0b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:54 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c958bd49-ffa6-42c4-8032-8ebb76dcc9c0 tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (706c087e-7ea2-43b9-8291-af0e44dcc0b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:33:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-673336363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f485cad-9eb2-4fbf-b343-f6b9014ccb5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8da1a4df661e48a896791cae706d962d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:33:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:33:54Z,use_quota=True,user_id='7390514821a74358b20ac932df9a2ce2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:54 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c958bd49-ffa6-42c4-8032-8ebb76dcc9c0 tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c31ed19-73d9-4a14-adc0-aa27f5a08541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:54 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c958bd49-ffa6-42c4-8032-8ebb76dcc9c0 tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c31ed19-73d9-4a14-adc0-aa27f5a08541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:54 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c958bd49-ffa6-42c4-8032-8ebb76dcc9c0 tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2426b838-e354-4b4c-a0be-450066366569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:54 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c958bd49-ffa6-42c4-8032-8ebb76dcc9c0 tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2426b838-e354-4b4c-a0be-450066366569) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f485cad-9eb2-4fbf-b343-f6b9014ccb5c', 'volume_name': 'volume-6f485cad-9eb2-4fbf-b343-f6b9014ccb5c', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:54 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c958bd49-ffa6-42c4-8032-8ebb76dcc9c0 tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e1e72ad-e861-48fa-83b5-2530b7899cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:54 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c958bd49-ffa6-42c4-8032-8ebb76dcc9c0 tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e1e72ad-e861-48fa-83b5-2530b7899cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:54 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c958bd49-ffa6-42c4-8032-8ebb76dcc9c0 tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3d9dbe3-4601-46f3-96fe-680850c95148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:54 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-c958bd49-ffa6-42c4-8032-8ebb76dcc9c0 tempest-ProjectMemberTests-188752871 None] Volume 6f485cad-9eb2-4fbf-b343-f6b9014ccb5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f485cad-9eb2-4fbf-b343-f6b9014ccb5c', 'volume_size': 1} Aug 05 10:33:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c958bd49-ffa6-42c4-8032-8ebb76dcc9c0 tempest-ProjectMemberTests-188752871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c958bd49-ffa6-42c4-8032-8ebb76dcc9c0 tempest-ProjectMemberTests-188752871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:54 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-c958bd49-ffa6-42c4-8032-8ebb76dcc9c0 tempest-ProjectMemberTests-188752871 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:33:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-673336363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f485cad-9eb2-4fbf-b343-f6b9014ccb5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8da1a4df661e48a896791cae706d962d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:33:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:33:54Z,use_quota=True,user_id='7390514821a74358b20ac932df9a2ce2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:33:54 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-c958bd49-ffa6-42c4-8032-8ebb76dcc9c0 tempest-ProjectMemberTests-188752871 None] Creating volume 6f485cad-9eb2-4fbf-b343-f6b9014ccb5c {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:33:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c958bd49-ffa6-42c4-8032-8ebb76dcc9c0 tempest-ProjectMemberTests-188752871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c958bd49-ffa6-42c4-8032-8ebb76dcc9c0 tempest-ProjectMemberTests-188752871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:54 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-c958bd49-ffa6-42c4-8032-8ebb76dcc9c0 tempest-ProjectMemberTests-188752871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:33:54 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-c958bd49-ffa6-42c4-8032-8ebb76dcc9c0 tempest-ProjectMemberTests-188752871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:33:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c958bd49-ffa6-42c4-8032-8ebb76dcc9c0 tempest-ProjectMemberTests-188752871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:54 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-c958bd49-ffa6-42c4-8032-8ebb76dcc9c0 tempest-ProjectMemberTests-188752871 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:33:54 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-c958bd49-ffa6-42c4-8032-8ebb76dcc9c0 tempest-ProjectMemberTests-188752871 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:33:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c958bd49-ffa6-42c4-8032-8ebb76dcc9c0 tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6f485cad-9eb2-4fbf-b343-f6b9014ccb5c 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:54 devstack sudo[107315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6f485cad-9eb2-4fbf-b343-f6b9014ccb5c 1073741824 Aug 05 10:33:54 devstack sudo[107315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:54 devstack sudo[107313]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4f89de01-5e67-45da-bf02-3f75686791a8 tempest-ProjectReaderTests-75358439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-984ee01b-8adf-48db-a6ba-422650a3e2f7.9ef74463-2396-4bc9-a99a-bfab602e03a9" returned: 0 in 0.360s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:54 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-4f89de01-5e67-45da-bf02-3f75686791a8 tempest-ProjectReaderTests-75358439 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-984ee01b-8adf-48db-a6ba-422650a3e2f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88613) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:33:54 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[10956c0d-9a4d-4697-8030-d41d2c5a2129]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:33:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4f89de01-5e67-45da-bf02-3f75686791a8 tempest-ProjectReaderTests-75358439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-984ee01b-8adf-48db-a6ba-422650a3e2f7 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:54 devstack sudo[107320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-984ee01b-8adf-48db-a6ba-422650a3e2f7 Aug 05 10:33:54 devstack sudo[107320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:54 devstack sudo[107315]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c958bd49-ffa6-42c4-8032-8ebb76dcc9c0 tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6f485cad-9eb2-4fbf-b343-f6b9014ccb5c 1073741824" returned: 0 in 0.488s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c958bd49-ffa6-42c4-8032-8ebb76dcc9c0 tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6f485cad-9eb2-4fbf-b343-f6b9014ccb5c {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:54 devstack sudo[107328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6f485cad-9eb2-4fbf-b343-f6b9014ccb5c Aug 05 10:33:54 devstack sudo[107328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:54 devstack sudo[107320]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4f89de01-5e67-45da-bf02-3f75686791a8 tempest-ProjectReaderTests-75358439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-984ee01b-8adf-48db-a6ba-422650a3e2f7" returned: 0 in 0.469s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4f89de01-5e67-45da-bf02-3f75686791a8 tempest-ProjectReaderTests-75358439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-984ee01b-8adf-48db-a6ba-422650a3e2f7.9ef74463-2396-4bc9-a99a-bfab602e03a9 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:54 devstack sudo[107332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-984ee01b-8adf-48db-a6ba-422650a3e2f7.9ef74463-2396-4bc9-a99a-bfab602e03a9 Aug 05 10:33:54 devstack sudo[107332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:55 devstack sudo[107328]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:55 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c958bd49-ffa6-42c4-8032-8ebb76dcc9c0 tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6f485cad-9eb2-4fbf-b343-f6b9014ccb5c" returned: 0 in 0.345s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:55 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-c958bd49-ffa6-42c4-8032-8ebb76dcc9c0 tempest-ProjectMemberTests-188752871 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:33:55 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c958bd49-ffa6-42c4-8032-8ebb76dcc9c0 tempest-ProjectMemberTests-188752871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:55 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c958bd49-ffa6-42c4-8032-8ebb76dcc9c0 tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3d9dbe3-4601-46f3-96fe-680850c95148) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f485cad-9eb2-4fbf-b343-f6b9014ccb5c', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:55 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c958bd49-ffa6-42c4-8032-8ebb76dcc9c0 tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8dbbfd8-73e1-4fe0-9bc7-60a4f21cd134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:55 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-c958bd49-ffa6-42c4-8032-8ebb76dcc9c0 tempest-ProjectMemberTests-188752871 None] Volume volume-6f485cad-9eb2-4fbf-b343-f6b9014ccb5c (6f485cad-9eb2-4fbf-b343-f6b9014ccb5c): created successfully Aug 05 10:33:55 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c958bd49-ffa6-42c4-8032-8ebb76dcc9c0 tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8dbbfd8-73e1-4fe0-9bc7-60a4f21cd134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:55 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c958bd49-ffa6-42c4-8032-8ebb76dcc9c0 tempest-ProjectMemberTests-188752871 None] Flow 'volume_create_manager' (d4698fd8-3daf-4b0e-9bcc-4e0f4235d8a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:33:55 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-c958bd49-ffa6-42c4-8032-8ebb76dcc9c0 tempest-ProjectMemberTests-188752871 None] Created volume successfully. Aug 05 10:33:55 devstack sudo[107332]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:55 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4f89de01-5e67-45da-bf02-3f75686791a8 tempest-ProjectReaderTests-75358439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-984ee01b-8adf-48db-a6ba-422650a3e2f7.9ef74463-2396-4bc9-a99a-bfab602e03a9" returned: 0 in 0.413s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:55 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4f89de01-5e67-45da-bf02-3f75686791a8 tempest-ProjectReaderTests-75358439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-984ee01b-8adf-48db-a6ba-422650a3e2f7.9ef74463-2396-4bc9-a99a-bfab602e03a9 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:55 devstack sudo[107339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-984ee01b-8adf-48db-a6ba-422650a3e2f7.9ef74463-2396-4bc9-a99a-bfab602e03a9 Aug 05 10:33:55 devstack sudo[107339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:55 devstack sudo[107339]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:55 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4f89de01-5e67-45da-bf02-3f75686791a8 tempest-ProjectReaderTests-75358439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-984ee01b-8adf-48db-a6ba-422650a3e2f7.9ef74463-2396-4bc9-a99a-bfab602e03a9" returned: 0 in 0.268s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:55 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-4f89de01-5e67-45da-bf02-3f75686791a8 tempest-ProjectReaderTests-75358439 None] Lock "cinder-quobyte-9ef74463-2396-4bc9-a99a-bfab602e03a9" released by "_delete_snapshot" :: held 1.617s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:55 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-4f89de01-5e67-45da-bf02-3f75686791a8 tempest-ProjectReaderTests-75358439 None] Lock "cinder-quobyte-984ee01b-8adf-48db-a6ba-422650a3e2f7" released by "delete_snapshot" :: held 1.646s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:55 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-4f89de01-5e67-45da-bf02-3f75686791a8 tempest-ProjectReaderTests-75358439 None] Created reservations ['d36c0bda-509f-47d6-bf03-3273c3c776a5', '53c334b4-fe13-42d0-a3e9-36d0a6839b8f', '698232e1-6618-4be1-92e8-7e43ca126f0c', '60832d4d-19c5-4598-908e-ebb46fce5521'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:33:55 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-4f89de01-5e67-45da-bf02-3f75686791a8 tempest-ProjectReaderTests-75358439 None] Delete snapshot completed successfully. Aug 05 10:33:55 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-4f89de01-5e67-45da-bf02-3f75686791a8 tempest-ProjectReaderTests-75358439 None] Lock "cinder-9ef74463-2396-4bc9-a99a-bfab602e03a9-delete_snapshot" released by "delete_snapshot" :: held 1.800s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:56 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-fd85c7d4-ccf9-411d-b338-7b57a1458ccc tempest-ProjectReaderTests-75358439 None] Acquiring lock "cinder-984ee01b-8adf-48db-a6ba-422650a3e2f7-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:56 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-fd85c7d4-ccf9-411d-b338-7b57a1458ccc tempest-ProjectReaderTests-75358439 None] Lock "cinder-984ee01b-8adf-48db-a6ba-422650a3e2f7-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:56 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-fd85c7d4-ccf9-411d-b338-7b57a1458ccc tempest-ProjectReaderTests-75358439 None] Acquiring lock "cinder-quobyte-984ee01b-8adf-48db-a6ba-422650a3e2f7" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:56 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-fd85c7d4-ccf9-411d-b338-7b57a1458ccc tempest-ProjectReaderTests-75358439 None] Lock "cinder-quobyte-984ee01b-8adf-48db-a6ba-422650a3e2f7" acquired by "delete_volume" :: waited 0.015s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:56 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5fd6cad-5490-4227-80a5-b794726f32fc]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:33:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-fd85c7d4-ccf9-411d-b338-7b57a1458ccc tempest-ProjectReaderTests-75358439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-984ee01b-8adf-48db-a6ba-422650a3e2f7 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:56 devstack sudo[107342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-984ee01b-8adf-48db-a6ba-422650a3e2f7 Aug 05 10:33:56 devstack sudo[107342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-e02cedfe-39d6-4ade-98e1-abaab9ac3d01 tempest-ProjectMemberTests-188752871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-e02cedfe-39d6-4ade-98e1-abaab9ac3d01 tempest-ProjectMemberTests-188752871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:56 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-e02cedfe-39d6-4ade-98e1-abaab9ac3d01 tempest-ProjectMemberTests-188752871 None] Creating offline snapshot 4e70a706-fbe0-4a9b-a0df-c81a7b4c5827 of volume 6f485cad-9eb2-4fbf-b343-f6b9014ccb5c {{(pid=88613) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:33:56 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[470cd4a0-a57c-4ecd-80eb-934fa66135ad]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:33:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e02cedfe-39d6-4ade-98e1-abaab9ac3d01 tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6f485cad-9eb2-4fbf-b343-f6b9014ccb5c {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:56 devstack sudo[107344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6f485cad-9eb2-4fbf-b343-f6b9014ccb5c Aug 05 10:33:56 devstack sudo[107344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:56 devstack sudo[107342]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-fd85c7d4-ccf9-411d-b338-7b57a1458ccc tempest-ProjectReaderTests-75358439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-984ee01b-8adf-48db-a6ba-422650a3e2f7" returned: 0 in 0.414s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-fd85c7d4-ccf9-411d-b338-7b57a1458ccc tempest-ProjectReaderTests-75358439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-984ee01b-8adf-48db-a6ba-422650a3e2f7 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:56 devstack sudo[107349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-984ee01b-8adf-48db-a6ba-422650a3e2f7 Aug 05 10:33:56 devstack sudo[107349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:56 devstack sudo[107344]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e02cedfe-39d6-4ade-98e1-abaab9ac3d01 tempest-ProjectMemberTests-188752871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6f485cad-9eb2-4fbf-b343-f6b9014ccb5c" returned: 0 in 0.413s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e02cedfe-39d6-4ade-98e1-abaab9ac3d01 tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6f485cad-9eb2-4fbf-b343-f6b9014ccb5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6f485cad-9eb2-4fbf-b343-f6b9014ccb5c.4e70a706-fbe0-4a9b-a0df-c81a7b4c5827 1G {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:56 devstack sudo[107354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6f485cad-9eb2-4fbf-b343-f6b9014ccb5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6f485cad-9eb2-4fbf-b343-f6b9014ccb5c.4e70a706-fbe0-4a9b-a0df-c81a7b4c5827 1G Aug 05 10:33:56 devstack sudo[107354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:56 devstack sudo[107349]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:56 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-fd85c7d4-ccf9-411d-b338-7b57a1458ccc tempest-ProjectReaderTests-75358439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-984ee01b-8adf-48db-a6ba-422650a3e2f7" returned: 0 in 0.316s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:56 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-fd85c7d4-ccf9-411d-b338-7b57a1458ccc tempest-ProjectReaderTests-75358439 None] Lock "cinder-quobyte-984ee01b-8adf-48db-a6ba-422650a3e2f7" released by "delete_volume" :: held 0.807s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:56 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-fd85c7d4-ccf9-411d-b338-7b57a1458ccc tempest-ProjectReaderTests-75358439 None] Created reservations ['fea5044d-4278-495c-b0c0-e4eef5197f04', '0a5aa6df-2e78-4c9d-a537-37173cc4591b', 'cabfd3f1-75bf-4bf3-8989-a304e401dc43', '0283ebd2-b4ec-4afd-90d4-ec3f884932db'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:33:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-fd85c7d4-ccf9-411d-b338-7b57a1458ccc tempest-ProjectReaderTests-75358439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-fd85c7d4-ccf9-411d-b338-7b57a1458ccc tempest-ProjectReaderTests-75358439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:57 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-fd85c7d4-ccf9-411d-b338-7b57a1458ccc tempest-ProjectReaderTests-75358439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:33:57 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-fd85c7d4-ccf9-411d-b338-7b57a1458ccc tempest-ProjectReaderTests-75358439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:33:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-fd85c7d4-ccf9-411d-b338-7b57a1458ccc tempest-ProjectReaderTests-75358439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-fd85c7d4-ccf9-411d-b338-7b57a1458ccc tempest-ProjectReaderTests-75358439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:57 devstack sudo[107360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:33:57 devstack sudo[107360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:57 devstack sudo[107354]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e02cedfe-39d6-4ade-98e1-abaab9ac3d01 tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6f485cad-9eb2-4fbf-b343-f6b9014ccb5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6f485cad-9eb2-4fbf-b343-f6b9014ccb5c.4e70a706-fbe0-4a9b-a0df-c81a7b4c5827 1G" returned: 0 in 0.469s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e02cedfe-39d6-4ade-98e1-abaab9ac3d01 tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f485cad-9eb2-4fbf-b343-f6b9014ccb5c -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6f485cad-9eb2-4fbf-b343-f6b9014ccb5c.4e70a706-fbe0-4a9b-a0df-c81a7b4c5827 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:57 devstack sudo[107362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f485cad-9eb2-4fbf-b343-f6b9014ccb5c -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6f485cad-9eb2-4fbf-b343-f6b9014ccb5c.4e70a706-fbe0-4a9b-a0df-c81a7b4c5827 Aug 05 10:33:57 devstack sudo[107362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:57 devstack sudo[107360]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-fd85c7d4-ccf9-411d-b338-7b57a1458ccc tempest-ProjectReaderTests-75358439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.305s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:57 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-fd85c7d4-ccf9-411d-b338-7b57a1458ccc tempest-ProjectReaderTests-75358439 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:33:57 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-fd85c7d4-ccf9-411d-b338-7b57a1458ccc tempest-ProjectReaderTests-75358439 None] Deleted volume successfully. Aug 05 10:33:57 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-fd85c7d4-ccf9-411d-b338-7b57a1458ccc tempest-ProjectReaderTests-75358439 None] Lock "cinder-984ee01b-8adf-48db-a6ba-422650a3e2f7-delete_volume" released by "delete_volume" :: held 1.359s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:57 devstack sudo[107362]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e02cedfe-39d6-4ade-98e1-abaab9ac3d01 tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f485cad-9eb2-4fbf-b343-f6b9014ccb5c -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6f485cad-9eb2-4fbf-b343-f6b9014ccb5c.4e70a706-fbe0-4a9b-a0df-c81a7b4c5827" returned: 0 in 0.370s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:57 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-e02cedfe-39d6-4ade-98e1-abaab9ac3d01 tempest-ProjectMemberTests-188752871 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6f485cad-9eb2-4fbf-b343-f6b9014ccb5c.4e70a706-fbe0-4a9b-a0df-c81a7b4c5827 is being set with open permissions: ugo+rw Aug 05 10:33:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e02cedfe-39d6-4ade-98e1-abaab9ac3d01 tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6f485cad-9eb2-4fbf-b343-f6b9014ccb5c.4e70a706-fbe0-4a9b-a0df-c81a7b4c5827 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:57 devstack sudo[107368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6f485cad-9eb2-4fbf-b343-f6b9014ccb5c.4e70a706-fbe0-4a9b-a0df-c81a7b4c5827 Aug 05 10:33:57 devstack sudo[107368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:57 devstack cinder-volume[88613]: DEBUG dbcounter [-] [88613] Writing DB stats cinder:SELECT=239,cinder:INSERT=75,cinder:UPDATE=313,cinder:DELETE=19 {{(pid=88613) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:33:57 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-eeaff495-d536-47da-83b9-bd1f81b19336 tempest-ProjectReaderTests-75358439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:33:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-eeaff495-d536-47da-83b9-bd1f81b19336 tempest-ProjectReaderTests-75358439 None] Flow 'volume_create_manager' (030f3bbd-7e26-42a8-9bbc-db555e987ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:33:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-eeaff495-d536-47da-83b9-bd1f81b19336 tempest-ProjectReaderTests-75358439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a23a68a4-05e5-409d-bef5-44885056f4cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-eeaff495-d536-47da-83b9-bd1f81b19336 tempest-ProjectReaderTests-75358439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a23a68a4-05e5-409d-bef5-44885056f4cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:33:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-837402885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aebf6ae4-8a5e-4f77-93a8-4001e16e9edd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9b5160d951e4a2a96ce9b3e8fdeea1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:33:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:33:58Z,use_quota=True,user_id='933aa00d66fc4d42adc58da2c963056c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-eeaff495-d536-47da-83b9-bd1f81b19336 tempest-ProjectReaderTests-75358439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e87d91af-e2f9-413c-89cd-65d8a79ae14a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-eeaff495-d536-47da-83b9-bd1f81b19336 tempest-ProjectReaderTests-75358439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e87d91af-e2f9-413c-89cd-65d8a79ae14a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-eeaff495-d536-47da-83b9-bd1f81b19336 tempest-ProjectReaderTests-75358439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34496386-ddc1-4ec4-bd15-bd23084eea94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-eeaff495-d536-47da-83b9-bd1f81b19336 tempest-ProjectReaderTests-75358439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34496386-ddc1-4ec4-bd15-bd23084eea94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aebf6ae4-8a5e-4f77-93a8-4001e16e9edd', 'volume_name': 'volume-aebf6ae4-8a5e-4f77-93a8-4001e16e9edd', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-eeaff495-d536-47da-83b9-bd1f81b19336 tempest-ProjectReaderTests-75358439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (759c50d8-2b10-4c19-8234-fd809b8ee834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-eeaff495-d536-47da-83b9-bd1f81b19336 tempest-ProjectReaderTests-75358439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (759c50d8-2b10-4c19-8234-fd809b8ee834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:57 devstack sudo[107368]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:57 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-eeaff495-d536-47da-83b9-bd1f81b19336 tempest-ProjectReaderTests-75358439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdc1bcbd-a656-4114-afa6-1d43437e3c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:57 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-eeaff495-d536-47da-83b9-bd1f81b19336 tempest-ProjectReaderTests-75358439 None] Volume aebf6ae4-8a5e-4f77-93a8-4001e16e9edd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aebf6ae4-8a5e-4f77-93a8-4001e16e9edd', 'volume_size': 1} Aug 05 10:33:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-eeaff495-d536-47da-83b9-bd1f81b19336 tempest-ProjectReaderTests-75358439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e02cedfe-39d6-4ade-98e1-abaab9ac3d01 tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6f485cad-9eb2-4fbf-b343-f6b9014ccb5c.4e70a706-fbe0-4a9b-a0df-c81a7b4c5827" returned: 0 in 0.307s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:57 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e02cedfe-39d6-4ade-98e1-abaab9ac3d01 tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6f485cad-9eb2-4fbf-b343-f6b9014ccb5c.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:57 devstack sudo[107371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6f485cad-9eb2-4fbf-b343-f6b9014ccb5c.info Aug 05 10:33:57 devstack sudo[107371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:58 devstack sudo[107371]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e02cedfe-39d6-4ade-98e1-abaab9ac3d01 tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6f485cad-9eb2-4fbf-b343-f6b9014ccb5c.info" returned: 0 in 0.305s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:58 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-e02cedfe-39d6-4ade-98e1-abaab9ac3d01 tempest-ProjectMemberTests-188752871 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6f485cad-9eb2-4fbf-b343-f6b9014ccb5c.info is being set with open permissions: ugo+rw Aug 05 10:33:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e02cedfe-39d6-4ade-98e1-abaab9ac3d01 tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6f485cad-9eb2-4fbf-b343-f6b9014ccb5c.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:58 devstack sudo[107375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6f485cad-9eb2-4fbf-b343-f6b9014ccb5c.info Aug 05 10:33:58 devstack sudo[107375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:58 devstack sudo[107375]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e02cedfe-39d6-4ade-98e1-abaab9ac3d01 tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6f485cad-9eb2-4fbf-b343-f6b9014ccb5c.info" returned: 0 in 0.249s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-e02cedfe-39d6-4ade-98e1-abaab9ac3d01 tempest-ProjectMemberTests-188752871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.198s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-eeaff495-d536-47da-83b9-bd1f81b19336 tempest-ProjectReaderTests-75358439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.601s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:58 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-eeaff495-d536-47da-83b9-bd1f81b19336 tempest-ProjectReaderTests-75358439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:33:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-837402885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aebf6ae4-8a5e-4f77-93a8-4001e16e9edd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9b5160d951e4a2a96ce9b3e8fdeea1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:33:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:33:58Z,use_quota=True,user_id='933aa00d66fc4d42adc58da2c963056c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:33:58 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-eeaff495-d536-47da-83b9-bd1f81b19336 tempest-ProjectReaderTests-75358439 None] Creating volume aebf6ae4-8a5e-4f77-93a8-4001e16e9edd {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:33:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-eeaff495-d536-47da-83b9-bd1f81b19336 tempest-ProjectReaderTests-75358439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-eeaff495-d536-47da-83b9-bd1f81b19336 tempest-ProjectReaderTests-75358439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:58 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-eeaff495-d536-47da-83b9-bd1f81b19336 tempest-ProjectReaderTests-75358439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:33:58 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-eeaff495-d536-47da-83b9-bd1f81b19336 tempest-ProjectReaderTests-75358439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:33:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-eeaff495-d536-47da-83b9-bd1f81b19336 tempest-ProjectReaderTests-75358439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:58 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-eeaff495-d536-47da-83b9-bd1f81b19336 tempest-ProjectReaderTests-75358439 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:33:58 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-eeaff495-d536-47da-83b9-bd1f81b19336 tempest-ProjectReaderTests-75358439 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:33:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-eeaff495-d536-47da-83b9-bd1f81b19336 tempest-ProjectReaderTests-75358439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-aebf6ae4-8a5e-4f77-93a8-4001e16e9edd 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:58 devstack sudo[107378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-aebf6ae4-8a5e-4f77-93a8-4001e16e9edd 1073741824 Aug 05 10:33:58 devstack sudo[107378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:58 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-e02cedfe-39d6-4ade-98e1-abaab9ac3d01 tempest-ProjectMemberTests-188752871 None] Create snapshot completed successfully Aug 05 10:33:58 devstack sudo[107378]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:58 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-eeaff495-d536-47da-83b9-bd1f81b19336 tempest-ProjectReaderTests-75358439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-aebf6ae4-8a5e-4f77-93a8-4001e16e9edd 1073741824" returned: 0 in 0.452s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-eeaff495-d536-47da-83b9-bd1f81b19336 tempest-ProjectReaderTests-75358439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-aebf6ae4-8a5e-4f77-93a8-4001e16e9edd {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:59 devstack sudo[107383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-aebf6ae4-8a5e-4f77-93a8-4001e16e9edd Aug 05 10:33:59 devstack sudo[107383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:59 devstack sudo[107383]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-eeaff495-d536-47da-83b9-bd1f81b19336 tempest-ProjectReaderTests-75358439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-aebf6ae4-8a5e-4f77-93a8-4001e16e9edd" returned: 0 in 0.245s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:59 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-eeaff495-d536-47da-83b9-bd1f81b19336 tempest-ProjectReaderTests-75358439 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:33:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-eeaff495-d536-47da-83b9-bd1f81b19336 tempest-ProjectReaderTests-75358439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:59 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-eeaff495-d536-47da-83b9-bd1f81b19336 tempest-ProjectReaderTests-75358439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdc1bcbd-a656-4114-afa6-1d43437e3c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aebf6ae4-8a5e-4f77-93a8-4001e16e9edd', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:59 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-eeaff495-d536-47da-83b9-bd1f81b19336 tempest-ProjectReaderTests-75358439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f99fb20e-fd12-4f92-8f8c-3c41af6dec6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:59 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-eeaff495-d536-47da-83b9-bd1f81b19336 tempest-ProjectReaderTests-75358439 None] Volume volume-aebf6ae4-8a5e-4f77-93a8-4001e16e9edd (aebf6ae4-8a5e-4f77-93a8-4001e16e9edd): created successfully Aug 05 10:33:59 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-eeaff495-d536-47da-83b9-bd1f81b19336 tempest-ProjectReaderTests-75358439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f99fb20e-fd12-4f92-8f8c-3c41af6dec6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:59 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-eeaff495-d536-47da-83b9-bd1f81b19336 tempest-ProjectReaderTests-75358439 None] Flow 'volume_create_manager' (030f3bbd-7e26-42a8-9bbc-db555e987ae8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:33:59 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-eeaff495-d536-47da-83b9-bd1f81b19336 tempest-ProjectReaderTests-75358439 None] Created volume successfully. Aug 05 10:33:59 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-cbe6fea5-1368-4912-a051-614425905237 tempest-ProjectMemberTests-188752871 None] Acquiring lock "cinder-4e70a706-fbe0-4a9b-a0df-c81a7b4c5827-delete_snapshot" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:59 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-cbe6fea5-1368-4912-a051-614425905237 tempest-ProjectMemberTests-188752871 None] Lock "cinder-4e70a706-fbe0-4a9b-a0df-c81a7b4c5827-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:59 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-cbe6fea5-1368-4912-a051-614425905237 tempest-ProjectMemberTests-188752871 None] Acquiring lock "cinder-quobyte-6f485cad-9eb2-4fbf-b343-f6b9014ccb5c" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:59 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-cbe6fea5-1368-4912-a051-614425905237 tempest-ProjectMemberTests-188752871 None] Lock "cinder-quobyte-6f485cad-9eb2-4fbf-b343-f6b9014ccb5c" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:59 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-cbe6fea5-1368-4912-a051-614425905237 tempest-ProjectMemberTests-188752871 None] Acquiring lock "cinder-quobyte-4e70a706-fbe0-4a9b-a0df-c81a7b4c5827" by "_delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:59 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-cbe6fea5-1368-4912-a051-614425905237 tempest-ProjectMemberTests-188752871 None] Lock "cinder-quobyte-4e70a706-fbe0-4a9b-a0df-c81a7b4c5827" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:59 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-cbe6fea5-1368-4912-a051-614425905237 tempest-ProjectMemberTests-188752871 None] Deleting offline snapshot 4e70a706-fbe0-4a9b-a0df-c81a7b4c5827 of volume 6f485cad-9eb2-4fbf-b343-f6b9014ccb5c {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:33:59 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-cbe6fea5-1368-4912-a051-614425905237 tempest-ProjectMemberTests-188752871 None] snapshot_file for this snap is: volume-6f485cad-9eb2-4fbf-b343-f6b9014ccb5c.4e70a706-fbe0-4a9b-a0df-c81a7b4c5827 {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:33:59 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b512a73-c6a4-4bb2-8111-714fe6536341]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:33:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-cbe6fea5-1368-4912-a051-614425905237 tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6f485cad-9eb2-4fbf-b343-f6b9014ccb5c.4e70a706-fbe0-4a9b-a0df-c81a7b4c5827 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:59 devstack sudo[107386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6f485cad-9eb2-4fbf-b343-f6b9014ccb5c.4e70a706-fbe0-4a9b-a0df-c81a7b4c5827 Aug 05 10:33:59 devstack sudo[107386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:59 devstack sudo[107386]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-cbe6fea5-1368-4912-a051-614425905237 tempest-ProjectMemberTests-188752871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6f485cad-9eb2-4fbf-b343-f6b9014ccb5c.4e70a706-fbe0-4a9b-a0df-c81a7b4c5827" returned: 0 in 0.399s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:59 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-cbe6fea5-1368-4912-a051-614425905237 tempest-ProjectMemberTests-188752871 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f485cad-9eb2-4fbf-b343-f6b9014ccb5c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88613) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:34:00 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[d16e58a4-3cd7-4c81-ae35-14a008a7bec1]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:34:00 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-cbe6fea5-1368-4912-a051-614425905237 tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6f485cad-9eb2-4fbf-b343-f6b9014ccb5c {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:00 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5dcf7511-52e8-4a45-8728-7de84c4f1bea tempest-ProjectReaderTests-75358439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:34:00 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5dcf7511-52e8-4a45-8728-7de84c4f1bea tempest-ProjectReaderTests-75358439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:34:00 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-5dcf7511-52e8-4a45-8728-7de84c4f1bea tempest-ProjectReaderTests-75358439 None] Creating offline snapshot 1e05e123-a393-4db0-bd9a-bac500aef032 of volume aebf6ae4-8a5e-4f77-93a8-4001e16e9edd {{(pid=88613) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:34:00 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0bc28ad-9646-4d4a-9315-99d8ab594579]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:34:00 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5dcf7511-52e8-4a45-8728-7de84c4f1bea tempest-ProjectReaderTests-75358439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-aebf6ae4-8a5e-4f77-93a8-4001e16e9edd {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:00 devstack sudo[107392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6f485cad-9eb2-4fbf-b343-f6b9014ccb5c Aug 05 10:34:00 devstack sudo[107392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:00 devstack sudo[107393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-aebf6ae4-8a5e-4f77-93a8-4001e16e9edd Aug 05 10:34:00 devstack sudo[107393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:00 devstack sudo[107392]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:00 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-cbe6fea5-1368-4912-a051-614425905237 tempest-ProjectMemberTests-188752871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6f485cad-9eb2-4fbf-b343-f6b9014ccb5c" returned: 0 in 0.371s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:00 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-cbe6fea5-1368-4912-a051-614425905237 tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6f485cad-9eb2-4fbf-b343-f6b9014ccb5c.4e70a706-fbe0-4a9b-a0df-c81a7b4c5827 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:00 devstack sudo[107401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6f485cad-9eb2-4fbf-b343-f6b9014ccb5c.4e70a706-fbe0-4a9b-a0df-c81a7b4c5827 Aug 05 10:34:00 devstack sudo[107401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:00 devstack sudo[107393]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:00 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5dcf7511-52e8-4a45-8728-7de84c4f1bea tempest-ProjectReaderTests-75358439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-aebf6ae4-8a5e-4f77-93a8-4001e16e9edd" returned: 0 in 0.364s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:00 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5dcf7511-52e8-4a45-8728-7de84c4f1bea tempest-ProjectReaderTests-75358439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-aebf6ae4-8a5e-4f77-93a8-4001e16e9edd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-aebf6ae4-8a5e-4f77-93a8-4001e16e9edd.1e05e123-a393-4db0-bd9a-bac500aef032 1G {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:00 devstack sudo[107404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-aebf6ae4-8a5e-4f77-93a8-4001e16e9edd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-aebf6ae4-8a5e-4f77-93a8-4001e16e9edd.1e05e123-a393-4db0-bd9a-bac500aef032 1G Aug 05 10:34:00 devstack sudo[107404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:00 devstack sudo[107401]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:00 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-cbe6fea5-1368-4912-a051-614425905237 tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6f485cad-9eb2-4fbf-b343-f6b9014ccb5c.4e70a706-fbe0-4a9b-a0df-c81a7b4c5827" returned: 0 in 0.363s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:00 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-cbe6fea5-1368-4912-a051-614425905237 tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6f485cad-9eb2-4fbf-b343-f6b9014ccb5c.4e70a706-fbe0-4a9b-a0df-c81a7b4c5827 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:00 devstack sudo[107412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6f485cad-9eb2-4fbf-b343-f6b9014ccb5c.4e70a706-fbe0-4a9b-a0df-c81a7b4c5827 Aug 05 10:34:00 devstack sudo[107412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:00 devstack sudo[107404]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:00 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5dcf7511-52e8-4a45-8728-7de84c4f1bea tempest-ProjectReaderTests-75358439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-aebf6ae4-8a5e-4f77-93a8-4001e16e9edd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-aebf6ae4-8a5e-4f77-93a8-4001e16e9edd.1e05e123-a393-4db0-bd9a-bac500aef032 1G" returned: 0 in 0.419s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:00 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5dcf7511-52e8-4a45-8728-7de84c4f1bea tempest-ProjectReaderTests-75358439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aebf6ae4-8a5e-4f77-93a8-4001e16e9edd -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-aebf6ae4-8a5e-4f77-93a8-4001e16e9edd.1e05e123-a393-4db0-bd9a-bac500aef032 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:00 devstack sudo[107414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aebf6ae4-8a5e-4f77-93a8-4001e16e9edd -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-aebf6ae4-8a5e-4f77-93a8-4001e16e9edd.1e05e123-a393-4db0-bd9a-bac500aef032 Aug 05 10:34:00 devstack sudo[107414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:01 devstack sudo[107412]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:01 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-cbe6fea5-1368-4912-a051-614425905237 tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6f485cad-9eb2-4fbf-b343-f6b9014ccb5c.4e70a706-fbe0-4a9b-a0df-c81a7b4c5827" returned: 0 in 0.251s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:01 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-cbe6fea5-1368-4912-a051-614425905237 tempest-ProjectMemberTests-188752871 None] Lock "cinder-quobyte-4e70a706-fbe0-4a9b-a0df-c81a7b4c5827" released by "_delete_snapshot" :: held 1.500s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:34:01 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-cbe6fea5-1368-4912-a051-614425905237 tempest-ProjectMemberTests-188752871 None] Lock "cinder-quobyte-6f485cad-9eb2-4fbf-b343-f6b9014ccb5c" released by "delete_snapshot" :: held 1.525s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:34:01 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-cbe6fea5-1368-4912-a051-614425905237 tempest-ProjectMemberTests-188752871 None] Created reservations ['7e45f603-4253-4b29-838f-d15aee818619', 'a990be5c-b5f0-4eed-bfd8-7aeaaba43df9', '51ca3e53-9c8b-4b04-ab41-aff7cd003f2a', '5e9c38fe-8858-4845-b8f1-288a0d1867c7'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:34:01 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-cbe6fea5-1368-4912-a051-614425905237 tempest-ProjectMemberTests-188752871 None] Delete snapshot completed successfully. Aug 05 10:34:01 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-cbe6fea5-1368-4912-a051-614425905237 tempest-ProjectMemberTests-188752871 None] Lock "cinder-4e70a706-fbe0-4a9b-a0df-c81a7b4c5827-delete_snapshot" released by "delete_snapshot" :: held 1.665s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:34:01 devstack sudo[107414]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:01 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5dcf7511-52e8-4a45-8728-7de84c4f1bea tempest-ProjectReaderTests-75358439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aebf6ae4-8a5e-4f77-93a8-4001e16e9edd -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-aebf6ae4-8a5e-4f77-93a8-4001e16e9edd.1e05e123-a393-4db0-bd9a-bac500aef032" returned: 0 in 0.330s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:01 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-5dcf7511-52e8-4a45-8728-7de84c4f1bea tempest-ProjectReaderTests-75358439 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-aebf6ae4-8a5e-4f77-93a8-4001e16e9edd.1e05e123-a393-4db0-bd9a-bac500aef032 is being set with open permissions: ugo+rw Aug 05 10:34:01 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5dcf7511-52e8-4a45-8728-7de84c4f1bea tempest-ProjectReaderTests-75358439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-aebf6ae4-8a5e-4f77-93a8-4001e16e9edd.1e05e123-a393-4db0-bd9a-bac500aef032 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:01 devstack sudo[107420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-aebf6ae4-8a5e-4f77-93a8-4001e16e9edd.1e05e123-a393-4db0-bd9a-bac500aef032 Aug 05 10:34:01 devstack sudo[107420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:01 devstack sudo[107420]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:01 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5dcf7511-52e8-4a45-8728-7de84c4f1bea tempest-ProjectReaderTests-75358439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-aebf6ae4-8a5e-4f77-93a8-4001e16e9edd.1e05e123-a393-4db0-bd9a-bac500aef032" returned: 0 in 0.245s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:01 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5dcf7511-52e8-4a45-8728-7de84c4f1bea tempest-ProjectReaderTests-75358439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-aebf6ae4-8a5e-4f77-93a8-4001e16e9edd.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:01 devstack sudo[107459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-aebf6ae4-8a5e-4f77-93a8-4001e16e9edd.info Aug 05 10:34:01 devstack sudo[107459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:01 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-fe9b05ca-0875-4f77-9d95-55ac306670fd tempest-ProjectMemberTests-188752871 None] Acquiring lock "cinder-6f485cad-9eb2-4fbf-b343-f6b9014ccb5c-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:34:01 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-fe9b05ca-0875-4f77-9d95-55ac306670fd tempest-ProjectMemberTests-188752871 None] Lock "cinder-6f485cad-9eb2-4fbf-b343-f6b9014ccb5c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:34:01 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-fe9b05ca-0875-4f77-9d95-55ac306670fd tempest-ProjectMemberTests-188752871 None] Acquiring lock "cinder-quobyte-6f485cad-9eb2-4fbf-b343-f6b9014ccb5c" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:34:01 devstack sudo[107459]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:01 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5dcf7511-52e8-4a45-8728-7de84c4f1bea tempest-ProjectReaderTests-75358439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-aebf6ae4-8a5e-4f77-93a8-4001e16e9edd.info" returned: 0 in 0.290s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:01 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-5dcf7511-52e8-4a45-8728-7de84c4f1bea tempest-ProjectReaderTests-75358439 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-aebf6ae4-8a5e-4f77-93a8-4001e16e9edd.info is being set with open permissions: ugo+rw Aug 05 10:34:01 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5dcf7511-52e8-4a45-8728-7de84c4f1bea tempest-ProjectReaderTests-75358439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-aebf6ae4-8a5e-4f77-93a8-4001e16e9edd.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:01 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-fe9b05ca-0875-4f77-9d95-55ac306670fd tempest-ProjectMemberTests-188752871 None] Lock "cinder-quobyte-6f485cad-9eb2-4fbf-b343-f6b9014ccb5c" acquired by "delete_volume" :: waited 0.040s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:34:01 devstack sudo[107462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-aebf6ae4-8a5e-4f77-93a8-4001e16e9edd.info Aug 05 10:34:01 devstack sudo[107462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:01 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9c971c-49cd-40d4-ad21-d29d095dc50c]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:34:01 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-fe9b05ca-0875-4f77-9d95-55ac306670fd tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6f485cad-9eb2-4fbf-b343-f6b9014ccb5c {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:01 devstack sudo[107464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6f485cad-9eb2-4fbf-b343-f6b9014ccb5c Aug 05 10:34:01 devstack sudo[107464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:02 devstack sudo[107462]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:02 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-5dcf7511-52e8-4a45-8728-7de84c4f1bea tempest-ProjectReaderTests-75358439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-aebf6ae4-8a5e-4f77-93a8-4001e16e9edd.info" returned: 0 in 0.263s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:02 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-5dcf7511-52e8-4a45-8728-7de84c4f1bea tempest-ProjectReaderTests-75358439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.014s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:34:02 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-5dcf7511-52e8-4a45-8728-7de84c4f1bea tempest-ProjectReaderTests-75358439 None] Create snapshot completed successfully Aug 05 10:34:02 devstack sudo[107464]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:02 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-fe9b05ca-0875-4f77-9d95-55ac306670fd tempest-ProjectMemberTests-188752871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6f485cad-9eb2-4fbf-b343-f6b9014ccb5c" returned: 0 in 0.383s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:02 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-fe9b05ca-0875-4f77-9d95-55ac306670fd tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6f485cad-9eb2-4fbf-b343-f6b9014ccb5c {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:02 devstack sudo[107470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6f485cad-9eb2-4fbf-b343-f6b9014ccb5c Aug 05 10:34:02 devstack sudo[107470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:02 devstack sudo[107470]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:02 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-fe9b05ca-0875-4f77-9d95-55ac306670fd tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6f485cad-9eb2-4fbf-b343-f6b9014ccb5c" returned: 0 in 0.249s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:02 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-fe9b05ca-0875-4f77-9d95-55ac306670fd tempest-ProjectMemberTests-188752871 None] Lock "cinder-quobyte-6f485cad-9eb2-4fbf-b343-f6b9014ccb5c" released by "delete_volume" :: held 0.702s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:34:02 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-fe9b05ca-0875-4f77-9d95-55ac306670fd tempest-ProjectMemberTests-188752871 None] Created reservations ['b47ec1ec-ef99-44af-b142-55daaba3e5e4', 'ab528957-21a3-453c-9a92-79dcfcce2cc6', 'af3c0ffe-d0be-4cf2-942f-4478744b664a', 'c9204c8b-588d-408e-aca5-601c32c031ef'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:34:02 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-fe9b05ca-0875-4f77-9d95-55ac306670fd tempest-ProjectMemberTests-188752871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:34:02 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-fe9b05ca-0875-4f77-9d95-55ac306670fd tempest-ProjectMemberTests-188752871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:34:02 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-fe9b05ca-0875-4f77-9d95-55ac306670fd tempest-ProjectMemberTests-188752871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:34:02 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-fe9b05ca-0875-4f77-9d95-55ac306670fd tempest-ProjectMemberTests-188752871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:34:02 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-fe9b05ca-0875-4f77-9d95-55ac306670fd tempest-ProjectMemberTests-188752871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:34:02 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-fe9b05ca-0875-4f77-9d95-55ac306670fd tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:02 devstack sudo[107473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:34:02 devstack sudo[107473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:02 devstack sudo[107473]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:02 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-fe9b05ca-0875-4f77-9d95-55ac306670fd tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.276s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:02 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-fe9b05ca-0875-4f77-9d95-55ac306670fd tempest-ProjectMemberTests-188752871 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:34:02 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-fe9b05ca-0875-4f77-9d95-55ac306670fd tempest-ProjectMemberTests-188752871 None] Deleted volume successfully. Aug 05 10:34:02 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-fe9b05ca-0875-4f77-9d95-55ac306670fd tempest-ProjectMemberTests-188752871 None] Lock "cinder-6f485cad-9eb2-4fbf-b343-f6b9014ccb5c-delete_volume" released by "delete_volume" :: held 1.210s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:34:03 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-42af7d2c-2ea2-4194-a0c1-07a310e07b67 tempest-ProjectReaderTests-75358439 None] Acquiring lock "cinder-1e05e123-a393-4db0-bd9a-bac500aef032-delete_snapshot" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:34:03 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-42af7d2c-2ea2-4194-a0c1-07a310e07b67 tempest-ProjectReaderTests-75358439 None] Lock "cinder-1e05e123-a393-4db0-bd9a-bac500aef032-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:34:03 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-42af7d2c-2ea2-4194-a0c1-07a310e07b67 tempest-ProjectReaderTests-75358439 None] Acquiring lock "cinder-quobyte-aebf6ae4-8a5e-4f77-93a8-4001e16e9edd" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:34:03 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-42af7d2c-2ea2-4194-a0c1-07a310e07b67 tempest-ProjectReaderTests-75358439 None] Lock "cinder-quobyte-aebf6ae4-8a5e-4f77-93a8-4001e16e9edd" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:34:03 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-42af7d2c-2ea2-4194-a0c1-07a310e07b67 tempest-ProjectReaderTests-75358439 None] Acquiring lock "cinder-quobyte-1e05e123-a393-4db0-bd9a-bac500aef032" by "_delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:34:03 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-42af7d2c-2ea2-4194-a0c1-07a310e07b67 tempest-ProjectReaderTests-75358439 None] Lock "cinder-quobyte-1e05e123-a393-4db0-bd9a-bac500aef032" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:34:03 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-42af7d2c-2ea2-4194-a0c1-07a310e07b67 tempest-ProjectReaderTests-75358439 None] Deleting offline snapshot 1e05e123-a393-4db0-bd9a-bac500aef032 of volume aebf6ae4-8a5e-4f77-93a8-4001e16e9edd {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:34:03 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-42af7d2c-2ea2-4194-a0c1-07a310e07b67 tempest-ProjectReaderTests-75358439 None] snapshot_file for this snap is: volume-aebf6ae4-8a5e-4f77-93a8-4001e16e9edd.1e05e123-a393-4db0-bd9a-bac500aef032 {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:34:03 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3ec139-a188-45b8-8a68-f1c9e5726113]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:34:03 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-42af7d2c-2ea2-4194-a0c1-07a310e07b67 tempest-ProjectReaderTests-75358439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-aebf6ae4-8a5e-4f77-93a8-4001e16e9edd.1e05e123-a393-4db0-bd9a-bac500aef032 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:03 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-2197b3aa-9bb4-4591-b827-f9091a3f9470 tempest-ProjectMemberTests-188752871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:34:03 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2197b3aa-9bb4-4591-b827-f9091a3f9470 tempest-ProjectMemberTests-188752871 None] Flow 'volume_create_manager' (f93e40ed-db4d-4bb5-b2a2-f24f0b474f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:34:03 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2197b3aa-9bb4-4591-b827-f9091a3f9470 tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (642a4bab-511f-43ae-8ad7-2aa123c0ed91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:03 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2197b3aa-9bb4-4591-b827-f9091a3f9470 tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (642a4bab-511f-43ae-8ad7-2aa123c0ed91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:34:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-17119768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15da6e26-b79f-4fd6-b308-b1f985683e8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8da1a4df661e48a896791cae706d962d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:34:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:34:03Z,use_quota=True,user_id='7390514821a74358b20ac932df9a2ce2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:03 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2197b3aa-9bb4-4591-b827-f9091a3f9470 tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95fcf4f0-c784-4f6d-adbf-216ffae257fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:03 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2197b3aa-9bb4-4591-b827-f9091a3f9470 tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95fcf4f0-c784-4f6d-adbf-216ffae257fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:03 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2197b3aa-9bb4-4591-b827-f9091a3f9470 tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b686083-b5c6-4311-a2c5-fafa63e9f65f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:03 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2197b3aa-9bb4-4591-b827-f9091a3f9470 tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b686083-b5c6-4311-a2c5-fafa63e9f65f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15da6e26-b79f-4fd6-b308-b1f985683e8e', 'volume_name': 'volume-15da6e26-b79f-4fd6-b308-b1f985683e8e', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:03 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2197b3aa-9bb4-4591-b827-f9091a3f9470 tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3740fa29-8881-4032-a57f-4e4151bbbf89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:03 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2197b3aa-9bb4-4591-b827-f9091a3f9470 tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3740fa29-8881-4032-a57f-4e4151bbbf89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:03 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2197b3aa-9bb4-4591-b827-f9091a3f9470 tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e411dfd-7006-414a-9fdf-77485955cef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:03 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-2197b3aa-9bb4-4591-b827-f9091a3f9470 tempest-ProjectMemberTests-188752871 None] Volume 15da6e26-b79f-4fd6-b308-b1f985683e8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15da6e26-b79f-4fd6-b308-b1f985683e8e', 'volume_size': 1} Aug 05 10:34:03 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2197b3aa-9bb4-4591-b827-f9091a3f9470 tempest-ProjectMemberTests-188752871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:34:03 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2197b3aa-9bb4-4591-b827-f9091a3f9470 tempest-ProjectMemberTests-188752871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:34:03 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-2197b3aa-9bb4-4591-b827-f9091a3f9470 tempest-ProjectMemberTests-188752871 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:34:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-17119768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15da6e26-b79f-4fd6-b308-b1f985683e8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8da1a4df661e48a896791cae706d962d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:34:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:34:03Z,use_quota=True,user_id='7390514821a74358b20ac932df9a2ce2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:34:03 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-2197b3aa-9bb4-4591-b827-f9091a3f9470 tempest-ProjectMemberTests-188752871 None] Creating volume 15da6e26-b79f-4fd6-b308-b1f985683e8e {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:34:03 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2197b3aa-9bb4-4591-b827-f9091a3f9470 tempest-ProjectMemberTests-188752871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:34:03 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2197b3aa-9bb4-4591-b827-f9091a3f9470 tempest-ProjectMemberTests-188752871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:34:03 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-2197b3aa-9bb4-4591-b827-f9091a3f9470 tempest-ProjectMemberTests-188752871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:34:03 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-2197b3aa-9bb4-4591-b827-f9091a3f9470 tempest-ProjectMemberTests-188752871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:34:03 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2197b3aa-9bb4-4591-b827-f9091a3f9470 tempest-ProjectMemberTests-188752871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:34:03 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-2197b3aa-9bb4-4591-b827-f9091a3f9470 tempest-ProjectMemberTests-188752871 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:34:03 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-2197b3aa-9bb4-4591-b827-f9091a3f9470 tempest-ProjectMemberTests-188752871 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:34:03 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2197b3aa-9bb4-4591-b827-f9091a3f9470 tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-15da6e26-b79f-4fd6-b308-b1f985683e8e 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:03 devstack sudo[107476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-aebf6ae4-8a5e-4f77-93a8-4001e16e9edd.1e05e123-a393-4db0-bd9a-bac500aef032 Aug 05 10:34:03 devstack sudo[107476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:03 devstack sudo[107478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-15da6e26-b79f-4fd6-b308-b1f985683e8e 1073741824 Aug 05 10:34:03 devstack sudo[107478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:03 devstack sudo[107476]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:03 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-42af7d2c-2ea2-4194-a0c1-07a310e07b67 tempest-ProjectReaderTests-75358439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-aebf6ae4-8a5e-4f77-93a8-4001e16e9edd.1e05e123-a393-4db0-bd9a-bac500aef032" returned: 0 in 0.385s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:03 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-42af7d2c-2ea2-4194-a0c1-07a310e07b67 tempest-ProjectReaderTests-75358439 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aebf6ae4-8a5e-4f77-93a8-4001e16e9edd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88613) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:34:03 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[b63e70c5-dcf1-414f-872b-06a1e7a6166d]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:34:03 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-42af7d2c-2ea2-4194-a0c1-07a310e07b67 tempest-ProjectReaderTests-75358439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-aebf6ae4-8a5e-4f77-93a8-4001e16e9edd {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:03 devstack sudo[107486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-aebf6ae4-8a5e-4f77-93a8-4001e16e9edd Aug 05 10:34:03 devstack sudo[107486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:03 devstack sudo[107478]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:03 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2197b3aa-9bb4-4591-b827-f9091a3f9470 tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-15da6e26-b79f-4fd6-b308-b1f985683e8e 1073741824" returned: 0 in 0.478s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:03 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2197b3aa-9bb4-4591-b827-f9091a3f9470 tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-15da6e26-b79f-4fd6-b308-b1f985683e8e {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:03 devstack sudo[107489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-15da6e26-b79f-4fd6-b308-b1f985683e8e Aug 05 10:34:03 devstack sudo[107489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:04 devstack sudo[107486]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-42af7d2c-2ea2-4194-a0c1-07a310e07b67 tempest-ProjectReaderTests-75358439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-aebf6ae4-8a5e-4f77-93a8-4001e16e9edd" returned: 0 in 0.385s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-42af7d2c-2ea2-4194-a0c1-07a310e07b67 tempest-ProjectReaderTests-75358439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-aebf6ae4-8a5e-4f77-93a8-4001e16e9edd.1e05e123-a393-4db0-bd9a-bac500aef032 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:04 devstack sudo[107494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-aebf6ae4-8a5e-4f77-93a8-4001e16e9edd.1e05e123-a393-4db0-bd9a-bac500aef032 Aug 05 10:34:04 devstack sudo[107494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:04 devstack sudo[107489]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-2197b3aa-9bb4-4591-b827-f9091a3f9470 tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-15da6e26-b79f-4fd6-b308-b1f985683e8e" returned: 0 in 0.277s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:04 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-2197b3aa-9bb4-4591-b827-f9091a3f9470 tempest-ProjectMemberTests-188752871 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:34:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-2197b3aa-9bb4-4591-b827-f9091a3f9470 tempest-ProjectMemberTests-188752871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:34:04 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2197b3aa-9bb4-4591-b827-f9091a3f9470 tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e411dfd-7006-414a-9fdf-77485955cef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15da6e26-b79f-4fd6-b308-b1f985683e8e', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:04 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2197b3aa-9bb4-4591-b827-f9091a3f9470 tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c52573bd-4c2b-4ea8-bdcb-07db9fef93e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:04 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-2197b3aa-9bb4-4591-b827-f9091a3f9470 tempest-ProjectMemberTests-188752871 None] Volume volume-15da6e26-b79f-4fd6-b308-b1f985683e8e (15da6e26-b79f-4fd6-b308-b1f985683e8e): created successfully Aug 05 10:34:04 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2197b3aa-9bb4-4591-b827-f9091a3f9470 tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c52573bd-4c2b-4ea8-bdcb-07db9fef93e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:04 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-2197b3aa-9bb4-4591-b827-f9091a3f9470 tempest-ProjectMemberTests-188752871 None] Flow 'volume_create_manager' (f93e40ed-db4d-4bb5-b2a2-f24f0b474f0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:34:04 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-2197b3aa-9bb4-4591-b827-f9091a3f9470 tempest-ProjectMemberTests-188752871 None] Created volume successfully. Aug 05 10:34:04 devstack sudo[107494]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-42af7d2c-2ea2-4194-a0c1-07a310e07b67 tempest-ProjectReaderTests-75358439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-aebf6ae4-8a5e-4f77-93a8-4001e16e9edd.1e05e123-a393-4db0-bd9a-bac500aef032" returned: 0 in 0.341s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-42af7d2c-2ea2-4194-a0c1-07a310e07b67 tempest-ProjectReaderTests-75358439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-aebf6ae4-8a5e-4f77-93a8-4001e16e9edd.1e05e123-a393-4db0-bd9a-bac500aef032 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:04 devstack sudo[107500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-aebf6ae4-8a5e-4f77-93a8-4001e16e9edd.1e05e123-a393-4db0-bd9a-bac500aef032 Aug 05 10:34:04 devstack sudo[107500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:04 devstack sudo[107500]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-42af7d2c-2ea2-4194-a0c1-07a310e07b67 tempest-ProjectReaderTests-75358439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-aebf6ae4-8a5e-4f77-93a8-4001e16e9edd.1e05e123-a393-4db0-bd9a-bac500aef032" returned: 0 in 0.255s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:04 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-42af7d2c-2ea2-4194-a0c1-07a310e07b67 tempest-ProjectReaderTests-75358439 None] Lock "cinder-quobyte-1e05e123-a393-4db0-bd9a-bac500aef032" released by "_delete_snapshot" :: held 1.477s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:34:04 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-42af7d2c-2ea2-4194-a0c1-07a310e07b67 tempest-ProjectReaderTests-75358439 None] Lock "cinder-quobyte-aebf6ae4-8a5e-4f77-93a8-4001e16e9edd" released by "delete_snapshot" :: held 1.506s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:34:04 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-42af7d2c-2ea2-4194-a0c1-07a310e07b67 tempest-ProjectReaderTests-75358439 None] Created reservations ['f54567fd-e2c0-4195-8b00-be86d8dfc05a', '9545acaa-1bdc-42be-9091-f3c8b200b703', '4a1207a7-f584-460d-a800-907d89571dca', '9408defc-91df-49d1-9d4c-3183185c2fb6'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:34:04 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-42af7d2c-2ea2-4194-a0c1-07a310e07b67 tempest-ProjectReaderTests-75358439 None] Delete snapshot completed successfully. Aug 05 10:34:04 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-42af7d2c-2ea2-4194-a0c1-07a310e07b67 tempest-ProjectReaderTests-75358439 None] Lock "cinder-1e05e123-a393-4db0-bd9a-bac500aef032-delete_snapshot" released by "delete_snapshot" :: held 1.650s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:34:05 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-c3350457-7f72-4fe1-b125-43c624585340 tempest-ProjectReaderTests-75358439 None] Acquiring lock "cinder-aebf6ae4-8a5e-4f77-93a8-4001e16e9edd-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:34:05 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-c3350457-7f72-4fe1-b125-43c624585340 tempest-ProjectReaderTests-75358439 None] Lock "cinder-aebf6ae4-8a5e-4f77-93a8-4001e16e9edd-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:34:05 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-c3350457-7f72-4fe1-b125-43c624585340 tempest-ProjectReaderTests-75358439 None] Acquiring lock "cinder-quobyte-aebf6ae4-8a5e-4f77-93a8-4001e16e9edd" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:34:05 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-c3350457-7f72-4fe1-b125-43c624585340 tempest-ProjectReaderTests-75358439 None] Lock "cinder-quobyte-aebf6ae4-8a5e-4f77-93a8-4001e16e9edd" acquired by "delete_volume" :: waited 0.020s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:34:05 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[0705b4bb-1f9e-49f7-becb-1bad390e0c8b]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:34:05 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c3350457-7f72-4fe1-b125-43c624585340 tempest-ProjectReaderTests-75358439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-aebf6ae4-8a5e-4f77-93a8-4001e16e9edd {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:05 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-9509f8d5-f01d-4721-87d7-e1fbab5b5b23 tempest-ProjectMemberTests-188752871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:34:05 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-9509f8d5-f01d-4721-87d7-e1fbab5b5b23 tempest-ProjectMemberTests-188752871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:34:05 devstack sudo[107504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-aebf6ae4-8a5e-4f77-93a8-4001e16e9edd Aug 05 10:34:05 devstack sudo[107504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:05 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-9509f8d5-f01d-4721-87d7-e1fbab5b5b23 tempest-ProjectMemberTests-188752871 None] Creating offline snapshot 4df52eca-03ca-440d-ac7b-511b67f532eb of volume 15da6e26-b79f-4fd6-b308-b1f985683e8e {{(pid=88613) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:34:05 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[421184ac-3a3f-4851-8fa4-62d126e62df0]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:34:05 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9509f8d5-f01d-4721-87d7-e1fbab5b5b23 tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-15da6e26-b79f-4fd6-b308-b1f985683e8e {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:05 devstack sudo[107506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-15da6e26-b79f-4fd6-b308-b1f985683e8e Aug 05 10:34:05 devstack sudo[107506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:05 devstack sudo[107504]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:05 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c3350457-7f72-4fe1-b125-43c624585340 tempest-ProjectReaderTests-75358439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-aebf6ae4-8a5e-4f77-93a8-4001e16e9edd" returned: 0 in 0.374s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:05 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c3350457-7f72-4fe1-b125-43c624585340 tempest-ProjectReaderTests-75358439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-aebf6ae4-8a5e-4f77-93a8-4001e16e9edd {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:05 devstack sudo[107511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-aebf6ae4-8a5e-4f77-93a8-4001e16e9edd Aug 05 10:34:05 devstack sudo[107511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:06 devstack sudo[107506]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9509f8d5-f01d-4721-87d7-e1fbab5b5b23 tempest-ProjectMemberTests-188752871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-15da6e26-b79f-4fd6-b308-b1f985683e8e" returned: 0 in 0.367s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9509f8d5-f01d-4721-87d7-e1fbab5b5b23 tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-15da6e26-b79f-4fd6-b308-b1f985683e8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-15da6e26-b79f-4fd6-b308-b1f985683e8e.4df52eca-03ca-440d-ac7b-511b67f532eb 1G {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:06 devstack sudo[107516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-15da6e26-b79f-4fd6-b308-b1f985683e8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-15da6e26-b79f-4fd6-b308-b1f985683e8e.4df52eca-03ca-440d-ac7b-511b67f532eb 1G Aug 05 10:34:06 devstack sudo[107516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:06 devstack sudo[107511]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c3350457-7f72-4fe1-b125-43c624585340 tempest-ProjectReaderTests-75358439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-aebf6ae4-8a5e-4f77-93a8-4001e16e9edd" returned: 0 in 0.246s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:06 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-c3350457-7f72-4fe1-b125-43c624585340 tempest-ProjectReaderTests-75358439 None] Lock "cinder-quobyte-aebf6ae4-8a5e-4f77-93a8-4001e16e9edd" released by "delete_volume" :: held 0.691s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:34:06 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-c3350457-7f72-4fe1-b125-43c624585340 tempest-ProjectReaderTests-75358439 None] Created reservations ['285bfcfd-131f-4c2f-a1f2-e27dd4920a79', '4e73566f-e1b5-4b4c-b52a-391297013b9a', '34f1eef2-b82c-4492-b8b7-e17728026d8d', 'a19c771f-15b1-4ca8-ade7-1d01c96db4ab'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:34:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c3350457-7f72-4fe1-b125-43c624585340 tempest-ProjectReaderTests-75358439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:34:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c3350457-7f72-4fe1-b125-43c624585340 tempest-ProjectReaderTests-75358439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:34:06 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-c3350457-7f72-4fe1-b125-43c624585340 tempest-ProjectReaderTests-75358439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:34:06 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-c3350457-7f72-4fe1-b125-43c624585340 tempest-ProjectReaderTests-75358439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:34:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c3350457-7f72-4fe1-b125-43c624585340 tempest-ProjectReaderTests-75358439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:34:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c3350457-7f72-4fe1-b125-43c624585340 tempest-ProjectReaderTests-75358439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:06 devstack sudo[107521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:34:06 devstack sudo[107521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:06 devstack sudo[107516]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9509f8d5-f01d-4721-87d7-e1fbab5b5b23 tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-15da6e26-b79f-4fd6-b308-b1f985683e8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-15da6e26-b79f-4fd6-b308-b1f985683e8e.4df52eca-03ca-440d-ac7b-511b67f532eb 1G" returned: 0 in 0.425s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9509f8d5-f01d-4721-87d7-e1fbab5b5b23 tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15da6e26-b79f-4fd6-b308-b1f985683e8e -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-15da6e26-b79f-4fd6-b308-b1f985683e8e.4df52eca-03ca-440d-ac7b-511b67f532eb {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:06 devstack sudo[107524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15da6e26-b79f-4fd6-b308-b1f985683e8e -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-15da6e26-b79f-4fd6-b308-b1f985683e8e.4df52eca-03ca-440d-ac7b-511b67f532eb Aug 05 10:34:06 devstack sudo[107524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:06 devstack sudo[107521]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c3350457-7f72-4fe1-b125-43c624585340 tempest-ProjectReaderTests-75358439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.260s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:06 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-c3350457-7f72-4fe1-b125-43c624585340 tempest-ProjectReaderTests-75358439 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:34:06 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-c3350457-7f72-4fe1-b125-43c624585340 tempest-ProjectReaderTests-75358439 None] Deleted volume successfully. Aug 05 10:34:06 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-c3350457-7f72-4fe1-b125-43c624585340 tempest-ProjectReaderTests-75358439 None] Lock "cinder-aebf6ae4-8a5e-4f77-93a8-4001e16e9edd-delete_volume" released by "delete_volume" :: held 1.175s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:34:06 devstack sudo[107524]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9509f8d5-f01d-4721-87d7-e1fbab5b5b23 tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15da6e26-b79f-4fd6-b308-b1f985683e8e -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-15da6e26-b79f-4fd6-b308-b1f985683e8e.4df52eca-03ca-440d-ac7b-511b67f532eb" returned: 0 in 0.342s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:06 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-9509f8d5-f01d-4721-87d7-e1fbab5b5b23 tempest-ProjectMemberTests-188752871 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-15da6e26-b79f-4fd6-b308-b1f985683e8e.4df52eca-03ca-440d-ac7b-511b67f532eb is being set with open permissions: ugo+rw Aug 05 10:34:06 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9509f8d5-f01d-4721-87d7-e1fbab5b5b23 tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-15da6e26-b79f-4fd6-b308-b1f985683e8e.4df52eca-03ca-440d-ac7b-511b67f532eb {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:06 devstack sudo[107530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-15da6e26-b79f-4fd6-b308-b1f985683e8e.4df52eca-03ca-440d-ac7b-511b67f532eb Aug 05 10:34:06 devstack sudo[107530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:07 devstack sudo[107530]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9509f8d5-f01d-4721-87d7-e1fbab5b5b23 tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-15da6e26-b79f-4fd6-b308-b1f985683e8e.4df52eca-03ca-440d-ac7b-511b67f532eb" returned: 0 in 0.263s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9509f8d5-f01d-4721-87d7-e1fbab5b5b23 tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-15da6e26-b79f-4fd6-b308-b1f985683e8e.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:07 devstack sudo[107533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-15da6e26-b79f-4fd6-b308-b1f985683e8e.info Aug 05 10:34:07 devstack sudo[107533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:07 devstack sudo[107533]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9509f8d5-f01d-4721-87d7-e1fbab5b5b23 tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-15da6e26-b79f-4fd6-b308-b1f985683e8e.info" returned: 0 in 0.266s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:07 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-9509f8d5-f01d-4721-87d7-e1fbab5b5b23 tempest-ProjectMemberTests-188752871 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-15da6e26-b79f-4fd6-b308-b1f985683e8e.info is being set with open permissions: ugo+rw Aug 05 10:34:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9509f8d5-f01d-4721-87d7-e1fbab5b5b23 tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-15da6e26-b79f-4fd6-b308-b1f985683e8e.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:07 devstack sudo[107536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-15da6e26-b79f-4fd6-b308-b1f985683e8e.info Aug 05 10:34:07 devstack sudo[107536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:07 devstack sudo[107536]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9509f8d5-f01d-4721-87d7-e1fbab5b5b23 tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-15da6e26-b79f-4fd6-b308-b1f985683e8e.info" returned: 0 in 0.294s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:07 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-9509f8d5-f01d-4721-87d7-e1fbab5b5b23 tempest-ProjectMemberTests-188752871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.059s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:34:07 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-9509f8d5-f01d-4721-87d7-e1fbab5b5b23 tempest-ProjectMemberTests-188752871 None] Create snapshot completed successfully Aug 05 10:34:08 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d7e9418f-9f73-4121-8cb7-4ec87e0ee2cf tempest-ProjectMemberTests-188752871 None] Acquiring lock "cinder-4df52eca-03ca-440d-ac7b-511b67f532eb-delete_snapshot" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:34:08 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d7e9418f-9f73-4121-8cb7-4ec87e0ee2cf tempest-ProjectMemberTests-188752871 None] Lock "cinder-4df52eca-03ca-440d-ac7b-511b67f532eb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:34:08 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d7e9418f-9f73-4121-8cb7-4ec87e0ee2cf tempest-ProjectMemberTests-188752871 None] Acquiring lock "cinder-quobyte-15da6e26-b79f-4fd6-b308-b1f985683e8e" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:34:08 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d7e9418f-9f73-4121-8cb7-4ec87e0ee2cf tempest-ProjectMemberTests-188752871 None] Lock "cinder-quobyte-15da6e26-b79f-4fd6-b308-b1f985683e8e" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:34:08 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d7e9418f-9f73-4121-8cb7-4ec87e0ee2cf tempest-ProjectMemberTests-188752871 None] Acquiring lock "cinder-quobyte-4df52eca-03ca-440d-ac7b-511b67f532eb" by "_delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:34:08 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d7e9418f-9f73-4121-8cb7-4ec87e0ee2cf tempest-ProjectMemberTests-188752871 None] Lock "cinder-quobyte-4df52eca-03ca-440d-ac7b-511b67f532eb" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:34:08 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-d7e9418f-9f73-4121-8cb7-4ec87e0ee2cf tempest-ProjectMemberTests-188752871 None] Deleting offline snapshot 4df52eca-03ca-440d-ac7b-511b67f532eb of volume 15da6e26-b79f-4fd6-b308-b1f985683e8e {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:34:08 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-d7e9418f-9f73-4121-8cb7-4ec87e0ee2cf tempest-ProjectMemberTests-188752871 None] snapshot_file for this snap is: volume-15da6e26-b79f-4fd6-b308-b1f985683e8e.4df52eca-03ca-440d-ac7b-511b67f532eb {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:34:08 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9add87-5bce-4bf6-9d73-d984124696bb]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:34:08 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d7e9418f-9f73-4121-8cb7-4ec87e0ee2cf tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-15da6e26-b79f-4fd6-b308-b1f985683e8e.4df52eca-03ca-440d-ac7b-511b67f532eb {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:09 devstack sudo[107545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-15da6e26-b79f-4fd6-b308-b1f985683e8e.4df52eca-03ca-440d-ac7b-511b67f532eb Aug 05 10:34:09 devstack sudo[107545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:09 devstack sudo[107545]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d7e9418f-9f73-4121-8cb7-4ec87e0ee2cf tempest-ProjectMemberTests-188752871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-15da6e26-b79f-4fd6-b308-b1f985683e8e.4df52eca-03ca-440d-ac7b-511b67f532eb" returned: 0 in 0.374s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:09 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-d7e9418f-9f73-4121-8cb7-4ec87e0ee2cf tempest-ProjectMemberTests-188752871 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-15da6e26-b79f-4fd6-b308-b1f985683e8e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88613) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:34:09 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[de5cef86-455b-483d-a197-81c6e4da6a4f]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:34:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d7e9418f-9f73-4121-8cb7-4ec87e0ee2cf tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-15da6e26-b79f-4fd6-b308-b1f985683e8e {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:09 devstack sudo[107550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-15da6e26-b79f-4fd6-b308-b1f985683e8e Aug 05 10:34:09 devstack sudo[107550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:09 devstack sudo[107550]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d7e9418f-9f73-4121-8cb7-4ec87e0ee2cf tempest-ProjectMemberTests-188752871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-15da6e26-b79f-4fd6-b308-b1f985683e8e" returned: 0 in 0.371s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:09 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d7e9418f-9f73-4121-8cb7-4ec87e0ee2cf tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-15da6e26-b79f-4fd6-b308-b1f985683e8e.4df52eca-03ca-440d-ac7b-511b67f532eb {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:09 devstack sudo[107555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-15da6e26-b79f-4fd6-b308-b1f985683e8e.4df52eca-03ca-440d-ac7b-511b67f532eb Aug 05 10:34:09 devstack sudo[107555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:10 devstack sudo[107555]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:10 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d7e9418f-9f73-4121-8cb7-4ec87e0ee2cf tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-15da6e26-b79f-4fd6-b308-b1f985683e8e.4df52eca-03ca-440d-ac7b-511b67f532eb" returned: 0 in 0.366s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:10 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d7e9418f-9f73-4121-8cb7-4ec87e0ee2cf tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-15da6e26-b79f-4fd6-b308-b1f985683e8e.4df52eca-03ca-440d-ac7b-511b67f532eb {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:10 devstack sudo[107560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-15da6e26-b79f-4fd6-b308-b1f985683e8e.4df52eca-03ca-440d-ac7b-511b67f532eb Aug 05 10:34:10 devstack sudo[107560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:10 devstack sudo[107560]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:10 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d7e9418f-9f73-4121-8cb7-4ec87e0ee2cf tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-15da6e26-b79f-4fd6-b308-b1f985683e8e.4df52eca-03ca-440d-ac7b-511b67f532eb" returned: 0 in 0.262s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:10 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d7e9418f-9f73-4121-8cb7-4ec87e0ee2cf tempest-ProjectMemberTests-188752871 None] Lock "cinder-quobyte-4df52eca-03ca-440d-ac7b-511b67f532eb" released by "_delete_snapshot" :: held 1.494s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:34:10 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d7e9418f-9f73-4121-8cb7-4ec87e0ee2cf tempest-ProjectMemberTests-188752871 None] Lock "cinder-quobyte-15da6e26-b79f-4fd6-b308-b1f985683e8e" released by "delete_snapshot" :: held 1.518s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:34:10 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-d7e9418f-9f73-4121-8cb7-4ec87e0ee2cf tempest-ProjectMemberTests-188752871 None] Created reservations ['627553c7-e821-480d-a7e6-9794d3efcc8c', '6decc0d4-bc97-4712-9f5f-fc99de9a01b3', '9c3e4f4a-a0d1-4c5f-b917-4c69150255e5', 'b56dbc80-bdc2-4f30-b214-0caf41741e79'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:34:10 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-d7e9418f-9f73-4121-8cb7-4ec87e0ee2cf tempest-ProjectMemberTests-188752871 None] Delete snapshot completed successfully. Aug 05 10:34:10 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d7e9418f-9f73-4121-8cb7-4ec87e0ee2cf tempest-ProjectMemberTests-188752871 None] Lock "cinder-4df52eca-03ca-440d-ac7b-511b67f532eb-delete_snapshot" released by "delete_snapshot" :: held 1.655s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:34:10 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-56f8726d-f36e-41e7-8725-01061556b0b5 tempest-ProjectMemberTests-188752871 None] Acquiring lock "cinder-15da6e26-b79f-4fd6-b308-b1f985683e8e-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:34:10 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-56f8726d-f36e-41e7-8725-01061556b0b5 tempest-ProjectMemberTests-188752871 None] Lock "cinder-15da6e26-b79f-4fd6-b308-b1f985683e8e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:34:11 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-56f8726d-f36e-41e7-8725-01061556b0b5 tempest-ProjectMemberTests-188752871 None] Acquiring lock "cinder-quobyte-15da6e26-b79f-4fd6-b308-b1f985683e8e" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:34:11 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-56f8726d-f36e-41e7-8725-01061556b0b5 tempest-ProjectMemberTests-188752871 None] Lock "cinder-quobyte-15da6e26-b79f-4fd6-b308-b1f985683e8e" acquired by "delete_volume" :: waited 0.014s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:34:11 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[587aadf3-8150-4b15-ba44-32dd3ddce2ec]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:34:11 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-56f8726d-f36e-41e7-8725-01061556b0b5 tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-15da6e26-b79f-4fd6-b308-b1f985683e8e {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:11 devstack sudo[107563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-15da6e26-b79f-4fd6-b308-b1f985683e8e Aug 05 10:34:11 devstack sudo[107563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:11 devstack sudo[107563]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:11 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-56f8726d-f36e-41e7-8725-01061556b0b5 tempest-ProjectMemberTests-188752871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-15da6e26-b79f-4fd6-b308-b1f985683e8e" returned: 0 in 0.376s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:11 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-56f8726d-f36e-41e7-8725-01061556b0b5 tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-15da6e26-b79f-4fd6-b308-b1f985683e8e {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:11 devstack sudo[107568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-15da6e26-b79f-4fd6-b308-b1f985683e8e Aug 05 10:34:11 devstack sudo[107568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:11 devstack sudo[107568]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:11 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-56f8726d-f36e-41e7-8725-01061556b0b5 tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-15da6e26-b79f-4fd6-b308-b1f985683e8e" returned: 0 in 0.264s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:11 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-56f8726d-f36e-41e7-8725-01061556b0b5 tempest-ProjectMemberTests-188752871 None] Lock "cinder-quobyte-15da6e26-b79f-4fd6-b308-b1f985683e8e" released by "delete_volume" :: held 0.701s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:34:11 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-56f8726d-f36e-41e7-8725-01061556b0b5 tempest-ProjectMemberTests-188752871 None] Created reservations ['e2c82e13-c56a-4286-a09d-6ab63d9f00de', '63fd6c56-a23c-41e0-89b0-22dacd171fe4', '78e634b2-b6f3-4bc7-9c69-e9c0cafb229d', 'f6e27514-caa0-4fb2-8cc3-0b27d87afce8'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:34:11 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-56f8726d-f36e-41e7-8725-01061556b0b5 tempest-ProjectMemberTests-188752871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:34:11 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-56f8726d-f36e-41e7-8725-01061556b0b5 tempest-ProjectMemberTests-188752871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:34:11 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-56f8726d-f36e-41e7-8725-01061556b0b5 tempest-ProjectMemberTests-188752871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:34:11 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-56f8726d-f36e-41e7-8725-01061556b0b5 tempest-ProjectMemberTests-188752871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:34:11 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-56f8726d-f36e-41e7-8725-01061556b0b5 tempest-ProjectMemberTests-188752871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:34:11 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-56f8726d-f36e-41e7-8725-01061556b0b5 tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:11 devstack sudo[107571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:34:11 devstack sudo[107571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:12 devstack sudo[107571]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:12 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-56f8726d-f36e-41e7-8725-01061556b0b5 tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.257s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:12 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-56f8726d-f36e-41e7-8725-01061556b0b5 tempest-ProjectMemberTests-188752871 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:34:12 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-56f8726d-f36e-41e7-8725-01061556b0b5 tempest-ProjectMemberTests-188752871 None] Deleted volume successfully. Aug 05 10:34:12 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-56f8726d-f36e-41e7-8725-01061556b0b5 tempest-ProjectMemberTests-188752871 None] Lock "cinder-15da6e26-b79f-4fd6-b308-b1f985683e8e-delete_volume" released by "delete_volume" :: held 1.187s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:34:12 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-21b23f6a-4cba-45c4-bd1f-0fdd991d4a45 tempest-ProjectMemberTests-188752871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:34:12 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-21b23f6a-4cba-45c4-bd1f-0fdd991d4a45 tempest-ProjectMemberTests-188752871 None] Flow 'volume_create_manager' (6d569a57-3468-4d7c-9321-4869bd918a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:34:12 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-21b23f6a-4cba-45c4-bd1f-0fdd991d4a45 tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fba924e0-7d67-4800-8f21-aa19db43ee61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:12 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-21b23f6a-4cba-45c4-bd1f-0fdd991d4a45 tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fba924e0-7d67-4800-8f21-aa19db43ee61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:34:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-135922586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1928350-f700-480d-b7f7-f8957fe28388,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8da1a4df661e48a896791cae706d962d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:34:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:34:13Z,use_quota=True,user_id='7390514821a74358b20ac932df9a2ce2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:12 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-21b23f6a-4cba-45c4-bd1f-0fdd991d4a45 tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14d47fd4-7ca2-4466-8ae7-6c7938657006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:12 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-21b23f6a-4cba-45c4-bd1f-0fdd991d4a45 tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14d47fd4-7ca2-4466-8ae7-6c7938657006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:12 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-21b23f6a-4cba-45c4-bd1f-0fdd991d4a45 tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c08de004-b1e0-4e54-ae65-d57c57923bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:12 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-21b23f6a-4cba-45c4-bd1f-0fdd991d4a45 tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c08de004-b1e0-4e54-ae65-d57c57923bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1928350-f700-480d-b7f7-f8957fe28388', 'volume_name': 'volume-d1928350-f700-480d-b7f7-f8957fe28388', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:12 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-21b23f6a-4cba-45c4-bd1f-0fdd991d4a45 tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (027ae88a-e67b-4eba-a542-282cac431ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:12 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-21b23f6a-4cba-45c4-bd1f-0fdd991d4a45 tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (027ae88a-e67b-4eba-a542-282cac431ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:12 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-21b23f6a-4cba-45c4-bd1f-0fdd991d4a45 tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be251e3c-4545-4541-9c5e-9dbaf7accce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:12 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-21b23f6a-4cba-45c4-bd1f-0fdd991d4a45 tempest-ProjectMemberTests-188752871 None] Volume d1928350-f700-480d-b7f7-f8957fe28388: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1928350-f700-480d-b7f7-f8957fe28388', 'volume_size': 1} Aug 05 10:34:12 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-21b23f6a-4cba-45c4-bd1f-0fdd991d4a45 tempest-ProjectMemberTests-188752871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:34:12 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-21b23f6a-4cba-45c4-bd1f-0fdd991d4a45 tempest-ProjectMemberTests-188752871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:34:12 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-21b23f6a-4cba-45c4-bd1f-0fdd991d4a45 tempest-ProjectMemberTests-188752871 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:34:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-135922586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1928350-f700-480d-b7f7-f8957fe28388,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8da1a4df661e48a896791cae706d962d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:34:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:34:13Z,use_quota=True,user_id='7390514821a74358b20ac932df9a2ce2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:34:12 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-21b23f6a-4cba-45c4-bd1f-0fdd991d4a45 tempest-ProjectMemberTests-188752871 None] Creating volume d1928350-f700-480d-b7f7-f8957fe28388 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:34:12 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-21b23f6a-4cba-45c4-bd1f-0fdd991d4a45 tempest-ProjectMemberTests-188752871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:34:12 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-21b23f6a-4cba-45c4-bd1f-0fdd991d4a45 tempest-ProjectMemberTests-188752871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:34:12 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-21b23f6a-4cba-45c4-bd1f-0fdd991d4a45 tempest-ProjectMemberTests-188752871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:34:12 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-21b23f6a-4cba-45c4-bd1f-0fdd991d4a45 tempest-ProjectMemberTests-188752871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:34:12 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-21b23f6a-4cba-45c4-bd1f-0fdd991d4a45 tempest-ProjectMemberTests-188752871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:34:12 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-21b23f6a-4cba-45c4-bd1f-0fdd991d4a45 tempest-ProjectMemberTests-188752871 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:34:12 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-21b23f6a-4cba-45c4-bd1f-0fdd991d4a45 tempest-ProjectMemberTests-188752871 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:34:12 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-21b23f6a-4cba-45c4-bd1f-0fdd991d4a45 tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d1928350-f700-480d-b7f7-f8957fe28388 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:12 devstack sudo[107574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d1928350-f700-480d-b7f7-f8957fe28388 1073741824 Aug 05 10:34:12 devstack sudo[107574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:13 devstack sudo[107574]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:13 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-21b23f6a-4cba-45c4-bd1f-0fdd991d4a45 tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d1928350-f700-480d-b7f7-f8957fe28388 1073741824" returned: 0 in 0.417s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:13 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-21b23f6a-4cba-45c4-bd1f-0fdd991d4a45 tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d1928350-f700-480d-b7f7-f8957fe28388 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:13 devstack sudo[107580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d1928350-f700-480d-b7f7-f8957fe28388 Aug 05 10:34:13 devstack sudo[107580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:13 devstack sudo[107580]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:13 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-21b23f6a-4cba-45c4-bd1f-0fdd991d4a45 tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d1928350-f700-480d-b7f7-f8957fe28388" returned: 0 in 0.246s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:13 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-21b23f6a-4cba-45c4-bd1f-0fdd991d4a45 tempest-ProjectMemberTests-188752871 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:34:13 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-21b23f6a-4cba-45c4-bd1f-0fdd991d4a45 tempest-ProjectMemberTests-188752871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.703s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:34:13 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-21b23f6a-4cba-45c4-bd1f-0fdd991d4a45 tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be251e3c-4545-4541-9c5e-9dbaf7accce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1928350-f700-480d-b7f7-f8957fe28388', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:13 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-21b23f6a-4cba-45c4-bd1f-0fdd991d4a45 tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cfe913f-deae-4ce1-8b7d-707f2ae87ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:13 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-21b23f6a-4cba-45c4-bd1f-0fdd991d4a45 tempest-ProjectMemberTests-188752871 None] Volume volume-d1928350-f700-480d-b7f7-f8957fe28388 (d1928350-f700-480d-b7f7-f8957fe28388): created successfully Aug 05 10:34:13 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-21b23f6a-4cba-45c4-bd1f-0fdd991d4a45 tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cfe913f-deae-4ce1-8b7d-707f2ae87ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:13 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-21b23f6a-4cba-45c4-bd1f-0fdd991d4a45 tempest-ProjectMemberTests-188752871 None] Flow 'volume_create_manager' (6d569a57-3468-4d7c-9321-4869bd918a94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:34:13 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-21b23f6a-4cba-45c4-bd1f-0fdd991d4a45 tempest-ProjectMemberTests-188752871 None] Created volume successfully. Aug 05 10:34:13 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-7169466c-2f69-40d1-956f-a1397e740b98 tempest-ProjectMemberTests-188752871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:34:13 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-7169466c-2f69-40d1-956f-a1397e740b98 tempest-ProjectMemberTests-188752871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:34:13 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-7169466c-2f69-40d1-956f-a1397e740b98 tempest-ProjectMemberTests-188752871 None] Creating offline snapshot 4f63f401-2b8a-488d-b544-b5649f399579 of volume d1928350-f700-480d-b7f7-f8957fe28388 {{(pid=88613) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:34:13 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[d935fc27-e5cc-4ce2-aea8-5cbc6db2c6a8]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:34:13 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7169466c-2f69-40d1-956f-a1397e740b98 tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d1928350-f700-480d-b7f7-f8957fe28388 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:13 devstack sudo[107584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d1928350-f700-480d-b7f7-f8957fe28388 Aug 05 10:34:13 devstack sudo[107584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:14 devstack sudo[107584]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:14 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7169466c-2f69-40d1-956f-a1397e740b98 tempest-ProjectMemberTests-188752871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d1928350-f700-480d-b7f7-f8957fe28388" returned: 0 in 0.377s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:14 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7169466c-2f69-40d1-956f-a1397e740b98 tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d1928350-f700-480d-b7f7-f8957fe28388,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d1928350-f700-480d-b7f7-f8957fe28388.4f63f401-2b8a-488d-b544-b5649f399579 1G {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:14 devstack sudo[107589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d1928350-f700-480d-b7f7-f8957fe28388,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d1928350-f700-480d-b7f7-f8957fe28388.4f63f401-2b8a-488d-b544-b5649f399579 1G Aug 05 10:34:14 devstack sudo[107589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:14 devstack sudo[107589]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:14 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7169466c-2f69-40d1-956f-a1397e740b98 tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d1928350-f700-480d-b7f7-f8957fe28388,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d1928350-f700-480d-b7f7-f8957fe28388.4f63f401-2b8a-488d-b544-b5649f399579 1G" returned: 0 in 0.436s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:14 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7169466c-2f69-40d1-956f-a1397e740b98 tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1928350-f700-480d-b7f7-f8957fe28388 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d1928350-f700-480d-b7f7-f8957fe28388.4f63f401-2b8a-488d-b544-b5649f399579 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:14 devstack sudo[107596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1928350-f700-480d-b7f7-f8957fe28388 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d1928350-f700-480d-b7f7-f8957fe28388.4f63f401-2b8a-488d-b544-b5649f399579 Aug 05 10:34:14 devstack sudo[107596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:14 devstack sudo[107596]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:14 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7169466c-2f69-40d1-956f-a1397e740b98 tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1928350-f700-480d-b7f7-f8957fe28388 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d1928350-f700-480d-b7f7-f8957fe28388.4f63f401-2b8a-488d-b544-b5649f399579" returned: 0 in 0.311s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:14 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-7169466c-2f69-40d1-956f-a1397e740b98 tempest-ProjectMemberTests-188752871 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d1928350-f700-480d-b7f7-f8957fe28388.4f63f401-2b8a-488d-b544-b5649f399579 is being set with open permissions: ugo+rw Aug 05 10:34:14 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7169466c-2f69-40d1-956f-a1397e740b98 tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d1928350-f700-480d-b7f7-f8957fe28388.4f63f401-2b8a-488d-b544-b5649f399579 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:14 devstack sudo[107602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d1928350-f700-480d-b7f7-f8957fe28388.4f63f401-2b8a-488d-b544-b5649f399579 Aug 05 10:34:14 devstack sudo[107602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:15 devstack sudo[107602]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:15 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7169466c-2f69-40d1-956f-a1397e740b98 tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d1928350-f700-480d-b7f7-f8957fe28388.4f63f401-2b8a-488d-b544-b5649f399579" returned: 0 in 0.256s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:15 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7169466c-2f69-40d1-956f-a1397e740b98 tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d1928350-f700-480d-b7f7-f8957fe28388.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:15 devstack sudo[107605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d1928350-f700-480d-b7f7-f8957fe28388.info Aug 05 10:34:15 devstack sudo[107605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:15 devstack sudo[107605]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:15 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7169466c-2f69-40d1-956f-a1397e740b98 tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d1928350-f700-480d-b7f7-f8957fe28388.info" returned: 0 in 0.255s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:15 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-7169466c-2f69-40d1-956f-a1397e740b98 tempest-ProjectMemberTests-188752871 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d1928350-f700-480d-b7f7-f8957fe28388.info is being set with open permissions: ugo+rw Aug 05 10:34:15 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7169466c-2f69-40d1-956f-a1397e740b98 tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d1928350-f700-480d-b7f7-f8957fe28388.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:15 devstack sudo[107608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d1928350-f700-480d-b7f7-f8957fe28388.info Aug 05 10:34:15 devstack sudo[107608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:15 devstack sudo[107608]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:15 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-7169466c-2f69-40d1-956f-a1397e740b98 tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d1928350-f700-480d-b7f7-f8957fe28388.info" returned: 0 in 0.246s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:15 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-7169466c-2f69-40d1-956f-a1397e740b98 tempest-ProjectMemberTests-188752871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.972s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:34:15 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-7169466c-2f69-40d1-956f-a1397e740b98 tempest-ProjectMemberTests-188752871 None] Create snapshot completed successfully Aug 05 10:34:15 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-4c9109d5-29fe-4feb-8ba2-302a9920797d tempest-ProjectMemberTests-188752871 None] Acquiring lock "cinder-4f63f401-2b8a-488d-b544-b5649f399579-delete_snapshot" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:34:15 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-4c9109d5-29fe-4feb-8ba2-302a9920797d tempest-ProjectMemberTests-188752871 None] Lock "cinder-4f63f401-2b8a-488d-b544-b5649f399579-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:34:15 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-4c9109d5-29fe-4feb-8ba2-302a9920797d tempest-ProjectMemberTests-188752871 None] Acquiring lock "cinder-quobyte-d1928350-f700-480d-b7f7-f8957fe28388" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:34:15 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-4c9109d5-29fe-4feb-8ba2-302a9920797d tempest-ProjectMemberTests-188752871 None] Lock "cinder-quobyte-d1928350-f700-480d-b7f7-f8957fe28388" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:34:15 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-4c9109d5-29fe-4feb-8ba2-302a9920797d tempest-ProjectMemberTests-188752871 None] Acquiring lock "cinder-quobyte-4f63f401-2b8a-488d-b544-b5649f399579" by "_delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:34:15 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-4c9109d5-29fe-4feb-8ba2-302a9920797d tempest-ProjectMemberTests-188752871 None] Lock "cinder-quobyte-4f63f401-2b8a-488d-b544-b5649f399579" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:34:15 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-4c9109d5-29fe-4feb-8ba2-302a9920797d tempest-ProjectMemberTests-188752871 None] Deleting offline snapshot 4f63f401-2b8a-488d-b544-b5649f399579 of volume d1928350-f700-480d-b7f7-f8957fe28388 {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:34:16 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-4c9109d5-29fe-4feb-8ba2-302a9920797d tempest-ProjectMemberTests-188752871 None] snapshot_file for this snap is: volume-d1928350-f700-480d-b7f7-f8957fe28388.4f63f401-2b8a-488d-b544-b5649f399579 {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:34:16 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[811cdbdc-b955-4871-93bd-aca71e52d9e6]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:34:16 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4c9109d5-29fe-4feb-8ba2-302a9920797d tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d1928350-f700-480d-b7f7-f8957fe28388.4f63f401-2b8a-488d-b544-b5649f399579 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:16 devstack sudo[107613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d1928350-f700-480d-b7f7-f8957fe28388.4f63f401-2b8a-488d-b544-b5649f399579 Aug 05 10:34:16 devstack sudo[107613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:16 devstack sudo[107613]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:16 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4c9109d5-29fe-4feb-8ba2-302a9920797d tempest-ProjectMemberTests-188752871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d1928350-f700-480d-b7f7-f8957fe28388.4f63f401-2b8a-488d-b544-b5649f399579" returned: 0 in 0.373s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:16 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-4c9109d5-29fe-4feb-8ba2-302a9920797d tempest-ProjectMemberTests-188752871 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1928350-f700-480d-b7f7-f8957fe28388(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88613) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:34:16 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[f794ec40-46cf-4109-8b82-72c46d472b70]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:34:16 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4c9109d5-29fe-4feb-8ba2-302a9920797d tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d1928350-f700-480d-b7f7-f8957fe28388 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:16 devstack sudo[107618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d1928350-f700-480d-b7f7-f8957fe28388 Aug 05 10:34:16 devstack sudo[107618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:16 devstack sudo[107618]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:16 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4c9109d5-29fe-4feb-8ba2-302a9920797d tempest-ProjectMemberTests-188752871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d1928350-f700-480d-b7f7-f8957fe28388" returned: 0 in 0.391s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:16 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4c9109d5-29fe-4feb-8ba2-302a9920797d tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d1928350-f700-480d-b7f7-f8957fe28388.4f63f401-2b8a-488d-b544-b5649f399579 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:16 devstack sudo[107623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d1928350-f700-480d-b7f7-f8957fe28388.4f63f401-2b8a-488d-b544-b5649f399579 Aug 05 10:34:16 devstack sudo[107623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:17 devstack sudo[107623]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4c9109d5-29fe-4feb-8ba2-302a9920797d tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d1928350-f700-480d-b7f7-f8957fe28388.4f63f401-2b8a-488d-b544-b5649f399579" returned: 0 in 0.360s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4c9109d5-29fe-4feb-8ba2-302a9920797d tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d1928350-f700-480d-b7f7-f8957fe28388.4f63f401-2b8a-488d-b544-b5649f399579 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:17 devstack sudo[107628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d1928350-f700-480d-b7f7-f8957fe28388.4f63f401-2b8a-488d-b544-b5649f399579 Aug 05 10:34:17 devstack sudo[107628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:17 devstack sudo[107628]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-4c9109d5-29fe-4feb-8ba2-302a9920797d tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d1928350-f700-480d-b7f7-f8957fe28388.4f63f401-2b8a-488d-b544-b5649f399579" returned: 0 in 0.263s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:17 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-4c9109d5-29fe-4feb-8ba2-302a9920797d tempest-ProjectMemberTests-188752871 None] Lock "cinder-quobyte-4f63f401-2b8a-488d-b544-b5649f399579" released by "_delete_snapshot" :: held 1.483s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:34:17 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-4c9109d5-29fe-4feb-8ba2-302a9920797d tempest-ProjectMemberTests-188752871 None] Lock "cinder-quobyte-d1928350-f700-480d-b7f7-f8957fe28388" released by "delete_snapshot" :: held 1.509s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:34:17 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-711a4921-3163-423d-9559-0dbdd82ba8e8 tempest-ProjectReaderTests-864194114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:34:17 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-711a4921-3163-423d-9559-0dbdd82ba8e8 tempest-ProjectReaderTests-864194114 None] Flow 'volume_create_manager' (4a3fdc70-d12e-46f9-bd6e-884cdcda44eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:34:17 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-711a4921-3163-423d-9559-0dbdd82ba8e8 tempest-ProjectReaderTests-864194114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8a4ff6b-2db2-4c64-afc5-889a8c09c234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:17 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-711a4921-3163-423d-9559-0dbdd82ba8e8 tempest-ProjectReaderTests-864194114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8a4ff6b-2db2-4c64-afc5-889a8c09c234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:34:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-919634060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f17cdf37-d4bd-4672-af3e-94299b896895,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf75f56f766645d2bd0e7291b0e56434',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:34:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:34:17Z,use_quota=True,user_id='01027e42620f4b348fda7e1a7dbf4c43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:17 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-711a4921-3163-423d-9559-0dbdd82ba8e8 tempest-ProjectReaderTests-864194114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66b2897d-e516-435a-8e4e-197335617c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:17 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-711a4921-3163-423d-9559-0dbdd82ba8e8 tempest-ProjectReaderTests-864194114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66b2897d-e516-435a-8e4e-197335617c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:17 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-711a4921-3163-423d-9559-0dbdd82ba8e8 tempest-ProjectReaderTests-864194114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d6326dc-49a0-4f9e-9629-d973a1e0ee24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:17 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-711a4921-3163-423d-9559-0dbdd82ba8e8 tempest-ProjectReaderTests-864194114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d6326dc-49a0-4f9e-9629-d973a1e0ee24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f17cdf37-d4bd-4672-af3e-94299b896895', 'volume_name': 'volume-f17cdf37-d4bd-4672-af3e-94299b896895', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:17 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-711a4921-3163-423d-9559-0dbdd82ba8e8 tempest-ProjectReaderTests-864194114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (481b9562-3979-416a-a1de-bf07a86e6e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:17 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-711a4921-3163-423d-9559-0dbdd82ba8e8 tempest-ProjectReaderTests-864194114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (481b9562-3979-416a-a1de-bf07a86e6e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:17 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-711a4921-3163-423d-9559-0dbdd82ba8e8 tempest-ProjectReaderTests-864194114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcda4441-11f6-4808-a70d-5d491f884f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:17 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-711a4921-3163-423d-9559-0dbdd82ba8e8 tempest-ProjectReaderTests-864194114 None] Volume f17cdf37-d4bd-4672-af3e-94299b896895: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f17cdf37-d4bd-4672-af3e-94299b896895', 'volume_size': 1} Aug 05 10:34:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-711a4921-3163-423d-9559-0dbdd82ba8e8 tempest-ProjectReaderTests-864194114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:34:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-711a4921-3163-423d-9559-0dbdd82ba8e8 tempest-ProjectReaderTests-864194114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:34:17 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-711a4921-3163-423d-9559-0dbdd82ba8e8 tempest-ProjectReaderTests-864194114 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:34:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-919634060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f17cdf37-d4bd-4672-af3e-94299b896895,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf75f56f766645d2bd0e7291b0e56434',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:34:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:34:17Z,use_quota=True,user_id='01027e42620f4b348fda7e1a7dbf4c43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:34:17 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-711a4921-3163-423d-9559-0dbdd82ba8e8 tempest-ProjectReaderTests-864194114 None] Creating volume f17cdf37-d4bd-4672-af3e-94299b896895 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:34:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-711a4921-3163-423d-9559-0dbdd82ba8e8 tempest-ProjectReaderTests-864194114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:34:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-711a4921-3163-423d-9559-0dbdd82ba8e8 tempest-ProjectReaderTests-864194114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:34:17 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-711a4921-3163-423d-9559-0dbdd82ba8e8 tempest-ProjectReaderTests-864194114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:34:17 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-711a4921-3163-423d-9559-0dbdd82ba8e8 tempest-ProjectReaderTests-864194114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:34:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-711a4921-3163-423d-9559-0dbdd82ba8e8 tempest-ProjectReaderTests-864194114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:34:17 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-711a4921-3163-423d-9559-0dbdd82ba8e8 tempest-ProjectReaderTests-864194114 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:34:17 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-711a4921-3163-423d-9559-0dbdd82ba8e8 tempest-ProjectReaderTests-864194114 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:34:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-711a4921-3163-423d-9559-0dbdd82ba8e8 tempest-ProjectReaderTests-864194114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f17cdf37-d4bd-4672-af3e-94299b896895 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:17 devstack sudo[107631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f17cdf37-d4bd-4672-af3e-94299b896895 1073741824 Aug 05 10:34:17 devstack sudo[107631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:17 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-4c9109d5-29fe-4feb-8ba2-302a9920797d tempest-ProjectMemberTests-188752871 None] Created reservations ['e9467930-dcdb-4cd1-913d-941ae54661e3', 'bd45d2ee-8e6f-4a8e-889f-81fd63f3f4ec', 'ec1f967a-8e79-4871-ab8e-23e92ee0bdce', '9dc295b4-20d1-4103-8d7b-c7879e2ba38d'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:34:17 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-4c9109d5-29fe-4feb-8ba2-302a9920797d tempest-ProjectMemberTests-188752871 None] Delete snapshot completed successfully. Aug 05 10:34:17 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-4c9109d5-29fe-4feb-8ba2-302a9920797d tempest-ProjectMemberTests-188752871 None] Lock "cinder-4f63f401-2b8a-488d-b544-b5649f399579-delete_snapshot" released by "delete_snapshot" :: held 1.752s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:34:17 devstack sudo[107631]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:17 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-711a4921-3163-423d-9559-0dbdd82ba8e8 tempest-ProjectReaderTests-864194114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f17cdf37-d4bd-4672-af3e-94299b896895 1073741824" returned: 0 in 0.407s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-711a4921-3163-423d-9559-0dbdd82ba8e8 tempest-ProjectReaderTests-864194114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f17cdf37-d4bd-4672-af3e-94299b896895 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:18 devstack sudo[107637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f17cdf37-d4bd-4672-af3e-94299b896895 Aug 05 10:34:18 devstack sudo[107637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:18 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-df7e4648-ad00-43fc-b883-67750437af46 tempest-ProjectMemberTests-188752871 None] Acquiring lock "cinder-d1928350-f700-480d-b7f7-f8957fe28388-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:34:18 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-df7e4648-ad00-43fc-b883-67750437af46 tempest-ProjectMemberTests-188752871 None] Lock "cinder-d1928350-f700-480d-b7f7-f8957fe28388-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:34:18 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-df7e4648-ad00-43fc-b883-67750437af46 tempest-ProjectMemberTests-188752871 None] Acquiring lock "cinder-quobyte-d1928350-f700-480d-b7f7-f8957fe28388" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:34:18 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-df7e4648-ad00-43fc-b883-67750437af46 tempest-ProjectMemberTests-188752871 None] Lock "cinder-quobyte-d1928350-f700-480d-b7f7-f8957fe28388" acquired by "delete_volume" :: waited 0.016s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:34:18 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc823b72-93d7-4db7-bc3a-0c6e1caf2d76]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:34:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-df7e4648-ad00-43fc-b883-67750437af46 tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d1928350-f700-480d-b7f7-f8957fe28388 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:18 devstack sudo[107637]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-711a4921-3163-423d-9559-0dbdd82ba8e8 tempest-ProjectReaderTests-864194114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f17cdf37-d4bd-4672-af3e-94299b896895" returned: 0 in 0.259s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:18 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-711a4921-3163-423d-9559-0dbdd82ba8e8 tempest-ProjectReaderTests-864194114 None] <== create_volume: return (703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:34:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-711a4921-3163-423d-9559-0dbdd82ba8e8 tempest-ProjectReaderTests-864194114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:34:18 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-711a4921-3163-423d-9559-0dbdd82ba8e8 tempest-ProjectReaderTests-864194114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcda4441-11f6-4808-a70d-5d491f884f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f17cdf37-d4bd-4672-af3e-94299b896895', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:18 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-711a4921-3163-423d-9559-0dbdd82ba8e8 tempest-ProjectReaderTests-864194114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ca45db9-7634-45d9-b076-4c8c66ee15fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:18 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-711a4921-3163-423d-9559-0dbdd82ba8e8 tempest-ProjectReaderTests-864194114 None] Volume volume-f17cdf37-d4bd-4672-af3e-94299b896895 (f17cdf37-d4bd-4672-af3e-94299b896895): created successfully Aug 05 10:34:18 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-711a4921-3163-423d-9559-0dbdd82ba8e8 tempest-ProjectReaderTests-864194114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ca45db9-7634-45d9-b076-4c8c66ee15fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:18 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-711a4921-3163-423d-9559-0dbdd82ba8e8 tempest-ProjectReaderTests-864194114 None] Flow 'volume_create_manager' (4a3fdc70-d12e-46f9-bd6e-884cdcda44eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:34:18 devstack sudo[107639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d1928350-f700-480d-b7f7-f8957fe28388 Aug 05 10:34:18 devstack sudo[107639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:18 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-711a4921-3163-423d-9559-0dbdd82ba8e8 tempest-ProjectReaderTests-864194114 None] Created volume successfully. Aug 05 10:34:18 devstack sudo[107639]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:18 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-6338340a-9f3c-4ac6-927b-663451682b22 tempest-ProjectReaderTests-864194114 None] Acquiring lock "cinder-f17cdf37-d4bd-4672-af3e-94299b896895-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:34:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-df7e4648-ad00-43fc-b883-67750437af46 tempest-ProjectMemberTests-188752871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d1928350-f700-480d-b7f7-f8957fe28388" returned: 0 in 0.393s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-df7e4648-ad00-43fc-b883-67750437af46 tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d1928350-f700-480d-b7f7-f8957fe28388 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:18 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-6338340a-9f3c-4ac6-927b-663451682b22 tempest-ProjectReaderTests-864194114 None] Lock "cinder-f17cdf37-d4bd-4672-af3e-94299b896895-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:34:18 devstack sudo[107645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d1928350-f700-480d-b7f7-f8957fe28388 Aug 05 10:34:18 devstack sudo[107645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:18 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-6338340a-9f3c-4ac6-927b-663451682b22 tempest-ProjectReaderTests-864194114 None] Acquiring lock "cinder-quobyte-f17cdf37-d4bd-4672-af3e-94299b896895" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:34:18 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-6338340a-9f3c-4ac6-927b-663451682b22 tempest-ProjectReaderTests-864194114 None] Lock "cinder-quobyte-f17cdf37-d4bd-4672-af3e-94299b896895" acquired by "delete_volume" :: waited 0.019s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:34:18 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2916464-bc46-49e6-9ba4-feaef0acab05]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:34:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6338340a-9f3c-4ac6-927b-663451682b22 tempest-ProjectReaderTests-864194114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f17cdf37-d4bd-4672-af3e-94299b896895 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:18 devstack sudo[107647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f17cdf37-d4bd-4672-af3e-94299b896895 Aug 05 10:34:18 devstack sudo[107647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:18 devstack sudo[107645]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-df7e4648-ad00-43fc-b883-67750437af46 tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-d1928350-f700-480d-b7f7-f8957fe28388" returned: 0 in 0.270s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:18 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-df7e4648-ad00-43fc-b883-67750437af46 tempest-ProjectMemberTests-188752871 None] Lock "cinder-quobyte-d1928350-f700-480d-b7f7-f8957fe28388" released by "delete_volume" :: held 0.718s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:34:18 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-df7e4648-ad00-43fc-b883-67750437af46 tempest-ProjectMemberTests-188752871 None] Created reservations ['4b7c7ba2-719a-4eea-bd09-5f79965b6831', 'bb1736c5-53ea-4741-be25-d09e94d2710b', 'f0fc136c-2fcb-46f2-b090-b3861f2e2ef9', '15ea5f6b-367b-45b8-bf98-ebd2ea79243e'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:34:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-df7e4648-ad00-43fc-b883-67750437af46 tempest-ProjectMemberTests-188752871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:34:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-df7e4648-ad00-43fc-b883-67750437af46 tempest-ProjectMemberTests-188752871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:34:18 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-df7e4648-ad00-43fc-b883-67750437af46 tempest-ProjectMemberTests-188752871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:34:18 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-df7e4648-ad00-43fc-b883-67750437af46 tempest-ProjectMemberTests-188752871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:34:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-df7e4648-ad00-43fc-b883-67750437af46 tempest-ProjectMemberTests-188752871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:34:18 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-df7e4648-ad00-43fc-b883-67750437af46 tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:19 devstack sudo[107650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:34:19 devstack sudo[107650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:19 devstack sudo[107647]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6338340a-9f3c-4ac6-927b-663451682b22 tempest-ProjectReaderTests-864194114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f17cdf37-d4bd-4672-af3e-94299b896895" returned: 0 in 0.387s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6338340a-9f3c-4ac6-927b-663451682b22 tempest-ProjectReaderTests-864194114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f17cdf37-d4bd-4672-af3e-94299b896895 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:19 devstack sudo[107655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f17cdf37-d4bd-4672-af3e-94299b896895 Aug 05 10:34:19 devstack sudo[107655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:19 devstack sudo[107650]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-df7e4648-ad00-43fc-b883-67750437af46 tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.264s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:19 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-df7e4648-ad00-43fc-b883-67750437af46 tempest-ProjectMemberTests-188752871 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:34:19 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-df7e4648-ad00-43fc-b883-67750437af46 tempest-ProjectMemberTests-188752871 None] Deleted volume successfully. Aug 05 10:34:19 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-df7e4648-ad00-43fc-b883-67750437af46 tempest-ProjectMemberTests-188752871 None] Lock "cinder-d1928350-f700-480d-b7f7-f8957fe28388-delete_volume" released by "delete_volume" :: held 1.177s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:34:19 devstack sudo[107655]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6338340a-9f3c-4ac6-927b-663451682b22 tempest-ProjectReaderTests-864194114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f17cdf37-d4bd-4672-af3e-94299b896895" returned: 0 in 0.273s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:19 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-6338340a-9f3c-4ac6-927b-663451682b22 tempest-ProjectReaderTests-864194114 None] Lock "cinder-quobyte-f17cdf37-d4bd-4672-af3e-94299b896895" released by "delete_volume" :: held 0.711s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:34:19 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-6338340a-9f3c-4ac6-927b-663451682b22 tempest-ProjectReaderTests-864194114 None] Created reservations ['70d3de6a-5111-4a33-88d0-c7d0439f8de7', '40d2fcc2-2838-4eef-9868-d2ca3e2fa6b6', 'c09c11c4-549c-47e1-af14-7220d166419d', '02febe5d-3593-4a16-8dc6-e060d1684a0f'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:34:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-6338340a-9f3c-4ac6-927b-663451682b22 tempest-ProjectReaderTests-864194114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:34:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-6338340a-9f3c-4ac6-927b-663451682b22 tempest-ProjectReaderTests-864194114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:34:19 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-6338340a-9f3c-4ac6-927b-663451682b22 tempest-ProjectReaderTests-864194114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:34:19 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-6338340a-9f3c-4ac6-927b-663451682b22 tempest-ProjectReaderTests-864194114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:34:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-6338340a-9f3c-4ac6-927b-663451682b22 tempest-ProjectReaderTests-864194114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:34:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6338340a-9f3c-4ac6-927b-663451682b22 tempest-ProjectReaderTests-864194114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:19 devstack sudo[107659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:34:19 devstack sudo[107659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:19 devstack sudo[107659]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6338340a-9f3c-4ac6-927b-663451682b22 tempest-ProjectReaderTests-864194114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.268s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:19 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-6338340a-9f3c-4ac6-927b-663451682b22 tempest-ProjectReaderTests-864194114 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:34:19 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-6338340a-9f3c-4ac6-927b-663451682b22 tempest-ProjectReaderTests-864194114 None] Deleted volume successfully. Aug 05 10:34:19 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-552cfe35-3d82-478a-a9f6-c81b0007cf2a tempest-ProjectMemberTests-188752871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:34:19 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-552cfe35-3d82-478a-a9f6-c81b0007cf2a tempest-ProjectMemberTests-188752871 None] Flow 'volume_create_manager' (0ad10cb7-9e8e-4f60-947d-2b942f52bdbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:34:19 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-552cfe35-3d82-478a-a9f6-c81b0007cf2a tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bb69f0a-b6b1-4fbf-b6f2-c4ab5d59105b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:19 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-6338340a-9f3c-4ac6-927b-663451682b22 tempest-ProjectReaderTests-864194114 None] Lock "cinder-f17cdf37-d4bd-4672-af3e-94299b896895-delete_volume" released by "delete_volume" :: held 1.224s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:34:19 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-552cfe35-3d82-478a-a9f6-c81b0007cf2a tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bb69f0a-b6b1-4fbf-b6f2-c4ab5d59105b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:34:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-846036173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d2cfd6d-9666-4279-8cea-3512cef5d239,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8da1a4df661e48a896791cae706d962d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:34:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:34:20Z,use_quota=True,user_id='7390514821a74358b20ac932df9a2ce2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:19 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-552cfe35-3d82-478a-a9f6-c81b0007cf2a tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2d34846-046b-4f2e-9f29-53426c884649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:19 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-552cfe35-3d82-478a-a9f6-c81b0007cf2a tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2d34846-046b-4f2e-9f29-53426c884649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:19 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-552cfe35-3d82-478a-a9f6-c81b0007cf2a tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d7f26f5-8ce9-4fb4-85ad-6da3b061a964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:19 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-552cfe35-3d82-478a-a9f6-c81b0007cf2a tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d7f26f5-8ce9-4fb4-85ad-6da3b061a964) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d2cfd6d-9666-4279-8cea-3512cef5d239', 'volume_name': 'volume-6d2cfd6d-9666-4279-8cea-3512cef5d239', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:19 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-552cfe35-3d82-478a-a9f6-c81b0007cf2a tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0e85d44-15ec-4ce2-85c4-1c3643318b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:19 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-552cfe35-3d82-478a-a9f6-c81b0007cf2a tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0e85d44-15ec-4ce2-85c4-1c3643318b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:19 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-552cfe35-3d82-478a-a9f6-c81b0007cf2a tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95b5ac12-2fb2-4cad-8808-1e1d07cfcf6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:19 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-552cfe35-3d82-478a-a9f6-c81b0007cf2a tempest-ProjectMemberTests-188752871 None] Volume 6d2cfd6d-9666-4279-8cea-3512cef5d239: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d2cfd6d-9666-4279-8cea-3512cef5d239', 'volume_size': 1} Aug 05 10:34:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-552cfe35-3d82-478a-a9f6-c81b0007cf2a tempest-ProjectMemberTests-188752871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:34:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-552cfe35-3d82-478a-a9f6-c81b0007cf2a tempest-ProjectMemberTests-188752871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:34:19 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-552cfe35-3d82-478a-a9f6-c81b0007cf2a tempest-ProjectMemberTests-188752871 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:34:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-846036173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d2cfd6d-9666-4279-8cea-3512cef5d239,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8da1a4df661e48a896791cae706d962d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:34:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:34:20Z,use_quota=True,user_id='7390514821a74358b20ac932df9a2ce2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:34:19 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-552cfe35-3d82-478a-a9f6-c81b0007cf2a tempest-ProjectMemberTests-188752871 None] Creating volume 6d2cfd6d-9666-4279-8cea-3512cef5d239 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:34:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-552cfe35-3d82-478a-a9f6-c81b0007cf2a tempest-ProjectMemberTests-188752871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:34:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-552cfe35-3d82-478a-a9f6-c81b0007cf2a tempest-ProjectMemberTests-188752871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:34:19 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-552cfe35-3d82-478a-a9f6-c81b0007cf2a tempest-ProjectMemberTests-188752871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:34:19 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-552cfe35-3d82-478a-a9f6-c81b0007cf2a tempest-ProjectMemberTests-188752871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:34:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-552cfe35-3d82-478a-a9f6-c81b0007cf2a tempest-ProjectMemberTests-188752871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:34:19 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-552cfe35-3d82-478a-a9f6-c81b0007cf2a tempest-ProjectMemberTests-188752871 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:34:19 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-552cfe35-3d82-478a-a9f6-c81b0007cf2a tempest-ProjectMemberTests-188752871 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:34:19 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-552cfe35-3d82-478a-a9f6-c81b0007cf2a tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6d2cfd6d-9666-4279-8cea-3512cef5d239 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:19 devstack sudo[107662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6d2cfd6d-9666-4279-8cea-3512cef5d239 1073741824 Aug 05 10:34:19 devstack sudo[107662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:20 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-d92461b1-15e6-490e-9e27-413c7aaefcff tempest-ProjectReaderTests-864194114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:34:20 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d92461b1-15e6-490e-9e27-413c7aaefcff tempest-ProjectReaderTests-864194114 None] Flow 'volume_create_manager' (fbe2ab13-d470-43af-8273-2b768cc25840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:34:20 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d92461b1-15e6-490e-9e27-413c7aaefcff tempest-ProjectReaderTests-864194114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (244efe51-8bff-4238-a6da-dfb784170270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:20 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d92461b1-15e6-490e-9e27-413c7aaefcff tempest-ProjectReaderTests-864194114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (244efe51-8bff-4238-a6da-dfb784170270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:34:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1107278569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e88cf4f-74d8-42df-afdf-c9f50d0ffc96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf75f56f766645d2bd0e7291b0e56434',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:34:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:34:20Z,use_quota=True,user_id='01027e42620f4b348fda7e1a7dbf4c43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:20 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d92461b1-15e6-490e-9e27-413c7aaefcff tempest-ProjectReaderTests-864194114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd1f78fd-288e-4ae6-88ab-700655ea532a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:20 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d92461b1-15e6-490e-9e27-413c7aaefcff tempest-ProjectReaderTests-864194114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd1f78fd-288e-4ae6-88ab-700655ea532a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:20 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d92461b1-15e6-490e-9e27-413c7aaefcff tempest-ProjectReaderTests-864194114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56f13101-130c-4357-afa1-bb336c38e415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:20 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d92461b1-15e6-490e-9e27-413c7aaefcff tempest-ProjectReaderTests-864194114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56f13101-130c-4357-afa1-bb336c38e415) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e88cf4f-74d8-42df-afdf-c9f50d0ffc96', 'volume_name': 'volume-8e88cf4f-74d8-42df-afdf-c9f50d0ffc96', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:20 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d92461b1-15e6-490e-9e27-413c7aaefcff tempest-ProjectReaderTests-864194114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a344eb0-127b-45ff-892b-95325328e205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:20 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d92461b1-15e6-490e-9e27-413c7aaefcff tempest-ProjectReaderTests-864194114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a344eb0-127b-45ff-892b-95325328e205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:20 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d92461b1-15e6-490e-9e27-413c7aaefcff tempest-ProjectReaderTests-864194114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65776701-f110-4fef-85ba-2662e7016ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:20 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-d92461b1-15e6-490e-9e27-413c7aaefcff tempest-ProjectReaderTests-864194114 None] Volume 8e88cf4f-74d8-42df-afdf-c9f50d0ffc96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e88cf4f-74d8-42df-afdf-c9f50d0ffc96', 'volume_size': 1} Aug 05 10:34:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-d92461b1-15e6-490e-9e27-413c7aaefcff tempest-ProjectReaderTests-864194114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:34:20 devstack sudo[107662]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-552cfe35-3d82-478a-a9f6-c81b0007cf2a tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6d2cfd6d-9666-4279-8cea-3512cef5d239 1073741824" returned: 0 in 0.441s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-552cfe35-3d82-478a-a9f6-c81b0007cf2a tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6d2cfd6d-9666-4279-8cea-3512cef5d239 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:20 devstack sudo[107668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6d2cfd6d-9666-4279-8cea-3512cef5d239 Aug 05 10:34:20 devstack sudo[107668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:20 devstack sudo[107668]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-552cfe35-3d82-478a-a9f6-c81b0007cf2a tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6d2cfd6d-9666-4279-8cea-3512cef5d239" returned: 0 in 0.247s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:20 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-552cfe35-3d82-478a-a9f6-c81b0007cf2a tempest-ProjectMemberTests-188752871 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:34:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-552cfe35-3d82-478a-a9f6-c81b0007cf2a tempest-ProjectMemberTests-188752871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:34:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-d92461b1-15e6-490e-9e27-413c7aaefcff tempest-ProjectReaderTests-864194114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.327s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:34:20 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-d92461b1-15e6-490e-9e27-413c7aaefcff tempest-ProjectReaderTests-864194114 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:34:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1107278569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e88cf4f-74d8-42df-afdf-c9f50d0ffc96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf75f56f766645d2bd0e7291b0e56434',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:34:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:34:20Z,use_quota=True,user_id='01027e42620f4b348fda7e1a7dbf4c43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:34:20 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-d92461b1-15e6-490e-9e27-413c7aaefcff tempest-ProjectReaderTests-864194114 None] Creating volume 8e88cf4f-74d8-42df-afdf-c9f50d0ffc96 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:34:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-d92461b1-15e6-490e-9e27-413c7aaefcff tempest-ProjectReaderTests-864194114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:34:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-d92461b1-15e6-490e-9e27-413c7aaefcff tempest-ProjectReaderTests-864194114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:34:20 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-d92461b1-15e6-490e-9e27-413c7aaefcff tempest-ProjectReaderTests-864194114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:34:20 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-d92461b1-15e6-490e-9e27-413c7aaefcff tempest-ProjectReaderTests-864194114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:34:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-d92461b1-15e6-490e-9e27-413c7aaefcff tempest-ProjectReaderTests-864194114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:34:20 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-d92461b1-15e6-490e-9e27-413c7aaefcff tempest-ProjectReaderTests-864194114 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:34:20 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-d92461b1-15e6-490e-9e27-413c7aaefcff tempest-ProjectReaderTests-864194114 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:34:20 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d92461b1-15e6-490e-9e27-413c7aaefcff tempest-ProjectReaderTests-864194114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e88cf4f-74d8-42df-afdf-c9f50d0ffc96 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:20 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-552cfe35-3d82-478a-a9f6-c81b0007cf2a tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95b5ac12-2fb2-4cad-8808-1e1d07cfcf6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d2cfd6d-9666-4279-8cea-3512cef5d239', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:20 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-552cfe35-3d82-478a-a9f6-c81b0007cf2a tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (895873e8-87b5-43e1-a4a3-b654858a8abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:20 devstack sudo[107671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e88cf4f-74d8-42df-afdf-c9f50d0ffc96 1073741824 Aug 05 10:34:20 devstack sudo[107671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:20 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-552cfe35-3d82-478a-a9f6-c81b0007cf2a tempest-ProjectMemberTests-188752871 None] Volume volume-6d2cfd6d-9666-4279-8cea-3512cef5d239 (6d2cfd6d-9666-4279-8cea-3512cef5d239): created successfully Aug 05 10:34:20 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-552cfe35-3d82-478a-a9f6-c81b0007cf2a tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (895873e8-87b5-43e1-a4a3-b654858a8abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:20 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-552cfe35-3d82-478a-a9f6-c81b0007cf2a tempest-ProjectMemberTests-188752871 None] Flow 'volume_create_manager' (0ad10cb7-9e8e-4f60-947d-2b942f52bdbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:34:20 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-552cfe35-3d82-478a-a9f6-c81b0007cf2a tempest-ProjectMemberTests-188752871 None] Created volume successfully. Aug 05 10:34:21 devstack sudo[107671]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d92461b1-15e6-490e-9e27-413c7aaefcff tempest-ProjectReaderTests-864194114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e88cf4f-74d8-42df-afdf-c9f50d0ffc96 1073741824" returned: 0 in 0.432s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d92461b1-15e6-490e-9e27-413c7aaefcff tempest-ProjectReaderTests-864194114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e88cf4f-74d8-42df-afdf-c9f50d0ffc96 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:21 devstack sudo[107677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e88cf4f-74d8-42df-afdf-c9f50d0ffc96 Aug 05 10:34:21 devstack sudo[107677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:21 devstack sudo[107677]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d92461b1-15e6-490e-9e27-413c7aaefcff tempest-ProjectReaderTests-864194114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e88cf4f-74d8-42df-afdf-c9f50d0ffc96" returned: 0 in 0.237s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:21 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-d92461b1-15e6-490e-9e27-413c7aaefcff tempest-ProjectReaderTests-864194114 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:34:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-d92461b1-15e6-490e-9e27-413c7aaefcff tempest-ProjectReaderTests-864194114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:34:21 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d92461b1-15e6-490e-9e27-413c7aaefcff tempest-ProjectReaderTests-864194114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65776701-f110-4fef-85ba-2662e7016ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e88cf4f-74d8-42df-afdf-c9f50d0ffc96', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:21 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d92461b1-15e6-490e-9e27-413c7aaefcff tempest-ProjectReaderTests-864194114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (469820d8-5a34-41dd-93fb-2f911cda9b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:21 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-d92461b1-15e6-490e-9e27-413c7aaefcff tempest-ProjectReaderTests-864194114 None] Volume volume-8e88cf4f-74d8-42df-afdf-c9f50d0ffc96 (8e88cf4f-74d8-42df-afdf-c9f50d0ffc96): created successfully Aug 05 10:34:21 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d92461b1-15e6-490e-9e27-413c7aaefcff tempest-ProjectReaderTests-864194114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (469820d8-5a34-41dd-93fb-2f911cda9b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:21 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-d92461b1-15e6-490e-9e27-413c7aaefcff tempest-ProjectReaderTests-864194114 None] Flow 'volume_create_manager' (fbe2ab13-d470-43af-8273-2b768cc25840) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:34:21 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-d92461b1-15e6-490e-9e27-413c7aaefcff tempest-ProjectReaderTests-864194114 None] Created volume successfully. Aug 05 10:34:21 devstack cinder-volume[88613]: DEBUG oslo_service.periodic_task [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88613) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:34:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:34:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:34:21 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:34:21 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:34:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:34:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:21 devstack sudo[107680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:34:21 devstack sudo[107680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-47920254-9642-4a33-bca9-0dd3880ea2cc tempest-ProjectMemberTests-188752871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:34:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-47920254-9642-4a33-bca9-0dd3880ea2cc tempest-ProjectMemberTests-188752871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:34:22 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-47920254-9642-4a33-bca9-0dd3880ea2cc tempest-ProjectMemberTests-188752871 None] Creating offline snapshot 460c9009-58c1-4416-bf0a-90688a75697c of volume 6d2cfd6d-9666-4279-8cea-3512cef5d239 {{(pid=88613) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:34:22 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[19746b0e-67dc-4c1b-bdb5-d995006bdeb2]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:34:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-47920254-9642-4a33-bca9-0dd3880ea2cc tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6d2cfd6d-9666-4279-8cea-3512cef5d239 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:22 devstack sudo[107680]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.261s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:22 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:34:22 devstack cinder-volume[88613]: DEBUG oslo_service.periodic_task [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Running periodic task VolumeManager._thread_info {{(pid=88613) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:34:22 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] thread count: 29 {{(pid=88613) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 10:34:22 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] thread info: [<_MainThread(MainThread, started 126173666128000)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88613) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 10:34:22 devstack sudo[107683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6d2cfd6d-9666-4279-8cea-3512cef5d239 Aug 05 10:34:22 devstack sudo[107683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:22 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-a4dcada9-62d6-4177-b949-3ec550a37145 tempest-ProjectReaderTests-864194114 None] Acquiring lock "cinder-8e88cf4f-74d8-42df-afdf-c9f50d0ffc96-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:34:22 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-a4dcada9-62d6-4177-b949-3ec550a37145 tempest-ProjectReaderTests-864194114 None] Lock "cinder-8e88cf4f-74d8-42df-afdf-c9f50d0ffc96-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:34:22 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-a4dcada9-62d6-4177-b949-3ec550a37145 tempest-ProjectReaderTests-864194114 None] Acquiring lock "cinder-quobyte-8e88cf4f-74d8-42df-afdf-c9f50d0ffc96" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:34:22 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-a4dcada9-62d6-4177-b949-3ec550a37145 tempest-ProjectReaderTests-864194114 None] Lock "cinder-quobyte-8e88cf4f-74d8-42df-afdf-c9f50d0ffc96" acquired by "delete_volume" :: waited 0.016s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:34:22 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa17915-cefd-4ae8-a8a9-338a77344de7]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:34:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a4dcada9-62d6-4177-b949-3ec550a37145 tempest-ProjectReaderTests-864194114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e88cf4f-74d8-42df-afdf-c9f50d0ffc96 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:22 devstack sudo[107683]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-47920254-9642-4a33-bca9-0dd3880ea2cc tempest-ProjectMemberTests-188752871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6d2cfd6d-9666-4279-8cea-3512cef5d239" returned: 0 in 0.405s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-47920254-9642-4a33-bca9-0dd3880ea2cc tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6d2cfd6d-9666-4279-8cea-3512cef5d239,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6d2cfd6d-9666-4279-8cea-3512cef5d239.460c9009-58c1-4416-bf0a-90688a75697c 1G {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:22 devstack sudo[107689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6d2cfd6d-9666-4279-8cea-3512cef5d239,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6d2cfd6d-9666-4279-8cea-3512cef5d239.460c9009-58c1-4416-bf0a-90688a75697c 1G Aug 05 10:34:22 devstack sudo[107689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:22 devstack sudo[107688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e88cf4f-74d8-42df-afdf-c9f50d0ffc96 Aug 05 10:34:22 devstack sudo[107688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:22 devstack sudo[107688]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a4dcada9-62d6-4177-b949-3ec550a37145 tempest-ProjectReaderTests-864194114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e88cf4f-74d8-42df-afdf-c9f50d0ffc96" returned: 0 in 0.397s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a4dcada9-62d6-4177-b949-3ec550a37145 tempest-ProjectReaderTests-864194114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e88cf4f-74d8-42df-afdf-c9f50d0ffc96 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:22 devstack sudo[107689]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-47920254-9642-4a33-bca9-0dd3880ea2cc tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6d2cfd6d-9666-4279-8cea-3512cef5d239,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6d2cfd6d-9666-4279-8cea-3512cef5d239.460c9009-58c1-4416-bf0a-90688a75697c 1G" returned: 0 in 0.410s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-47920254-9642-4a33-bca9-0dd3880ea2cc tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d2cfd6d-9666-4279-8cea-3512cef5d239 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6d2cfd6d-9666-4279-8cea-3512cef5d239.460c9009-58c1-4416-bf0a-90688a75697c {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:22 devstack sudo[107699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e88cf4f-74d8-42df-afdf-c9f50d0ffc96 Aug 05 10:34:22 devstack sudo[107699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:22 devstack sudo[107701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d2cfd6d-9666-4279-8cea-3512cef5d239 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6d2cfd6d-9666-4279-8cea-3512cef5d239.460c9009-58c1-4416-bf0a-90688a75697c Aug 05 10:34:22 devstack sudo[107701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:23 devstack sudo[107699]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a4dcada9-62d6-4177-b949-3ec550a37145 tempest-ProjectReaderTests-864194114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8e88cf4f-74d8-42df-afdf-c9f50d0ffc96" returned: 0 in 0.268s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:23 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-a4dcada9-62d6-4177-b949-3ec550a37145 tempest-ProjectReaderTests-864194114 None] Lock "cinder-quobyte-8e88cf4f-74d8-42df-afdf-c9f50d0ffc96" released by "delete_volume" :: held 0.700s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:34:23 devstack sudo[107701]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-47920254-9642-4a33-bca9-0dd3880ea2cc tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d2cfd6d-9666-4279-8cea-3512cef5d239 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6d2cfd6d-9666-4279-8cea-3512cef5d239.460c9009-58c1-4416-bf0a-90688a75697c" returned: 0 in 0.301s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:23 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-47920254-9642-4a33-bca9-0dd3880ea2cc tempest-ProjectMemberTests-188752871 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6d2cfd6d-9666-4279-8cea-3512cef5d239.460c9009-58c1-4416-bf0a-90688a75697c is being set with open permissions: ugo+rw Aug 05 10:34:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-47920254-9642-4a33-bca9-0dd3880ea2cc tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6d2cfd6d-9666-4279-8cea-3512cef5d239.460c9009-58c1-4416-bf0a-90688a75697c {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:23 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-a4dcada9-62d6-4177-b949-3ec550a37145 tempest-ProjectReaderTests-864194114 None] Created reservations ['2111e3c8-5b1f-4f9b-a9ce-604ed94d476a', '71bfd34b-57ff-4657-aa9b-09ee026d5226', '98ab793e-d3a4-436f-8157-ec6abd25fda3', 'b3f35577-924c-4ce8-946f-601340fdedbb'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:34:23 devstack sudo[107708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6d2cfd6d-9666-4279-8cea-3512cef5d239.460c9009-58c1-4416-bf0a-90688a75697c Aug 05 10:34:23 devstack sudo[107708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a4dcada9-62d6-4177-b949-3ec550a37145 tempest-ProjectReaderTests-864194114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:34:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a4dcada9-62d6-4177-b949-3ec550a37145 tempest-ProjectReaderTests-864194114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:34:23 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-a4dcada9-62d6-4177-b949-3ec550a37145 tempest-ProjectReaderTests-864194114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:34:23 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-a4dcada9-62d6-4177-b949-3ec550a37145 tempest-ProjectReaderTests-864194114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:34:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-a4dcada9-62d6-4177-b949-3ec550a37145 tempest-ProjectReaderTests-864194114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:34:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a4dcada9-62d6-4177-b949-3ec550a37145 tempest-ProjectReaderTests-864194114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:23 devstack sudo[107710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:34:23 devstack sudo[107710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:23 devstack sudo[107708]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-47920254-9642-4a33-bca9-0dd3880ea2cc tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6d2cfd6d-9666-4279-8cea-3512cef5d239.460c9009-58c1-4416-bf0a-90688a75697c" returned: 0 in 0.257s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-47920254-9642-4a33-bca9-0dd3880ea2cc tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6d2cfd6d-9666-4279-8cea-3512cef5d239.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:23 devstack sudo[107714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6d2cfd6d-9666-4279-8cea-3512cef5d239.info Aug 05 10:34:23 devstack sudo[107714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:23 devstack sudo[107710]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-a4dcada9-62d6-4177-b949-3ec550a37145 tempest-ProjectReaderTests-864194114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.257s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:23 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-a4dcada9-62d6-4177-b949-3ec550a37145 tempest-ProjectReaderTests-864194114 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:34:23 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-a4dcada9-62d6-4177-b949-3ec550a37145 tempest-ProjectReaderTests-864194114 None] Deleted volume successfully. Aug 05 10:34:23 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-a4dcada9-62d6-4177-b949-3ec550a37145 tempest-ProjectReaderTests-864194114 None] Lock "cinder-8e88cf4f-74d8-42df-afdf-c9f50d0ffc96-delete_volume" released by "delete_volume" :: held 1.190s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:34:23 devstack sudo[107714]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-47920254-9642-4a33-bca9-0dd3880ea2cc tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6d2cfd6d-9666-4279-8cea-3512cef5d239.info" returned: 0 in 0.286s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:23 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-47920254-9642-4a33-bca9-0dd3880ea2cc tempest-ProjectMemberTests-188752871 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6d2cfd6d-9666-4279-8cea-3512cef5d239.info is being set with open permissions: ugo+rw Aug 05 10:34:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-47920254-9642-4a33-bca9-0dd3880ea2cc tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6d2cfd6d-9666-4279-8cea-3512cef5d239.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:23 devstack sudo[107717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6d2cfd6d-9666-4279-8cea-3512cef5d239.info Aug 05 10:34:23 devstack sudo[107717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:23 devstack sudo[107717]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-47920254-9642-4a33-bca9-0dd3880ea2cc tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6d2cfd6d-9666-4279-8cea-3512cef5d239.info" returned: 0 in 0.253s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:23 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-47920254-9642-4a33-bca9-0dd3880ea2cc tempest-ProjectMemberTests-188752871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.004s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:34:24 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-47920254-9642-4a33-bca9-0dd3880ea2cc tempest-ProjectMemberTests-188752871 None] Create snapshot completed successfully Aug 05 10:34:25 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-bddfc534-6a0a-4264-80ed-a578298a1c83 tempest-ProjectMemberTests-188752871 None] Acquiring lock "cinder-460c9009-58c1-4416-bf0a-90688a75697c-delete_snapshot" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:34:25 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-bddfc534-6a0a-4264-80ed-a578298a1c83 tempest-ProjectMemberTests-188752871 None] Lock "cinder-460c9009-58c1-4416-bf0a-90688a75697c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:34:25 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-bddfc534-6a0a-4264-80ed-a578298a1c83 tempest-ProjectMemberTests-188752871 None] Acquiring lock "cinder-quobyte-6d2cfd6d-9666-4279-8cea-3512cef5d239" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:34:25 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-bddfc534-6a0a-4264-80ed-a578298a1c83 tempest-ProjectMemberTests-188752871 None] Lock "cinder-quobyte-6d2cfd6d-9666-4279-8cea-3512cef5d239" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:34:25 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-bddfc534-6a0a-4264-80ed-a578298a1c83 tempest-ProjectMemberTests-188752871 None] Acquiring lock "cinder-quobyte-460c9009-58c1-4416-bf0a-90688a75697c" by "_delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:34:25 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-bddfc534-6a0a-4264-80ed-a578298a1c83 tempest-ProjectMemberTests-188752871 None] Lock "cinder-quobyte-460c9009-58c1-4416-bf0a-90688a75697c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:34:25 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-bddfc534-6a0a-4264-80ed-a578298a1c83 tempest-ProjectMemberTests-188752871 None] Deleting offline snapshot 460c9009-58c1-4416-bf0a-90688a75697c of volume 6d2cfd6d-9666-4279-8cea-3512cef5d239 {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:34:25 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-bddfc534-6a0a-4264-80ed-a578298a1c83 tempest-ProjectMemberTests-188752871 None] snapshot_file for this snap is: volume-6d2cfd6d-9666-4279-8cea-3512cef5d239.460c9009-58c1-4416-bf0a-90688a75697c {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:34:25 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[137244a2-d231-4dc2-843d-8248ef593bf3]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:34:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-bddfc534-6a0a-4264-80ed-a578298a1c83 tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6d2cfd6d-9666-4279-8cea-3512cef5d239.460c9009-58c1-4416-bf0a-90688a75697c {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:25 devstack sudo[107721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6d2cfd6d-9666-4279-8cea-3512cef5d239.460c9009-58c1-4416-bf0a-90688a75697c Aug 05 10:34:25 devstack sudo[107721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:25 devstack sudo[107721]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-bddfc534-6a0a-4264-80ed-a578298a1c83 tempest-ProjectMemberTests-188752871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6d2cfd6d-9666-4279-8cea-3512cef5d239.460c9009-58c1-4416-bf0a-90688a75697c" returned: 0 in 0.380s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:25 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-bddfc534-6a0a-4264-80ed-a578298a1c83 tempest-ProjectMemberTests-188752871 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d2cfd6d-9666-4279-8cea-3512cef5d239(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88613) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:34:25 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[254213a4-3c26-4a60-b516-f82b54e70c06]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:34:25 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-bddfc534-6a0a-4264-80ed-a578298a1c83 tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6d2cfd6d-9666-4279-8cea-3512cef5d239 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:25 devstack sudo[107726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6d2cfd6d-9666-4279-8cea-3512cef5d239 Aug 05 10:34:25 devstack sudo[107726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:26 devstack sudo[107726]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:26 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-bddfc534-6a0a-4264-80ed-a578298a1c83 tempest-ProjectMemberTests-188752871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6d2cfd6d-9666-4279-8cea-3512cef5d239" returned: 0 in 0.395s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:26 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-bddfc534-6a0a-4264-80ed-a578298a1c83 tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6d2cfd6d-9666-4279-8cea-3512cef5d239.460c9009-58c1-4416-bf0a-90688a75697c {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:26 devstack sudo[107731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6d2cfd6d-9666-4279-8cea-3512cef5d239.460c9009-58c1-4416-bf0a-90688a75697c Aug 05 10:34:26 devstack sudo[107731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:26 devstack sudo[107731]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:26 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-bddfc534-6a0a-4264-80ed-a578298a1c83 tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6d2cfd6d-9666-4279-8cea-3512cef5d239.460c9009-58c1-4416-bf0a-90688a75697c" returned: 0 in 0.369s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:26 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-bddfc534-6a0a-4264-80ed-a578298a1c83 tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6d2cfd6d-9666-4279-8cea-3512cef5d239.460c9009-58c1-4416-bf0a-90688a75697c {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:26 devstack sudo[107737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6d2cfd6d-9666-4279-8cea-3512cef5d239.460c9009-58c1-4416-bf0a-90688a75697c Aug 05 10:34:26 devstack sudo[107737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:26 devstack sudo[107737]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:26 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-bddfc534-6a0a-4264-80ed-a578298a1c83 tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6d2cfd6d-9666-4279-8cea-3512cef5d239.460c9009-58c1-4416-bf0a-90688a75697c" returned: 0 in 0.283s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:26 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-bddfc534-6a0a-4264-80ed-a578298a1c83 tempest-ProjectMemberTests-188752871 None] Lock "cinder-quobyte-460c9009-58c1-4416-bf0a-90688a75697c" released by "_delete_snapshot" :: held 1.531s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:34:26 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-bddfc534-6a0a-4264-80ed-a578298a1c83 tempest-ProjectMemberTests-188752871 None] Lock "cinder-quobyte-6d2cfd6d-9666-4279-8cea-3512cef5d239" released by "delete_snapshot" :: held 1.553s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:34:26 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-bddfc534-6a0a-4264-80ed-a578298a1c83 tempest-ProjectMemberTests-188752871 None] Created reservations ['5559bc8e-f492-4363-bca7-08101b20ecc5', '30a91a47-da0c-4f9e-8df8-b932e2aa4982', '037f2e0d-8400-410e-8305-9dde1991abaa', '4b0206a2-81e7-4845-966e-1da7846aae66'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:34:26 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-bddfc534-6a0a-4264-80ed-a578298a1c83 tempest-ProjectMemberTests-188752871 None] Delete snapshot completed successfully. Aug 05 10:34:26 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-bddfc534-6a0a-4264-80ed-a578298a1c83 tempest-ProjectMemberTests-188752871 None] Lock "cinder-460c9009-58c1-4416-bf0a-90688a75697c-delete_snapshot" released by "delete_snapshot" :: held 1.708s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:34:27 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e856051e-2573-4ddc-87b9-81ecbadcd13b tempest-ProjectMemberTests-188752871 None] Acquiring lock "cinder-6d2cfd6d-9666-4279-8cea-3512cef5d239-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:34:27 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e856051e-2573-4ddc-87b9-81ecbadcd13b tempest-ProjectMemberTests-188752871 None] Lock "cinder-6d2cfd6d-9666-4279-8cea-3512cef5d239-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:34:27 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e856051e-2573-4ddc-87b9-81ecbadcd13b tempest-ProjectMemberTests-188752871 None] Acquiring lock "cinder-quobyte-6d2cfd6d-9666-4279-8cea-3512cef5d239" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:34:27 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e856051e-2573-4ddc-87b9-81ecbadcd13b tempest-ProjectMemberTests-188752871 None] Lock "cinder-quobyte-6d2cfd6d-9666-4279-8cea-3512cef5d239" acquired by "delete_volume" :: waited 0.019s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:34:27 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa5b2ac-b387-4199-81ce-4394c4cd219a]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:34:27 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e856051e-2573-4ddc-87b9-81ecbadcd13b tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6d2cfd6d-9666-4279-8cea-3512cef5d239 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:27 devstack sudo[107740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6d2cfd6d-9666-4279-8cea-3512cef5d239 Aug 05 10:34:27 devstack sudo[107740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:27 devstack sudo[107740]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:27 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e856051e-2573-4ddc-87b9-81ecbadcd13b tempest-ProjectMemberTests-188752871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6d2cfd6d-9666-4279-8cea-3512cef5d239" returned: 0 in 0.395s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:27 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e856051e-2573-4ddc-87b9-81ecbadcd13b tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6d2cfd6d-9666-4279-8cea-3512cef5d239 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:27 devstack sudo[107745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6d2cfd6d-9666-4279-8cea-3512cef5d239 Aug 05 10:34:27 devstack sudo[107745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:28 devstack sudo[107745]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:28 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e856051e-2573-4ddc-87b9-81ecbadcd13b tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-6d2cfd6d-9666-4279-8cea-3512cef5d239" returned: 0 in 0.269s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:28 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e856051e-2573-4ddc-87b9-81ecbadcd13b tempest-ProjectMemberTests-188752871 None] Lock "cinder-quobyte-6d2cfd6d-9666-4279-8cea-3512cef5d239" released by "delete_volume" :: held 0.729s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:34:28 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-e856051e-2573-4ddc-87b9-81ecbadcd13b tempest-ProjectMemberTests-188752871 None] Created reservations ['57e2229b-9e18-4be3-ad1e-55be99ecae1b', 'd4764442-d22b-4028-ae24-705eed75009e', '8c9a8574-e731-420e-9b86-ed26c34c437b', '02f39fbc-262f-41b7-9be5-8c0ab01abc00'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:34:28 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-e856051e-2573-4ddc-87b9-81ecbadcd13b tempest-ProjectMemberTests-188752871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:34:28 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-e856051e-2573-4ddc-87b9-81ecbadcd13b tempest-ProjectMemberTests-188752871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:34:28 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-e856051e-2573-4ddc-87b9-81ecbadcd13b tempest-ProjectMemberTests-188752871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:34:28 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-e856051e-2573-4ddc-87b9-81ecbadcd13b tempest-ProjectMemberTests-188752871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:34:28 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-e856051e-2573-4ddc-87b9-81ecbadcd13b tempest-ProjectMemberTests-188752871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:34:28 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e856051e-2573-4ddc-87b9-81ecbadcd13b tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:28 devstack sudo[107748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:34:28 devstack sudo[107748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:28 devstack sudo[107748]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:28 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e856051e-2573-4ddc-87b9-81ecbadcd13b tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.280s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:28 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-e856051e-2573-4ddc-87b9-81ecbadcd13b tempest-ProjectMemberTests-188752871 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:34:28 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-e856051e-2573-4ddc-87b9-81ecbadcd13b tempest-ProjectMemberTests-188752871 None] Deleted volume successfully. Aug 05 10:34:28 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e856051e-2573-4ddc-87b9-81ecbadcd13b tempest-ProjectMemberTests-188752871 None] Lock "cinder-6d2cfd6d-9666-4279-8cea-3512cef5d239-delete_volume" released by "delete_volume" :: held 1.218s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:34:28 devstack cinder-volume[88613]: DEBUG dbcounter [-] [88613] Writing DB stats cinder:UPDATE=254,cinder:DELETE=28,cinder:INSERT=70,cinder:SELECT=197 {{(pid=88613) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:34:28 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d60a975-355c-4b36-b9e8-f4b553f8e5f7 tempest-ProjectMemberTests-188752871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:34:29 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3d60a975-355c-4b36-b9e8-f4b553f8e5f7 tempest-ProjectMemberTests-188752871 None] Flow 'volume_create_manager' (e87e4576-ca54-4e53-b3af-3d5e759261c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:34:29 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3d60a975-355c-4b36-b9e8-f4b553f8e5f7 tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcaf86f0-64a7-4749-b916-33404e7129aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:29 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3d60a975-355c-4b36-b9e8-f4b553f8e5f7 tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcaf86f0-64a7-4749-b916-33404e7129aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:34:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1562698902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5849bd8-c431-4038-be67-bc0b50159c65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8da1a4df661e48a896791cae706d962d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:34:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:34:29Z,use_quota=True,user_id='7390514821a74358b20ac932df9a2ce2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:29 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3d60a975-355c-4b36-b9e8-f4b553f8e5f7 tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5c0c538-7d48-4da9-a5a5-97b5ca927d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:29 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3d60a975-355c-4b36-b9e8-f4b553f8e5f7 tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5c0c538-7d48-4da9-a5a5-97b5ca927d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:29 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3d60a975-355c-4b36-b9e8-f4b553f8e5f7 tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee9678b8-117b-476b-9980-6088ed050f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:29 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3d60a975-355c-4b36-b9e8-f4b553f8e5f7 tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee9678b8-117b-476b-9980-6088ed050f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5849bd8-c431-4038-be67-bc0b50159c65', 'volume_name': 'volume-e5849bd8-c431-4038-be67-bc0b50159c65', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:29 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3d60a975-355c-4b36-b9e8-f4b553f8e5f7 tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4d800c2-bf31-4fa6-9e3e-19c538ca260f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:29 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3d60a975-355c-4b36-b9e8-f4b553f8e5f7 tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4d800c2-bf31-4fa6-9e3e-19c538ca260f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:29 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3d60a975-355c-4b36-b9e8-f4b553f8e5f7 tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05889686-de8b-46ef-a717-45ba8ab34f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:29 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-3d60a975-355c-4b36-b9e8-f4b553f8e5f7 tempest-ProjectMemberTests-188752871 None] Volume e5849bd8-c431-4038-be67-bc0b50159c65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5849bd8-c431-4038-be67-bc0b50159c65', 'volume_size': 1} Aug 05 10:34:29 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-3d60a975-355c-4b36-b9e8-f4b553f8e5f7 tempest-ProjectMemberTests-188752871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:34:29 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-3d60a975-355c-4b36-b9e8-f4b553f8e5f7 tempest-ProjectMemberTests-188752871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:34:29 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-3d60a975-355c-4b36-b9e8-f4b553f8e5f7 tempest-ProjectMemberTests-188752871 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:34:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1562698902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5849bd8-c431-4038-be67-bc0b50159c65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8da1a4df661e48a896791cae706d962d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:34:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:34:29Z,use_quota=True,user_id='7390514821a74358b20ac932df9a2ce2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:34:29 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-3d60a975-355c-4b36-b9e8-f4b553f8e5f7 tempest-ProjectMemberTests-188752871 None] Creating volume e5849bd8-c431-4038-be67-bc0b50159c65 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:34:29 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-3d60a975-355c-4b36-b9e8-f4b553f8e5f7 tempest-ProjectMemberTests-188752871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:34:29 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-3d60a975-355c-4b36-b9e8-f4b553f8e5f7 tempest-ProjectMemberTests-188752871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:34:29 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-3d60a975-355c-4b36-b9e8-f4b553f8e5f7 tempest-ProjectMemberTests-188752871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:34:29 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-3d60a975-355c-4b36-b9e8-f4b553f8e5f7 tempest-ProjectMemberTests-188752871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:34:29 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-3d60a975-355c-4b36-b9e8-f4b553f8e5f7 tempest-ProjectMemberTests-188752871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:34:29 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-3d60a975-355c-4b36-b9e8-f4b553f8e5f7 tempest-ProjectMemberTests-188752871 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:34:29 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-3d60a975-355c-4b36-b9e8-f4b553f8e5f7 tempest-ProjectMemberTests-188752871 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:34:29 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3d60a975-355c-4b36-b9e8-f4b553f8e5f7 tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5849bd8-c431-4038-be67-bc0b50159c65 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:29 devstack sudo[107751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5849bd8-c431-4038-be67-bc0b50159c65 1073741824 Aug 05 10:34:29 devstack sudo[107751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:29 devstack sudo[107751]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:29 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3d60a975-355c-4b36-b9e8-f4b553f8e5f7 tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5849bd8-c431-4038-be67-bc0b50159c65 1073741824" returned: 0 in 0.460s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:29 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3d60a975-355c-4b36-b9e8-f4b553f8e5f7 tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5849bd8-c431-4038-be67-bc0b50159c65 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:29 devstack sudo[107757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5849bd8-c431-4038-be67-bc0b50159c65 Aug 05 10:34:29 devstack sudo[107757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:29 devstack sudo[107757]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:29 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-3d60a975-355c-4b36-b9e8-f4b553f8e5f7 tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5849bd8-c431-4038-be67-bc0b50159c65" returned: 0 in 0.253s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:29 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-3d60a975-355c-4b36-b9e8-f4b553f8e5f7 tempest-ProjectMemberTests-188752871 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:34:29 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-3d60a975-355c-4b36-b9e8-f4b553f8e5f7 tempest-ProjectMemberTests-188752871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:34:29 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3d60a975-355c-4b36-b9e8-f4b553f8e5f7 tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05889686-de8b-46ef-a717-45ba8ab34f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5849bd8-c431-4038-be67-bc0b50159c65', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:29 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3d60a975-355c-4b36-b9e8-f4b553f8e5f7 tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d638dee4-1bd0-4928-94ca-72e94842cb02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:29 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-3d60a975-355c-4b36-b9e8-f4b553f8e5f7 tempest-ProjectMemberTests-188752871 None] Volume volume-e5849bd8-c431-4038-be67-bc0b50159c65 (e5849bd8-c431-4038-be67-bc0b50159c65): created successfully Aug 05 10:34:29 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3d60a975-355c-4b36-b9e8-f4b553f8e5f7 tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d638dee4-1bd0-4928-94ca-72e94842cb02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:29 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-3d60a975-355c-4b36-b9e8-f4b553f8e5f7 tempest-ProjectMemberTests-188752871 None] Flow 'volume_create_manager' (e87e4576-ca54-4e53-b3af-3d5e759261c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:34:29 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-3d60a975-355c-4b36-b9e8-f4b553f8e5f7 tempest-ProjectMemberTests-188752871 None] Created volume successfully. Aug 05 10:34:31 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-b5084b78-c12d-45f5-8280-6bf40c610e21 tempest-ProjectMemberTests-188752871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:34:31 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-b5084b78-c12d-45f5-8280-6bf40c610e21 tempest-ProjectMemberTests-188752871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:34:31 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-b5084b78-c12d-45f5-8280-6bf40c610e21 tempest-ProjectMemberTests-188752871 None] Creating offline snapshot 9cbc97bd-d599-43c6-b007-70f80bdfaaca of volume e5849bd8-c431-4038-be67-bc0b50159c65 {{(pid=88613) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:34:31 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[545fdeb6-f132-4d60-9e04-b43a44bf36a7]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:34:31 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b5084b78-c12d-45f5-8280-6bf40c610e21 tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5849bd8-c431-4038-be67-bc0b50159c65 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:31 devstack sudo[107760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5849bd8-c431-4038-be67-bc0b50159c65 Aug 05 10:34:31 devstack sudo[107760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:31 devstack sudo[107760]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:31 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b5084b78-c12d-45f5-8280-6bf40c610e21 tempest-ProjectMemberTests-188752871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5849bd8-c431-4038-be67-bc0b50159c65" returned: 0 in 0.396s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:31 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b5084b78-c12d-45f5-8280-6bf40c610e21 tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5849bd8-c431-4038-be67-bc0b50159c65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5849bd8-c431-4038-be67-bc0b50159c65.9cbc97bd-d599-43c6-b007-70f80bdfaaca 1G {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:31 devstack sudo[107765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5849bd8-c431-4038-be67-bc0b50159c65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5849bd8-c431-4038-be67-bc0b50159c65.9cbc97bd-d599-43c6-b007-70f80bdfaaca 1G Aug 05 10:34:31 devstack sudo[107765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:32 devstack sudo[107765]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:32 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b5084b78-c12d-45f5-8280-6bf40c610e21 tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5849bd8-c431-4038-be67-bc0b50159c65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5849bd8-c431-4038-be67-bc0b50159c65.9cbc97bd-d599-43c6-b007-70f80bdfaaca 1G" returned: 0 in 0.522s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:32 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b5084b78-c12d-45f5-8280-6bf40c610e21 tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5849bd8-c431-4038-be67-bc0b50159c65 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5849bd8-c431-4038-be67-bc0b50159c65.9cbc97bd-d599-43c6-b007-70f80bdfaaca {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:32 devstack sudo[107771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5849bd8-c431-4038-be67-bc0b50159c65 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5849bd8-c431-4038-be67-bc0b50159c65.9cbc97bd-d599-43c6-b007-70f80bdfaaca Aug 05 10:34:32 devstack sudo[107771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:32 devstack sudo[107771]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:32 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b5084b78-c12d-45f5-8280-6bf40c610e21 tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5849bd8-c431-4038-be67-bc0b50159c65 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5849bd8-c431-4038-be67-bc0b50159c65.9cbc97bd-d599-43c6-b007-70f80bdfaaca" returned: 0 in 0.317s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:32 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-b5084b78-c12d-45f5-8280-6bf40c610e21 tempest-ProjectMemberTests-188752871 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5849bd8-c431-4038-be67-bc0b50159c65.9cbc97bd-d599-43c6-b007-70f80bdfaaca is being set with open permissions: ugo+rw Aug 05 10:34:32 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b5084b78-c12d-45f5-8280-6bf40c610e21 tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5849bd8-c431-4038-be67-bc0b50159c65.9cbc97bd-d599-43c6-b007-70f80bdfaaca {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:32 devstack sudo[107776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5849bd8-c431-4038-be67-bc0b50159c65.9cbc97bd-d599-43c6-b007-70f80bdfaaca Aug 05 10:34:32 devstack sudo[107776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:32 devstack sudo[107776]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:32 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b5084b78-c12d-45f5-8280-6bf40c610e21 tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5849bd8-c431-4038-be67-bc0b50159c65.9cbc97bd-d599-43c6-b007-70f80bdfaaca" returned: 0 in 0.286s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:32 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b5084b78-c12d-45f5-8280-6bf40c610e21 tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5849bd8-c431-4038-be67-bc0b50159c65.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:32 devstack sudo[107779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5849bd8-c431-4038-be67-bc0b50159c65.info Aug 05 10:34:32 devstack sudo[107779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:33 devstack sudo[107779]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:33 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b5084b78-c12d-45f5-8280-6bf40c610e21 tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5849bd8-c431-4038-be67-bc0b50159c65.info" returned: 0 in 0.253s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:33 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-b5084b78-c12d-45f5-8280-6bf40c610e21 tempest-ProjectMemberTests-188752871 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5849bd8-c431-4038-be67-bc0b50159c65.info is being set with open permissions: ugo+rw Aug 05 10:34:33 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b5084b78-c12d-45f5-8280-6bf40c610e21 tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5849bd8-c431-4038-be67-bc0b50159c65.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:33 devstack sudo[107782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5849bd8-c431-4038-be67-bc0b50159c65.info Aug 05 10:34:33 devstack sudo[107782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:33 devstack sudo[107782]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:33 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b5084b78-c12d-45f5-8280-6bf40c610e21 tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5849bd8-c431-4038-be67-bc0b50159c65.info" returned: 0 in 0.264s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:33 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-b5084b78-c12d-45f5-8280-6bf40c610e21 tempest-ProjectMemberTests-188752871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.131s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:34:33 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-b5084b78-c12d-45f5-8280-6bf40c610e21 tempest-ProjectMemberTests-188752871 None] Create snapshot completed successfully Aug 05 10:34:34 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-bb526cfc-602b-4137-9cc9-2d8a1ef55355 tempest-ProjectMemberTests-188752871 None] Acquiring lock "cinder-9cbc97bd-d599-43c6-b007-70f80bdfaaca-delete_snapshot" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:34:34 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-bb526cfc-602b-4137-9cc9-2d8a1ef55355 tempest-ProjectMemberTests-188752871 None] Lock "cinder-9cbc97bd-d599-43c6-b007-70f80bdfaaca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:34:34 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-bb526cfc-602b-4137-9cc9-2d8a1ef55355 tempest-ProjectMemberTests-188752871 None] Acquiring lock "cinder-quobyte-e5849bd8-c431-4038-be67-bc0b50159c65" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:34:34 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-bb526cfc-602b-4137-9cc9-2d8a1ef55355 tempest-ProjectMemberTests-188752871 None] Lock "cinder-quobyte-e5849bd8-c431-4038-be67-bc0b50159c65" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:34:34 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-bb526cfc-602b-4137-9cc9-2d8a1ef55355 tempest-ProjectMemberTests-188752871 None] Acquiring lock "cinder-quobyte-9cbc97bd-d599-43c6-b007-70f80bdfaaca" by "_delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:34:34 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-bb526cfc-602b-4137-9cc9-2d8a1ef55355 tempest-ProjectMemberTests-188752871 None] Lock "cinder-quobyte-9cbc97bd-d599-43c6-b007-70f80bdfaaca" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:34:34 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-bb526cfc-602b-4137-9cc9-2d8a1ef55355 tempest-ProjectMemberTests-188752871 None] Deleting offline snapshot 9cbc97bd-d599-43c6-b007-70f80bdfaaca of volume e5849bd8-c431-4038-be67-bc0b50159c65 {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:34:34 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-bb526cfc-602b-4137-9cc9-2d8a1ef55355 tempest-ProjectMemberTests-188752871 None] snapshot_file for this snap is: volume-e5849bd8-c431-4038-be67-bc0b50159c65.9cbc97bd-d599-43c6-b007-70f80bdfaaca {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:34:34 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1a31dd-c8f3-4f0f-b9f2-40925346311a]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:34:34 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-bb526cfc-602b-4137-9cc9-2d8a1ef55355 tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5849bd8-c431-4038-be67-bc0b50159c65.9cbc97bd-d599-43c6-b007-70f80bdfaaca {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:34 devstack sudo[107785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5849bd8-c431-4038-be67-bc0b50159c65.9cbc97bd-d599-43c6-b007-70f80bdfaaca Aug 05 10:34:34 devstack sudo[107785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:35 devstack sudo[107785]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:35 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-bb526cfc-602b-4137-9cc9-2d8a1ef55355 tempest-ProjectMemberTests-188752871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5849bd8-c431-4038-be67-bc0b50159c65.9cbc97bd-d599-43c6-b007-70f80bdfaaca" returned: 0 in 0.479s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:35 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-bb526cfc-602b-4137-9cc9-2d8a1ef55355 tempest-ProjectMemberTests-188752871 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5849bd8-c431-4038-be67-bc0b50159c65(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88613) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:34:35 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f112d7a-ac44-4468-8afe-3e6540831d63]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:34:35 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-bb526cfc-602b-4137-9cc9-2d8a1ef55355 tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5849bd8-c431-4038-be67-bc0b50159c65 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:35 devstack sudo[107792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5849bd8-c431-4038-be67-bc0b50159c65 Aug 05 10:34:35 devstack sudo[107792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:35 devstack sudo[107792]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:35 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-bb526cfc-602b-4137-9cc9-2d8a1ef55355 tempest-ProjectMemberTests-188752871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5849bd8-c431-4038-be67-bc0b50159c65" returned: 0 in 0.417s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:35 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-bb526cfc-602b-4137-9cc9-2d8a1ef55355 tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5849bd8-c431-4038-be67-bc0b50159c65.9cbc97bd-d599-43c6-b007-70f80bdfaaca {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:35 devstack sudo[107797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5849bd8-c431-4038-be67-bc0b50159c65.9cbc97bd-d599-43c6-b007-70f80bdfaaca Aug 05 10:34:35 devstack sudo[107797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:35 devstack sudo[107797]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:35 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-bb526cfc-602b-4137-9cc9-2d8a1ef55355 tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5849bd8-c431-4038-be67-bc0b50159c65.9cbc97bd-d599-43c6-b007-70f80bdfaaca" returned: 0 in 0.362s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:35 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-bb526cfc-602b-4137-9cc9-2d8a1ef55355 tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5849bd8-c431-4038-be67-bc0b50159c65.9cbc97bd-d599-43c6-b007-70f80bdfaaca {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:35 devstack sudo[107802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5849bd8-c431-4038-be67-bc0b50159c65.9cbc97bd-d599-43c6-b007-70f80bdfaaca Aug 05 10:34:35 devstack sudo[107802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:36 devstack sudo[107802]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:36 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-bb526cfc-602b-4137-9cc9-2d8a1ef55355 tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5849bd8-c431-4038-be67-bc0b50159c65.9cbc97bd-d599-43c6-b007-70f80bdfaaca" returned: 0 in 0.268s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:36 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-bb526cfc-602b-4137-9cc9-2d8a1ef55355 tempest-ProjectMemberTests-188752871 None] Lock "cinder-quobyte-9cbc97bd-d599-43c6-b007-70f80bdfaaca" released by "_delete_snapshot" :: held 1.640s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:34:36 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-bb526cfc-602b-4137-9cc9-2d8a1ef55355 tempest-ProjectMemberTests-188752871 None] Lock "cinder-quobyte-e5849bd8-c431-4038-be67-bc0b50159c65" released by "delete_snapshot" :: held 1.668s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:34:36 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-bb526cfc-602b-4137-9cc9-2d8a1ef55355 tempest-ProjectMemberTests-188752871 None] Created reservations ['42504182-4f34-4586-9117-94baef006b0d', 'd7467cf5-a962-41bb-9427-d450fc09384c', '80eeb7a7-8890-4f3a-b303-6d322ae33a4b', '906caa04-af95-41de-b4ca-cfbb617b5e63'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:34:36 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-bb526cfc-602b-4137-9cc9-2d8a1ef55355 tempest-ProjectMemberTests-188752871 None] Delete snapshot completed successfully. Aug 05 10:34:36 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-bb526cfc-602b-4137-9cc9-2d8a1ef55355 tempest-ProjectMemberTests-188752871 None] Lock "cinder-9cbc97bd-d599-43c6-b007-70f80bdfaaca-delete_snapshot" released by "delete_snapshot" :: held 1.847s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:34:36 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-225e1ff6-04a3-4ca7-9d07-be9cf4690b61 tempest-ProjectMemberTests-188752871 None] Acquiring lock "cinder-e5849bd8-c431-4038-be67-bc0b50159c65-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:34:36 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-225e1ff6-04a3-4ca7-9d07-be9cf4690b61 tempest-ProjectMemberTests-188752871 None] Lock "cinder-e5849bd8-c431-4038-be67-bc0b50159c65-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:34:36 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-225e1ff6-04a3-4ca7-9d07-be9cf4690b61 tempest-ProjectMemberTests-188752871 None] Acquiring lock "cinder-quobyte-e5849bd8-c431-4038-be67-bc0b50159c65" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:34:36 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-225e1ff6-04a3-4ca7-9d07-be9cf4690b61 tempest-ProjectMemberTests-188752871 None] Lock "cinder-quobyte-e5849bd8-c431-4038-be67-bc0b50159c65" acquired by "delete_volume" :: waited 0.019s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:34:36 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a3d10c-366e-4e60-8dac-a60b878d1409]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:34:36 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-225e1ff6-04a3-4ca7-9d07-be9cf4690b61 tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5849bd8-c431-4038-be67-bc0b50159c65 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:36 devstack sudo[107805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5849bd8-c431-4038-be67-bc0b50159c65 Aug 05 10:34:36 devstack sudo[107805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:37 devstack sudo[107805]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-225e1ff6-04a3-4ca7-9d07-be9cf4690b61 tempest-ProjectMemberTests-188752871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5849bd8-c431-4038-be67-bc0b50159c65" returned: 0 in 0.384s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-225e1ff6-04a3-4ca7-9d07-be9cf4690b61 tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5849bd8-c431-4038-be67-bc0b50159c65 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:37 devstack sudo[107810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5849bd8-c431-4038-be67-bc0b50159c65 Aug 05 10:34:37 devstack sudo[107810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:37 devstack sudo[107810]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-225e1ff6-04a3-4ca7-9d07-be9cf4690b61 tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-e5849bd8-c431-4038-be67-bc0b50159c65" returned: 0 in 0.275s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:37 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-225e1ff6-04a3-4ca7-9d07-be9cf4690b61 tempest-ProjectMemberTests-188752871 None] Lock "cinder-quobyte-e5849bd8-c431-4038-be67-bc0b50159c65" released by "delete_volume" :: held 0.716s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:34:37 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-225e1ff6-04a3-4ca7-9d07-be9cf4690b61 tempest-ProjectMemberTests-188752871 None] Created reservations ['2e21f7a0-52c1-45e3-8961-8497af2ffd82', '1dabd69a-2c3e-487d-942b-da309d591882', '738ddbd8-fc23-4536-bb23-747e7edce781', 'c1781188-8771-44a0-92e2-ee66d8561272'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:34:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-225e1ff6-04a3-4ca7-9d07-be9cf4690b61 tempest-ProjectMemberTests-188752871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:34:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-225e1ff6-04a3-4ca7-9d07-be9cf4690b61 tempest-ProjectMemberTests-188752871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:34:37 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-225e1ff6-04a3-4ca7-9d07-be9cf4690b61 tempest-ProjectMemberTests-188752871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:34:37 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-225e1ff6-04a3-4ca7-9d07-be9cf4690b61 tempest-ProjectMemberTests-188752871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:34:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-225e1ff6-04a3-4ca7-9d07-be9cf4690b61 tempest-ProjectMemberTests-188752871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:34:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-225e1ff6-04a3-4ca7-9d07-be9cf4690b61 tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:37 devstack sudo[107813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:34:37 devstack sudo[107813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:37 devstack sudo[107813]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:37 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-225e1ff6-04a3-4ca7-9d07-be9cf4690b61 tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.255s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:37 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-225e1ff6-04a3-4ca7-9d07-be9cf4690b61 tempest-ProjectMemberTests-188752871 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:34:37 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-225e1ff6-04a3-4ca7-9d07-be9cf4690b61 tempest-ProjectMemberTests-188752871 None] Deleted volume successfully. Aug 05 10:34:37 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-225e1ff6-04a3-4ca7-9d07-be9cf4690b61 tempest-ProjectMemberTests-188752871 None] Lock "cinder-e5849bd8-c431-4038-be67-bc0b50159c65-delete_volume" released by "delete_volume" :: held 1.204s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:34:38 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-df97395e-6427-45c9-843d-92267d9d041e tempest-ProjectMemberTests-188752871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:34:38 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-df97395e-6427-45c9-843d-92267d9d041e tempest-ProjectMemberTests-188752871 None] Flow 'volume_create_manager' (90edcba4-c290-47b5-987f-727b68d9ec8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:34:38 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-df97395e-6427-45c9-843d-92267d9d041e tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9f0ee57-a23f-4f8b-96ef-a37c38c002c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:38 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-df97395e-6427-45c9-843d-92267d9d041e tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9f0ee57-a23f-4f8b-96ef-a37c38c002c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:34:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1027679707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8826103-6367-4d36-b64b-65f16e851fd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8da1a4df661e48a896791cae706d962d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:34:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:34:38Z,use_quota=True,user_id='7390514821a74358b20ac932df9a2ce2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:38 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-df97395e-6427-45c9-843d-92267d9d041e tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae6497f8-93b4-4103-9490-2987f841d4e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:38 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-df97395e-6427-45c9-843d-92267d9d041e tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae6497f8-93b4-4103-9490-2987f841d4e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:38 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-df97395e-6427-45c9-843d-92267d9d041e tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a7b7184-f684-42fa-b151-15cf79357561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:38 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-df97395e-6427-45c9-843d-92267d9d041e tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a7b7184-f684-42fa-b151-15cf79357561) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8826103-6367-4d36-b64b-65f16e851fd6', 'volume_name': 'volume-f8826103-6367-4d36-b64b-65f16e851fd6', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:38 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-df97395e-6427-45c9-843d-92267d9d041e tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8f95303-e798-42ef-8a41-c8b0854a5a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:38 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-df97395e-6427-45c9-843d-92267d9d041e tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8f95303-e798-42ef-8a41-c8b0854a5a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:38 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-df97395e-6427-45c9-843d-92267d9d041e tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (571f3283-2602-4d43-858f-45e5d6870bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:38 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-df97395e-6427-45c9-843d-92267d9d041e tempest-ProjectMemberTests-188752871 None] Volume f8826103-6367-4d36-b64b-65f16e851fd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8826103-6367-4d36-b64b-65f16e851fd6', 'volume_size': 1} Aug 05 10:34:38 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-df97395e-6427-45c9-843d-92267d9d041e tempest-ProjectMemberTests-188752871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:34:38 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-df97395e-6427-45c9-843d-92267d9d041e tempest-ProjectMemberTests-188752871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:34:38 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-df97395e-6427-45c9-843d-92267d9d041e tempest-ProjectMemberTests-188752871 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:34:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1027679707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8826103-6367-4d36-b64b-65f16e851fd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8da1a4df661e48a896791cae706d962d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:34:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:34:38Z,use_quota=True,user_id='7390514821a74358b20ac932df9a2ce2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:34:38 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-df97395e-6427-45c9-843d-92267d9d041e tempest-ProjectMemberTests-188752871 None] Creating volume f8826103-6367-4d36-b64b-65f16e851fd6 {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:34:38 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-df97395e-6427-45c9-843d-92267d9d041e tempest-ProjectMemberTests-188752871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:34:38 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-df97395e-6427-45c9-843d-92267d9d041e tempest-ProjectMemberTests-188752871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:34:38 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-df97395e-6427-45c9-843d-92267d9d041e tempest-ProjectMemberTests-188752871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:34:38 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-df97395e-6427-45c9-843d-92267d9d041e tempest-ProjectMemberTests-188752871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:34:38 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-df97395e-6427-45c9-843d-92267d9d041e tempest-ProjectMemberTests-188752871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:34:38 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-df97395e-6427-45c9-843d-92267d9d041e tempest-ProjectMemberTests-188752871 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:34:38 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-df97395e-6427-45c9-843d-92267d9d041e tempest-ProjectMemberTests-188752871 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:34:38 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-df97395e-6427-45c9-843d-92267d9d041e tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f8826103-6367-4d36-b64b-65f16e851fd6 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:38 devstack sudo[107816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f8826103-6367-4d36-b64b-65f16e851fd6 1073741824 Aug 05 10:34:38 devstack sudo[107816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:38 devstack sudo[107816]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:38 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-df97395e-6427-45c9-843d-92267d9d041e tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f8826103-6367-4d36-b64b-65f16e851fd6 1073741824" returned: 0 in 0.453s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:38 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-df97395e-6427-45c9-843d-92267d9d041e tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f8826103-6367-4d36-b64b-65f16e851fd6 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:38 devstack sudo[107822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f8826103-6367-4d36-b64b-65f16e851fd6 Aug 05 10:34:38 devstack sudo[107822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:39 devstack sudo[107822]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:39 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-df97395e-6427-45c9-843d-92267d9d041e tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f8826103-6367-4d36-b64b-65f16e851fd6" returned: 0 in 0.260s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:39 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-df97395e-6427-45c9-843d-92267d9d041e tempest-ProjectMemberTests-188752871 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:34:39 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-df97395e-6427-45c9-843d-92267d9d041e tempest-ProjectMemberTests-188752871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:34:39 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-df97395e-6427-45c9-843d-92267d9d041e tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (571f3283-2602-4d43-858f-45e5d6870bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8826103-6367-4d36-b64b-65f16e851fd6', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:39 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-df97395e-6427-45c9-843d-92267d9d041e tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53126e5b-b8dc-4a8a-8150-0c724eec52bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:39 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-df97395e-6427-45c9-843d-92267d9d041e tempest-ProjectMemberTests-188752871 None] Volume volume-f8826103-6367-4d36-b64b-65f16e851fd6 (f8826103-6367-4d36-b64b-65f16e851fd6): created successfully Aug 05 10:34:39 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-df97395e-6427-45c9-843d-92267d9d041e tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53126e5b-b8dc-4a8a-8150-0c724eec52bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:39 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-df97395e-6427-45c9-843d-92267d9d041e tempest-ProjectMemberTests-188752871 None] Flow 'volume_create_manager' (90edcba4-c290-47b5-987f-727b68d9ec8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:34:39 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-df97395e-6427-45c9-843d-92267d9d041e tempest-ProjectMemberTests-188752871 None] Created volume successfully. Aug 05 10:34:39 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-682e9837-e2a6-440a-bf48-4aa0a5e5c0af tempest-ProjectMemberTests-188752871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:34:39 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-682e9837-e2a6-440a-bf48-4aa0a5e5c0af tempest-ProjectMemberTests-188752871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:34:39 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-682e9837-e2a6-440a-bf48-4aa0a5e5c0af tempest-ProjectMemberTests-188752871 None] Creating offline snapshot 8c6cb267-3aca-4f28-be29-cd87ead48233 of volume f8826103-6367-4d36-b64b-65f16e851fd6 {{(pid=88613) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:34:39 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[c35f32c3-2c02-4981-b352-77b63bd4ddd6]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:34:39 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-682e9837-e2a6-440a-bf48-4aa0a5e5c0af tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f8826103-6367-4d36-b64b-65f16e851fd6 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:39 devstack sudo[107826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f8826103-6367-4d36-b64b-65f16e851fd6 Aug 05 10:34:39 devstack sudo[107826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:40 devstack sudo[107826]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:40 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-682e9837-e2a6-440a-bf48-4aa0a5e5c0af tempest-ProjectMemberTests-188752871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f8826103-6367-4d36-b64b-65f16e851fd6" returned: 0 in 0.390s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:40 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-682e9837-e2a6-440a-bf48-4aa0a5e5c0af tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f8826103-6367-4d36-b64b-65f16e851fd6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f8826103-6367-4d36-b64b-65f16e851fd6.8c6cb267-3aca-4f28-be29-cd87ead48233 1G {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:40 devstack sudo[107832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f8826103-6367-4d36-b64b-65f16e851fd6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f8826103-6367-4d36-b64b-65f16e851fd6.8c6cb267-3aca-4f28-be29-cd87ead48233 1G Aug 05 10:34:40 devstack sudo[107832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:40 devstack sudo[107832]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:40 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-682e9837-e2a6-440a-bf48-4aa0a5e5c0af tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f8826103-6367-4d36-b64b-65f16e851fd6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f8826103-6367-4d36-b64b-65f16e851fd6.8c6cb267-3aca-4f28-be29-cd87ead48233 1G" returned: 0 in 0.419s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:40 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-682e9837-e2a6-440a-bf48-4aa0a5e5c0af tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8826103-6367-4d36-b64b-65f16e851fd6 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f8826103-6367-4d36-b64b-65f16e851fd6.8c6cb267-3aca-4f28-be29-cd87ead48233 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:40 devstack sudo[107838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8826103-6367-4d36-b64b-65f16e851fd6 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f8826103-6367-4d36-b64b-65f16e851fd6.8c6cb267-3aca-4f28-be29-cd87ead48233 Aug 05 10:34:40 devstack sudo[107838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:40 devstack sudo[107838]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:40 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-682e9837-e2a6-440a-bf48-4aa0a5e5c0af tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8826103-6367-4d36-b64b-65f16e851fd6 -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f8826103-6367-4d36-b64b-65f16e851fd6.8c6cb267-3aca-4f28-be29-cd87ead48233" returned: 0 in 0.293s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:40 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-682e9837-e2a6-440a-bf48-4aa0a5e5c0af tempest-ProjectMemberTests-188752871 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f8826103-6367-4d36-b64b-65f16e851fd6.8c6cb267-3aca-4f28-be29-cd87ead48233 is being set with open permissions: ugo+rw Aug 05 10:34:40 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-682e9837-e2a6-440a-bf48-4aa0a5e5c0af tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f8826103-6367-4d36-b64b-65f16e851fd6.8c6cb267-3aca-4f28-be29-cd87ead48233 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:40 devstack sudo[107843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f8826103-6367-4d36-b64b-65f16e851fd6.8c6cb267-3aca-4f28-be29-cd87ead48233 Aug 05 10:34:40 devstack sudo[107843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:41 devstack sudo[107843]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:41 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-682e9837-e2a6-440a-bf48-4aa0a5e5c0af tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f8826103-6367-4d36-b64b-65f16e851fd6.8c6cb267-3aca-4f28-be29-cd87ead48233" returned: 0 in 0.259s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:41 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-682e9837-e2a6-440a-bf48-4aa0a5e5c0af tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f8826103-6367-4d36-b64b-65f16e851fd6.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:41 devstack sudo[107846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f8826103-6367-4d36-b64b-65f16e851fd6.info Aug 05 10:34:41 devstack sudo[107846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:41 devstack sudo[107846]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:41 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-682e9837-e2a6-440a-bf48-4aa0a5e5c0af tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f8826103-6367-4d36-b64b-65f16e851fd6.info" returned: 0 in 0.266s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:41 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-682e9837-e2a6-440a-bf48-4aa0a5e5c0af tempest-ProjectMemberTests-188752871 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f8826103-6367-4d36-b64b-65f16e851fd6.info is being set with open permissions: ugo+rw Aug 05 10:34:41 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-682e9837-e2a6-440a-bf48-4aa0a5e5c0af tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f8826103-6367-4d36-b64b-65f16e851fd6.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:41 devstack sudo[107849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f8826103-6367-4d36-b64b-65f16e851fd6.info Aug 05 10:34:41 devstack sudo[107849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:41 devstack sudo[107849]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:41 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-682e9837-e2a6-440a-bf48-4aa0a5e5c0af tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f8826103-6367-4d36-b64b-65f16e851fd6.info" returned: 0 in 0.270s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:41 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-682e9837-e2a6-440a-bf48-4aa0a5e5c0af tempest-ProjectMemberTests-188752871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.002s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:34:41 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-682e9837-e2a6-440a-bf48-4aa0a5e5c0af tempest-ProjectMemberTests-188752871 None] Create snapshot completed successfully Aug 05 10:34:42 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-88357022-fd08-4e17-8d19-62fc650935f8 tempest-ProjectMemberTests-188752871 None] Acquiring lock "cinder-8c6cb267-3aca-4f28-be29-cd87ead48233-delete_snapshot" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:34:42 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-88357022-fd08-4e17-8d19-62fc650935f8 tempest-ProjectMemberTests-188752871 None] Lock "cinder-8c6cb267-3aca-4f28-be29-cd87ead48233-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:34:42 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-88357022-fd08-4e17-8d19-62fc650935f8 tempest-ProjectMemberTests-188752871 None] Acquiring lock "cinder-quobyte-f8826103-6367-4d36-b64b-65f16e851fd6" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:34:42 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-88357022-fd08-4e17-8d19-62fc650935f8 tempest-ProjectMemberTests-188752871 None] Lock "cinder-quobyte-f8826103-6367-4d36-b64b-65f16e851fd6" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:34:42 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-88357022-fd08-4e17-8d19-62fc650935f8 tempest-ProjectMemberTests-188752871 None] Acquiring lock "cinder-quobyte-8c6cb267-3aca-4f28-be29-cd87ead48233" by "_delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:34:42 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-88357022-fd08-4e17-8d19-62fc650935f8 tempest-ProjectMemberTests-188752871 None] Lock "cinder-quobyte-8c6cb267-3aca-4f28-be29-cd87ead48233" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:34:42 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-88357022-fd08-4e17-8d19-62fc650935f8 tempest-ProjectMemberTests-188752871 None] Deleting offline snapshot 8c6cb267-3aca-4f28-be29-cd87ead48233 of volume f8826103-6367-4d36-b64b-65f16e851fd6 {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:34:42 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-88357022-fd08-4e17-8d19-62fc650935f8 tempest-ProjectMemberTests-188752871 None] snapshot_file for this snap is: volume-f8826103-6367-4d36-b64b-65f16e851fd6.8c6cb267-3aca-4f28-be29-cd87ead48233 {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:34:42 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[27fc9730-d35a-4abd-a814-854e91e29ec3]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:34:42 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-88357022-fd08-4e17-8d19-62fc650935f8 tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f8826103-6367-4d36-b64b-65f16e851fd6.8c6cb267-3aca-4f28-be29-cd87ead48233 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:43 devstack sudo[107852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f8826103-6367-4d36-b64b-65f16e851fd6.8c6cb267-3aca-4f28-be29-cd87ead48233 Aug 05 10:34:43 devstack sudo[107852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:43 devstack sudo[107852]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:43 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-88357022-fd08-4e17-8d19-62fc650935f8 tempest-ProjectMemberTests-188752871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f8826103-6367-4d36-b64b-65f16e851fd6.8c6cb267-3aca-4f28-be29-cd87ead48233" returned: 0 in 0.381s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:43 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-88357022-fd08-4e17-8d19-62fc650935f8 tempest-ProjectMemberTests-188752871 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8826103-6367-4d36-b64b-65f16e851fd6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88613) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:34:43 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ea6ad6-3d2f-4d10-9b6e-90c5857419c9]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:34:43 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-88357022-fd08-4e17-8d19-62fc650935f8 tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f8826103-6367-4d36-b64b-65f16e851fd6 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:43 devstack sudo[107857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f8826103-6367-4d36-b64b-65f16e851fd6 Aug 05 10:34:43 devstack sudo[107857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:43 devstack sudo[107857]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:43 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-88357022-fd08-4e17-8d19-62fc650935f8 tempest-ProjectMemberTests-188752871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f8826103-6367-4d36-b64b-65f16e851fd6" returned: 0 in 0.409s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:43 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-88357022-fd08-4e17-8d19-62fc650935f8 tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f8826103-6367-4d36-b64b-65f16e851fd6.8c6cb267-3aca-4f28-be29-cd87ead48233 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:43 devstack sudo[107863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f8826103-6367-4d36-b64b-65f16e851fd6.8c6cb267-3aca-4f28-be29-cd87ead48233 Aug 05 10:34:43 devstack sudo[107863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:44 devstack sudo[107863]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-88357022-fd08-4e17-8d19-62fc650935f8 tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f8826103-6367-4d36-b64b-65f16e851fd6.8c6cb267-3aca-4f28-be29-cd87ead48233" returned: 0 in 0.381s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-88357022-fd08-4e17-8d19-62fc650935f8 tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f8826103-6367-4d36-b64b-65f16e851fd6.8c6cb267-3aca-4f28-be29-cd87ead48233 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:44 devstack sudo[107868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f8826103-6367-4d36-b64b-65f16e851fd6.8c6cb267-3aca-4f28-be29-cd87ead48233 Aug 05 10:34:44 devstack sudo[107868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:44 devstack sudo[107868]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:44 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-88357022-fd08-4e17-8d19-62fc650935f8 tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f8826103-6367-4d36-b64b-65f16e851fd6.8c6cb267-3aca-4f28-be29-cd87ead48233" returned: 0 in 0.245s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:44 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-88357022-fd08-4e17-8d19-62fc650935f8 tempest-ProjectMemberTests-188752871 None] Lock "cinder-quobyte-8c6cb267-3aca-4f28-be29-cd87ead48233" released by "_delete_snapshot" :: held 1.519s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:34:44 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-88357022-fd08-4e17-8d19-62fc650935f8 tempest-ProjectMemberTests-188752871 None] Lock "cinder-quobyte-f8826103-6367-4d36-b64b-65f16e851fd6" released by "delete_snapshot" :: held 1.541s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:34:44 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-88357022-fd08-4e17-8d19-62fc650935f8 tempest-ProjectMemberTests-188752871 None] Created reservations ['d28a556f-785c-43a9-846e-ecd55908c64c', '47f98909-327b-456a-a06c-1b5701273d84', '79a49ddb-73e8-4ee7-ab0c-037da8e2334c', '0d763948-29c5-44e9-a26a-35aebfab1b27'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:34:44 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-88357022-fd08-4e17-8d19-62fc650935f8 tempest-ProjectMemberTests-188752871 None] Delete snapshot completed successfully. Aug 05 10:34:44 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-88357022-fd08-4e17-8d19-62fc650935f8 tempest-ProjectMemberTests-188752871 None] Lock "cinder-8c6cb267-3aca-4f28-be29-cd87ead48233-delete_snapshot" released by "delete_snapshot" :: held 1.705s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:34:44 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-0881376c-166f-4737-9e7d-d3b821cd4db4 tempest-ProjectMemberTests-188752871 None] Acquiring lock "cinder-f8826103-6367-4d36-b64b-65f16e851fd6-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:34:44 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-0881376c-166f-4737-9e7d-d3b821cd4db4 tempest-ProjectMemberTests-188752871 None] Lock "cinder-f8826103-6367-4d36-b64b-65f16e851fd6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:34:45 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-0881376c-166f-4737-9e7d-d3b821cd4db4 tempest-ProjectMemberTests-188752871 None] Acquiring lock "cinder-quobyte-f8826103-6367-4d36-b64b-65f16e851fd6" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:34:45 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-0881376c-166f-4737-9e7d-d3b821cd4db4 tempest-ProjectMemberTests-188752871 None] Lock "cinder-quobyte-f8826103-6367-4d36-b64b-65f16e851fd6" acquired by "delete_volume" :: waited 0.018s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:34:45 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[1992095e-4efb-4fba-8441-0f1cfaf67ff0]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:34:45 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-0881376c-166f-4737-9e7d-d3b821cd4db4 tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f8826103-6367-4d36-b64b-65f16e851fd6 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:45 devstack sudo[107872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f8826103-6367-4d36-b64b-65f16e851fd6 Aug 05 10:34:45 devstack sudo[107872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:45 devstack sudo[107872]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:45 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-0881376c-166f-4737-9e7d-d3b821cd4db4 tempest-ProjectMemberTests-188752871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f8826103-6367-4d36-b64b-65f16e851fd6" returned: 0 in 0.457s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:45 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-0881376c-166f-4737-9e7d-d3b821cd4db4 tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f8826103-6367-4d36-b64b-65f16e851fd6 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:45 devstack sudo[107878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f8826103-6367-4d36-b64b-65f16e851fd6 Aug 05 10:34:45 devstack sudo[107878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:45 devstack sudo[107878]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:45 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-0881376c-166f-4737-9e7d-d3b821cd4db4 tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-f8826103-6367-4d36-b64b-65f16e851fd6" returned: 0 in 0.323s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:45 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-0881376c-166f-4737-9e7d-d3b821cd4db4 tempest-ProjectMemberTests-188752871 None] Lock "cinder-quobyte-f8826103-6367-4d36-b64b-65f16e851fd6" released by "delete_volume" :: held 0.858s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:34:45 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-0881376c-166f-4737-9e7d-d3b821cd4db4 tempest-ProjectMemberTests-188752871 None] Created reservations ['178f6ad0-d10c-4dbd-b172-b34d77ef2b50', '32bb6ec0-4c2a-4972-84ee-8b39520b6578', '2fc43ed5-1190-4194-8e4d-1228bbc418a0', '01638682-6b43-4866-b846-f552247b6950'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:34:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-0881376c-166f-4737-9e7d-d3b821cd4db4 tempest-ProjectMemberTests-188752871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:34:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-0881376c-166f-4737-9e7d-d3b821cd4db4 tempest-ProjectMemberTests-188752871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:34:46 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-0881376c-166f-4737-9e7d-d3b821cd4db4 tempest-ProjectMemberTests-188752871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:34:46 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-0881376c-166f-4737-9e7d-d3b821cd4db4 tempest-ProjectMemberTests-188752871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:34:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-0881376c-166f-4737-9e7d-d3b821cd4db4 tempest-ProjectMemberTests-188752871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:34:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-0881376c-166f-4737-9e7d-d3b821cd4db4 tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:46 devstack sudo[107881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:34:46 devstack sudo[107881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:46 devstack sudo[107881]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-0881376c-166f-4737-9e7d-d3b821cd4db4 tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.248s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:46 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-0881376c-166f-4737-9e7d-d3b821cd4db4 tempest-ProjectMemberTests-188752871 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:34:46 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-0881376c-166f-4737-9e7d-d3b821cd4db4 tempest-ProjectMemberTests-188752871 None] Deleted volume successfully. Aug 05 10:34:46 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-0881376c-166f-4737-9e7d-d3b821cd4db4 tempest-ProjectMemberTests-188752871 None] Lock "cinder-f8826103-6367-4d36-b64b-65f16e851fd6-delete_volume" released by "delete_volume" :: held 1.343s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:34:46 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-416c1c3e-7805-4c50-83ca-81380e591202 tempest-SnapshotDependencyTests-331849871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:34:46 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-416c1c3e-7805-4c50-83ca-81380e591202 tempest-SnapshotDependencyTests-331849871 None] Flow 'volume_create_manager' (57db9e2f-43ea-4e92-9419-8091d7505a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:34:46 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-416c1c3e-7805-4c50-83ca-81380e591202 tempest-SnapshotDependencyTests-331849871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (761b7b02-fc30-499a-a3f4-5d6d1c6989d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:46 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-416c1c3e-7805-4c50-83ca-81380e591202 tempest-SnapshotDependencyTests-331849871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (761b7b02-fc30-499a-a3f4-5d6d1c6989d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:34:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1321096437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d738b02-4355-45ef-b9dc-c6d9aa1552cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='757cc11573f8422385abea75eead8583',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:34:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:34:47Z,use_quota=True,user_id='2f8f9f310b914dff8efd2b08c0f1e02b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:46 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-416c1c3e-7805-4c50-83ca-81380e591202 tempest-SnapshotDependencyTests-331849871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5145623-5f05-410a-af18-c7adfdea14ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:46 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-416c1c3e-7805-4c50-83ca-81380e591202 tempest-SnapshotDependencyTests-331849871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5145623-5f05-410a-af18-c7adfdea14ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:46 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-416c1c3e-7805-4c50-83ca-81380e591202 tempest-SnapshotDependencyTests-331849871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed83b996-6188-42ee-be5f-6afa5dce2e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:46 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-416c1c3e-7805-4c50-83ca-81380e591202 tempest-SnapshotDependencyTests-331849871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed83b996-6188-42ee-be5f-6afa5dce2e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d738b02-4355-45ef-b9dc-c6d9aa1552cb', 'volume_name': 'volume-8d738b02-4355-45ef-b9dc-c6d9aa1552cb', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:46 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-416c1c3e-7805-4c50-83ca-81380e591202 tempest-SnapshotDependencyTests-331849871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f6aabc7-ad83-477d-bba9-011669bbcc0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:46 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-416c1c3e-7805-4c50-83ca-81380e591202 tempest-SnapshotDependencyTests-331849871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f6aabc7-ad83-477d-bba9-011669bbcc0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:46 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-416c1c3e-7805-4c50-83ca-81380e591202 tempest-SnapshotDependencyTests-331849871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8006117a-aff3-47e4-86fb-724e8cf091b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:46 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-416c1c3e-7805-4c50-83ca-81380e591202 tempest-SnapshotDependencyTests-331849871 None] Volume 8d738b02-4355-45ef-b9dc-c6d9aa1552cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d738b02-4355-45ef-b9dc-c6d9aa1552cb', 'volume_size': 1} Aug 05 10:34:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-416c1c3e-7805-4c50-83ca-81380e591202 tempest-SnapshotDependencyTests-331849871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:34:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-416c1c3e-7805-4c50-83ca-81380e591202 tempest-SnapshotDependencyTests-331849871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:34:46 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-416c1c3e-7805-4c50-83ca-81380e591202 tempest-SnapshotDependencyTests-331849871 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:34:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1321096437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d738b02-4355-45ef-b9dc-c6d9aa1552cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='757cc11573f8422385abea75eead8583',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:34:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:34:47Z,use_quota=True,user_id='2f8f9f310b914dff8efd2b08c0f1e02b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:34:46 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-416c1c3e-7805-4c50-83ca-81380e591202 tempest-SnapshotDependencyTests-331849871 None] Creating volume 8d738b02-4355-45ef-b9dc-c6d9aa1552cb {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:34:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-416c1c3e-7805-4c50-83ca-81380e591202 tempest-SnapshotDependencyTests-331849871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:34:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-416c1c3e-7805-4c50-83ca-81380e591202 tempest-SnapshotDependencyTests-331849871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:34:46 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-416c1c3e-7805-4c50-83ca-81380e591202 tempest-SnapshotDependencyTests-331849871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:34:46 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-416c1c3e-7805-4c50-83ca-81380e591202 tempest-SnapshotDependencyTests-331849871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:34:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-416c1c3e-7805-4c50-83ca-81380e591202 tempest-SnapshotDependencyTests-331849871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:34:46 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-416c1c3e-7805-4c50-83ca-81380e591202 tempest-SnapshotDependencyTests-331849871 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:34:46 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-416c1c3e-7805-4c50-83ca-81380e591202 tempest-SnapshotDependencyTests-331849871 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:34:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-416c1c3e-7805-4c50-83ca-81380e591202 tempest-SnapshotDependencyTests-331849871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8d738b02-4355-45ef-b9dc-c6d9aa1552cb 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:46 devstack sudo[107884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8d738b02-4355-45ef-b9dc-c6d9aa1552cb 1073741824 Aug 05 10:34:46 devstack sudo[107884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:46 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-9353ff44-a378-4ffd-9ff2-d673499aa05b tempest-ProjectMemberTests-188752871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:34:46 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9353ff44-a378-4ffd-9ff2-d673499aa05b tempest-ProjectMemberTests-188752871 None] Flow 'volume_create_manager' (d192e73b-02b3-49da-89f7-c9651709b5cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:34:46 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9353ff44-a378-4ffd-9ff2-d673499aa05b tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a19ccb7-df0e-4927-b60e-218ff17e839b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:46 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9353ff44-a378-4ffd-9ff2-d673499aa05b tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a19ccb7-df0e-4927-b60e-218ff17e839b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:34:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1690298721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31c15518-96b6-4c6f-9e0c-97d9d70c73aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8da1a4df661e48a896791cae706d962d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:34:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:34:47Z,use_quota=True,user_id='7390514821a74358b20ac932df9a2ce2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:46 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9353ff44-a378-4ffd-9ff2-d673499aa05b tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85de107b-486f-4c9f-b21d-c91c30b7eeb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:46 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9353ff44-a378-4ffd-9ff2-d673499aa05b tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85de107b-486f-4c9f-b21d-c91c30b7eeb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:46 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9353ff44-a378-4ffd-9ff2-d673499aa05b tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e39c359-1559-49e3-9aca-04d0b409da22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:46 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9353ff44-a378-4ffd-9ff2-d673499aa05b tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e39c359-1559-49e3-9aca-04d0b409da22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31c15518-96b6-4c6f-9e0c-97d9d70c73aa', 'volume_name': 'volume-31c15518-96b6-4c6f-9e0c-97d9d70c73aa', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:46 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9353ff44-a378-4ffd-9ff2-d673499aa05b tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fa4ae36-4a1b-4ed3-a981-094494162968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:46 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9353ff44-a378-4ffd-9ff2-d673499aa05b tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fa4ae36-4a1b-4ed3-a981-094494162968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:46 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9353ff44-a378-4ffd-9ff2-d673499aa05b tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6244415-5106-44d8-8228-ee4777504067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:46 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-9353ff44-a378-4ffd-9ff2-d673499aa05b tempest-ProjectMemberTests-188752871 None] Volume 31c15518-96b6-4c6f-9e0c-97d9d70c73aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31c15518-96b6-4c6f-9e0c-97d9d70c73aa', 'volume_size': 1} Aug 05 10:34:46 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-9353ff44-a378-4ffd-9ff2-d673499aa05b tempest-ProjectMemberTests-188752871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:34:47 devstack sudo[107884]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:47 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-416c1c3e-7805-4c50-83ca-81380e591202 tempest-SnapshotDependencyTests-331849871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8d738b02-4355-45ef-b9dc-c6d9aa1552cb 1073741824" returned: 0 in 0.402s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:47 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-416c1c3e-7805-4c50-83ca-81380e591202 tempest-SnapshotDependencyTests-331849871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8d738b02-4355-45ef-b9dc-c6d9aa1552cb {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:47 devstack sudo[107889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8d738b02-4355-45ef-b9dc-c6d9aa1552cb Aug 05 10:34:47 devstack sudo[107889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:47 devstack sudo[107889]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:47 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-416c1c3e-7805-4c50-83ca-81380e591202 tempest-SnapshotDependencyTests-331849871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8d738b02-4355-45ef-b9dc-c6d9aa1552cb" returned: 0 in 0.245s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:47 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-416c1c3e-7805-4c50-83ca-81380e591202 tempest-SnapshotDependencyTests-331849871 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:34:47 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-416c1c3e-7805-4c50-83ca-81380e591202 tempest-SnapshotDependencyTests-331849871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:34:47 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-9353ff44-a378-4ffd-9ff2-d673499aa05b tempest-ProjectMemberTests-188752871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.568s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:34:47 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-9353ff44-a378-4ffd-9ff2-d673499aa05b tempest-ProjectMemberTests-188752871 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:34:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1690298721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31c15518-96b6-4c6f-9e0c-97d9d70c73aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8da1a4df661e48a896791cae706d962d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:34:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:34:47Z,use_quota=True,user_id='7390514821a74358b20ac932df9a2ce2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)}" {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:34:47 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-9353ff44-a378-4ffd-9ff2-d673499aa05b tempest-ProjectMemberTests-188752871 None] Creating volume 31c15518-96b6-4c6f-9e0c-97d9d70c73aa {{(pid=88613) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:34:47 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-9353ff44-a378-4ffd-9ff2-d673499aa05b tempest-ProjectMemberTests-188752871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:34:47 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-9353ff44-a378-4ffd-9ff2-d673499aa05b tempest-ProjectMemberTests-188752871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:34:47 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-9353ff44-a378-4ffd-9ff2-d673499aa05b tempest-ProjectMemberTests-188752871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:34:47 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-9353ff44-a378-4ffd-9ff2-d673499aa05b tempest-ProjectMemberTests-188752871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:34:47 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-9353ff44-a378-4ffd-9ff2-d673499aa05b tempest-ProjectMemberTests-188752871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:34:47 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-9353ff44-a378-4ffd-9ff2-d673499aa05b tempest-ProjectMemberTests-188752871 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:34:47 devstack cinder-volume[88613]: INFO cinder.volume.drivers.remotefs [None req-9353ff44-a378-4ffd-9ff2-d673499aa05b tempest-ProjectMemberTests-188752871 None] casted to osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 Aug 05 10:34:47 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9353ff44-a378-4ffd-9ff2-d673499aa05b tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-31c15518-96b6-4c6f-9e0c-97d9d70c73aa 1073741824 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:47 devstack sudo[107892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-31c15518-96b6-4c6f-9e0c-97d9d70c73aa 1073741824 Aug 05 10:34:47 devstack sudo[107892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:47 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-416c1c3e-7805-4c50-83ca-81380e591202 tempest-SnapshotDependencyTests-331849871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8006117a-aff3-47e4-86fb-724e8cf091b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d738b02-4355-45ef-b9dc-c6d9aa1552cb', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:47 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-416c1c3e-7805-4c50-83ca-81380e591202 tempest-SnapshotDependencyTests-331849871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (672009c0-bae7-47f0-9ed7-b465095fd707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:47 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-416c1c3e-7805-4c50-83ca-81380e591202 tempest-SnapshotDependencyTests-331849871 None] Volume volume-8d738b02-4355-45ef-b9dc-c6d9aa1552cb (8d738b02-4355-45ef-b9dc-c6d9aa1552cb): created successfully Aug 05 10:34:47 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-416c1c3e-7805-4c50-83ca-81380e591202 tempest-SnapshotDependencyTests-331849871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (672009c0-bae7-47f0-9ed7-b465095fd707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:47 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-416c1c3e-7805-4c50-83ca-81380e591202 tempest-SnapshotDependencyTests-331849871 None] Flow 'volume_create_manager' (57db9e2f-43ea-4e92-9419-8091d7505a17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:34:47 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-416c1c3e-7805-4c50-83ca-81380e591202 tempest-SnapshotDependencyTests-331849871 None] Created volume successfully. Aug 05 10:34:47 devstack sudo[107892]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:47 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9353ff44-a378-4ffd-9ff2-d673499aa05b tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-31c15518-96b6-4c6f-9e0c-97d9d70c73aa 1073741824" returned: 0 in 0.415s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:47 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9353ff44-a378-4ffd-9ff2-d673499aa05b tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-31c15518-96b6-4c6f-9e0c-97d9d70c73aa {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:47 devstack sudo[107898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-31c15518-96b6-4c6f-9e0c-97d9d70c73aa Aug 05 10:34:47 devstack sudo[107898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:48 devstack sudo[107898]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:48 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-9353ff44-a378-4ffd-9ff2-d673499aa05b tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-31c15518-96b6-4c6f-9e0c-97d9d70c73aa" returned: 0 in 0.249s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:48 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-9353ff44-a378-4ffd-9ff2-d673499aa05b tempest-ProjectMemberTests-188752871 None] <== create_volume: return (706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'} {{(pid=88613) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:34:48 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-9353ff44-a378-4ffd-9ff2-d673499aa05b tempest-ProjectMemberTests-188752871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.709s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:34:48 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9353ff44-a378-4ffd-9ff2-d673499aa05b tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6244415-5106-44d8-8228-ee4777504067) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31c15518-96b6-4c6f-9e0c-97d9d70c73aa', 'volume_size': 1}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:48 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9353ff44-a378-4ffd-9ff2-d673499aa05b tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f039e9d9-bd07-4642-864d-9e3759130e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:48 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-9353ff44-a378-4ffd-9ff2-d673499aa05b tempest-ProjectMemberTests-188752871 None] Volume volume-31c15518-96b6-4c6f-9e0c-97d9d70c73aa (31c15518-96b6-4c6f-9e0c-97d9d70c73aa): created successfully Aug 05 10:34:48 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9353ff44-a378-4ffd-9ff2-d673499aa05b tempest-ProjectMemberTests-188752871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f039e9d9-bd07-4642-864d-9e3759130e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:48 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-9353ff44-a378-4ffd-9ff2-d673499aa05b tempest-ProjectMemberTests-188752871 None] Flow 'volume_create_manager' (d192e73b-02b3-49da-89f7-c9651709b5cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:34:48 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-9353ff44-a378-4ffd-9ff2-d673499aa05b tempest-ProjectMemberTests-188752871 None] Created volume successfully. Aug 05 10:34:48 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-aae43bd3-2e12-4124-8534-cefa25a1bb9d tempest-ProjectMemberTests-188752871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:34:48 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-aae43bd3-2e12-4124-8534-cefa25a1bb9d tempest-ProjectMemberTests-188752871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:34:48 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-aae43bd3-2e12-4124-8534-cefa25a1bb9d tempest-ProjectMemberTests-188752871 None] Creating offline snapshot 6f6572d1-f077-4a96-bbdc-2485d2cc25cb of volume 31c15518-96b6-4c6f-9e0c-97d9d70c73aa {{(pid=88613) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:34:48 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2af12a-93c4-40f5-82e6-19072af450fc]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:34:48 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-aae43bd3-2e12-4124-8534-cefa25a1bb9d tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-31c15518-96b6-4c6f-9e0c-97d9d70c73aa {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:48 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-b9bbfe97-64d8-4e2b-9349-7af056d813eb tempest-SnapshotDependencyTests-331849871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:34:49 devstack sudo[107901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-31c15518-96b6-4c6f-9e0c-97d9d70c73aa Aug 05 10:34:49 devstack sudo[107901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:49 devstack sudo[107901]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-aae43bd3-2e12-4124-8534-cefa25a1bb9d tempest-ProjectMemberTests-188752871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-31c15518-96b6-4c6f-9e0c-97d9d70c73aa" returned: 0 in 0.349s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-aae43bd3-2e12-4124-8534-cefa25a1bb9d tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-31c15518-96b6-4c6f-9e0c-97d9d70c73aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-31c15518-96b6-4c6f-9e0c-97d9d70c73aa.6f6572d1-f077-4a96-bbdc-2485d2cc25cb 1G {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:49 devstack sudo[107906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-31c15518-96b6-4c6f-9e0c-97d9d70c73aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-31c15518-96b6-4c6f-9e0c-97d9d70c73aa.6f6572d1-f077-4a96-bbdc-2485d2cc25cb 1G Aug 05 10:34:49 devstack sudo[107906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:49 devstack sudo[107906]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-aae43bd3-2e12-4124-8534-cefa25a1bb9d tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-31c15518-96b6-4c6f-9e0c-97d9d70c73aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-31c15518-96b6-4c6f-9e0c-97d9d70c73aa.6f6572d1-f077-4a96-bbdc-2485d2cc25cb 1G" returned: 0 in 0.393s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-aae43bd3-2e12-4124-8534-cefa25a1bb9d tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31c15518-96b6-4c6f-9e0c-97d9d70c73aa -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-31c15518-96b6-4c6f-9e0c-97d9d70c73aa.6f6572d1-f077-4a96-bbdc-2485d2cc25cb {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:49 devstack sudo[107911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31c15518-96b6-4c6f-9e0c-97d9d70c73aa -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-31c15518-96b6-4c6f-9e0c-97d9d70c73aa.6f6572d1-f077-4a96-bbdc-2485d2cc25cb Aug 05 10:34:49 devstack sudo[107911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:49 devstack sudo[107911]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-aae43bd3-2e12-4124-8534-cefa25a1bb9d tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31c15518-96b6-4c6f-9e0c-97d9d70c73aa -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-31c15518-96b6-4c6f-9e0c-97d9d70c73aa.6f6572d1-f077-4a96-bbdc-2485d2cc25cb" returned: 0 in 0.299s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:49 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-aae43bd3-2e12-4124-8534-cefa25a1bb9d tempest-ProjectMemberTests-188752871 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-31c15518-96b6-4c6f-9e0c-97d9d70c73aa.6f6572d1-f077-4a96-bbdc-2485d2cc25cb is being set with open permissions: ugo+rw Aug 05 10:34:49 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-aae43bd3-2e12-4124-8534-cefa25a1bb9d tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-31c15518-96b6-4c6f-9e0c-97d9d70c73aa.6f6572d1-f077-4a96-bbdc-2485d2cc25cb {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:49 devstack sudo[107917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-31c15518-96b6-4c6f-9e0c-97d9d70c73aa.6f6572d1-f077-4a96-bbdc-2485d2cc25cb Aug 05 10:34:49 devstack sudo[107917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:50 devstack sudo[107917]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-aae43bd3-2e12-4124-8534-cefa25a1bb9d tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-31c15518-96b6-4c6f-9e0c-97d9d70c73aa.6f6572d1-f077-4a96-bbdc-2485d2cc25cb" returned: 0 in 0.249s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-aae43bd3-2e12-4124-8534-cefa25a1bb9d tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-31c15518-96b6-4c6f-9e0c-97d9d70c73aa.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:50 devstack sudo[107920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-31c15518-96b6-4c6f-9e0c-97d9d70c73aa.info Aug 05 10:34:50 devstack sudo[107920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:50 devstack sudo[107920]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-aae43bd3-2e12-4124-8534-cefa25a1bb9d tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-31c15518-96b6-4c6f-9e0c-97d9d70c73aa.info" returned: 0 in 0.246s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:50 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-aae43bd3-2e12-4124-8534-cefa25a1bb9d tempest-ProjectMemberTests-188752871 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-31c15518-96b6-4c6f-9e0c-97d9d70c73aa.info is being set with open permissions: ugo+rw Aug 05 10:34:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-aae43bd3-2e12-4124-8534-cefa25a1bb9d tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-31c15518-96b6-4c6f-9e0c-97d9d70c73aa.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:50 devstack sudo[107923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-31c15518-96b6-4c6f-9e0c-97d9d70c73aa.info Aug 05 10:34:50 devstack sudo[107923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:50 devstack sudo[107923]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-aae43bd3-2e12-4124-8534-cefa25a1bb9d tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-31c15518-96b6-4c6f-9e0c-97d9d70c73aa.info" returned: 0 in 0.236s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-aae43bd3-2e12-4124-8534-cefa25a1bb9d tempest-ProjectMemberTests-188752871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.858s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:34:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-b9bbfe97-64d8-4e2b-9349-7af056d813eb tempest-SnapshotDependencyTests-331849871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.787s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:34:50 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-b9bbfe97-64d8-4e2b-9349-7af056d813eb tempest-SnapshotDependencyTests-331849871 None] Creating offline snapshot 239a221e-f8ae-4903-ad9e-4593ee5c90f4 of volume 8d738b02-4355-45ef-b9dc-c6d9aa1552cb {{(pid=88613) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:34:50 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[66aac3ad-1b34-47c0-9af0-fcc421833ecf]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:34:50 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b9bbfe97-64d8-4e2b-9349-7af056d813eb tempest-SnapshotDependencyTests-331849871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8d738b02-4355-45ef-b9dc-c6d9aa1552cb {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:50 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-aae43bd3-2e12-4124-8534-cefa25a1bb9d tempest-ProjectMemberTests-188752871 None] Create snapshot completed successfully Aug 05 10:34:50 devstack sudo[107926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8d738b02-4355-45ef-b9dc-c6d9aa1552cb Aug 05 10:34:50 devstack sudo[107926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:51 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-26680416-18be-4e3e-b893-2ef8c322378a tempest-ProjectMemberTests-188752871 None] Acquiring lock "cinder-6f6572d1-f077-4a96-bbdc-2485d2cc25cb-delete_snapshot" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:34:51 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-26680416-18be-4e3e-b893-2ef8c322378a tempest-ProjectMemberTests-188752871 None] Lock "cinder-6f6572d1-f077-4a96-bbdc-2485d2cc25cb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:34:51 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-26680416-18be-4e3e-b893-2ef8c322378a tempest-ProjectMemberTests-188752871 None] Acquiring lock "cinder-quobyte-31c15518-96b6-4c6f-9e0c-97d9d70c73aa" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:34:51 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-26680416-18be-4e3e-b893-2ef8c322378a tempest-ProjectMemberTests-188752871 None] Lock "cinder-quobyte-31c15518-96b6-4c6f-9e0c-97d9d70c73aa" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:34:51 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-26680416-18be-4e3e-b893-2ef8c322378a tempest-ProjectMemberTests-188752871 None] Acquiring lock "cinder-quobyte-6f6572d1-f077-4a96-bbdc-2485d2cc25cb" by "_delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:34:51 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-26680416-18be-4e3e-b893-2ef8c322378a tempest-ProjectMemberTests-188752871 None] Lock "cinder-quobyte-6f6572d1-f077-4a96-bbdc-2485d2cc25cb" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:34:51 devstack sudo[107926]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:51 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-26680416-18be-4e3e-b893-2ef8c322378a tempest-ProjectMemberTests-188752871 None] Deleting offline snapshot 6f6572d1-f077-4a96-bbdc-2485d2cc25cb of volume 31c15518-96b6-4c6f-9e0c-97d9d70c73aa {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:34:51 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-26680416-18be-4e3e-b893-2ef8c322378a tempest-ProjectMemberTests-188752871 None] snapshot_file for this snap is: volume-31c15518-96b6-4c6f-9e0c-97d9d70c73aa.6f6572d1-f077-4a96-bbdc-2485d2cc25cb {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:34:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b9bbfe97-64d8-4e2b-9349-7af056d813eb tempest-SnapshotDependencyTests-331849871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8d738b02-4355-45ef-b9dc-c6d9aa1552cb" returned: 0 in 0.417s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b9bbfe97-64d8-4e2b-9349-7af056d813eb tempest-SnapshotDependencyTests-331849871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8d738b02-4355-45ef-b9dc-c6d9aa1552cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8d738b02-4355-45ef-b9dc-c6d9aa1552cb.239a221e-f8ae-4903-ad9e-4593ee5c90f4 1G {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:51 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[626ee3ca-ba0b-486a-81de-1d2610fcb20c]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:34:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-26680416-18be-4e3e-b893-2ef8c322378a tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-31c15518-96b6-4c6f-9e0c-97d9d70c73aa.6f6572d1-f077-4a96-bbdc-2485d2cc25cb {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:51 devstack sudo[107931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8d738b02-4355-45ef-b9dc-c6d9aa1552cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8d738b02-4355-45ef-b9dc-c6d9aa1552cb.239a221e-f8ae-4903-ad9e-4593ee5c90f4 1G Aug 05 10:34:51 devstack sudo[107931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:51 devstack sudo[107932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-31c15518-96b6-4c6f-9e0c-97d9d70c73aa.6f6572d1-f077-4a96-bbdc-2485d2cc25cb Aug 05 10:34:51 devstack sudo[107932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:51 devstack sudo[107932]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-26680416-18be-4e3e-b893-2ef8c322378a tempest-ProjectMemberTests-188752871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-31c15518-96b6-4c6f-9e0c-97d9d70c73aa.6f6572d1-f077-4a96-bbdc-2485d2cc25cb" returned: 0 in 0.361s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:51 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-26680416-18be-4e3e-b893-2ef8c322378a tempest-ProjectMemberTests-188752871 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31c15518-96b6-4c6f-9e0c-97d9d70c73aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88613) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:34:51 devstack sudo[107931]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b9bbfe97-64d8-4e2b-9349-7af056d813eb tempest-SnapshotDependencyTests-331849871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8d738b02-4355-45ef-b9dc-c6d9aa1552cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8d738b02-4355-45ef-b9dc-c6d9aa1552cb.239a221e-f8ae-4903-ad9e-4593ee5c90f4 1G" returned: 0 in 0.392s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b9bbfe97-64d8-4e2b-9349-7af056d813eb tempest-SnapshotDependencyTests-331849871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d738b02-4355-45ef-b9dc-c6d9aa1552cb -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8d738b02-4355-45ef-b9dc-c6d9aa1552cb.239a221e-f8ae-4903-ad9e-4593ee5c90f4 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:51 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5943dc-28b9-4033-8a75-92f4b887b100]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:34:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-26680416-18be-4e3e-b893-2ef8c322378a tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-31c15518-96b6-4c6f-9e0c-97d9d70c73aa {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:51 devstack sudo[107942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d738b02-4355-45ef-b9dc-c6d9aa1552cb -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8d738b02-4355-45ef-b9dc-c6d9aa1552cb.239a221e-f8ae-4903-ad9e-4593ee5c90f4 Aug 05 10:34:51 devstack sudo[107942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:51 devstack sudo[107943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-31c15518-96b6-4c6f-9e0c-97d9d70c73aa Aug 05 10:34:51 devstack sudo[107943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:51 devstack sudo[107942]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b9bbfe97-64d8-4e2b-9349-7af056d813eb tempest-SnapshotDependencyTests-331849871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d738b02-4355-45ef-b9dc-c6d9aa1552cb -F qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8d738b02-4355-45ef-b9dc-c6d9aa1552cb.239a221e-f8ae-4903-ad9e-4593ee5c90f4" returned: 0 in 0.277s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:51 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-b9bbfe97-64d8-4e2b-9349-7af056d813eb tempest-SnapshotDependencyTests-331849871 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8d738b02-4355-45ef-b9dc-c6d9aa1552cb.239a221e-f8ae-4903-ad9e-4593ee5c90f4 is being set with open permissions: ugo+rw Aug 05 10:34:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b9bbfe97-64d8-4e2b-9349-7af056d813eb tempest-SnapshotDependencyTests-331849871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8d738b02-4355-45ef-b9dc-c6d9aa1552cb.239a221e-f8ae-4903-ad9e-4593ee5c90f4 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:51 devstack sudo[107949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8d738b02-4355-45ef-b9dc-c6d9aa1552cb.239a221e-f8ae-4903-ad9e-4593ee5c90f4 Aug 05 10:34:51 devstack sudo[107949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:51 devstack sudo[107943]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-26680416-18be-4e3e-b893-2ef8c322378a tempest-ProjectMemberTests-188752871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-31c15518-96b6-4c6f-9e0c-97d9d70c73aa" returned: 0 in 0.367s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:51 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-26680416-18be-4e3e-b893-2ef8c322378a tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-31c15518-96b6-4c6f-9e0c-97d9d70c73aa.6f6572d1-f077-4a96-bbdc-2485d2cc25cb {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:51 devstack sudo[107954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-31c15518-96b6-4c6f-9e0c-97d9d70c73aa.6f6572d1-f077-4a96-bbdc-2485d2cc25cb Aug 05 10:34:51 devstack sudo[107954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:52 devstack sudo[107949]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b9bbfe97-64d8-4e2b-9349-7af056d813eb tempest-SnapshotDependencyTests-331849871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8d738b02-4355-45ef-b9dc-c6d9aa1552cb.239a221e-f8ae-4903-ad9e-4593ee5c90f4" returned: 0 in 0.259s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b9bbfe97-64d8-4e2b-9349-7af056d813eb tempest-SnapshotDependencyTests-331849871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8d738b02-4355-45ef-b9dc-c6d9aa1552cb.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:52 devstack sudo[107957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8d738b02-4355-45ef-b9dc-c6d9aa1552cb.info Aug 05 10:34:52 devstack sudo[107957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:52 devstack sudo[107954]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-26680416-18be-4e3e-b893-2ef8c322378a tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-31c15518-96b6-4c6f-9e0c-97d9d70c73aa.6f6572d1-f077-4a96-bbdc-2485d2cc25cb" returned: 0 in 0.358s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-26680416-18be-4e3e-b893-2ef8c322378a tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-31c15518-96b6-4c6f-9e0c-97d9d70c73aa.6f6572d1-f077-4a96-bbdc-2485d2cc25cb {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:52 devstack sudo[107962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-31c15518-96b6-4c6f-9e0c-97d9d70c73aa.6f6572d1-f077-4a96-bbdc-2485d2cc25cb Aug 05 10:34:52 devstack sudo[107962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:52 devstack sudo[107957]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b9bbfe97-64d8-4e2b-9349-7af056d813eb tempest-SnapshotDependencyTests-331849871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8d738b02-4355-45ef-b9dc-c6d9aa1552cb.info" returned: 0 in 0.250s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:52 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-b9bbfe97-64d8-4e2b-9349-7af056d813eb tempest-SnapshotDependencyTests-331849871 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8d738b02-4355-45ef-b9dc-c6d9aa1552cb.info is being set with open permissions: ugo+rw Aug 05 10:34:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b9bbfe97-64d8-4e2b-9349-7af056d813eb tempest-SnapshotDependencyTests-331849871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8d738b02-4355-45ef-b9dc-c6d9aa1552cb.info {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:52 devstack sudo[107965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8d738b02-4355-45ef-b9dc-c6d9aa1552cb.info Aug 05 10:34:52 devstack sudo[107965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:52 devstack sudo[107962]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-26680416-18be-4e3e-b893-2ef8c322378a tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-31c15518-96b6-4c6f-9e0c-97d9d70c73aa.6f6572d1-f077-4a96-bbdc-2485d2cc25cb" returned: 0 in 0.262s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:52 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-26680416-18be-4e3e-b893-2ef8c322378a tempest-ProjectMemberTests-188752871 None] Lock "cinder-quobyte-6f6572d1-f077-4a96-bbdc-2485d2cc25cb" released by "_delete_snapshot" :: held 1.450s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:34:52 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-26680416-18be-4e3e-b893-2ef8c322378a tempest-ProjectMemberTests-188752871 None] Lock "cinder-quobyte-31c15518-96b6-4c6f-9e0c-97d9d70c73aa" released by "delete_snapshot" :: held 1.475s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:34:52 devstack sudo[107965]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b9bbfe97-64d8-4e2b-9349-7af056d813eb tempest-SnapshotDependencyTests-331849871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8d738b02-4355-45ef-b9dc-c6d9aa1552cb.info" returned: 0 in 0.257s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:52 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-b9bbfe97-64d8-4e2b-9349-7af056d813eb tempest-SnapshotDependencyTests-331849871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.944s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:34:52 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-26680416-18be-4e3e-b893-2ef8c322378a tempest-ProjectMemberTests-188752871 None] Created reservations ['c34a39a4-f3bd-4c5c-a033-a8258eaace7d', '47830da5-f4e9-41f5-ba05-6f6c8f7c7625', '67615ea5-d01c-4b86-a810-ca3b77818d1e', '3c5179a4-ec63-4ec4-9a12-6c750a7e9eef'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:34:52 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-b9bbfe97-64d8-4e2b-9349-7af056d813eb tempest-SnapshotDependencyTests-331849871 None] Create snapshot completed successfully Aug 05 10:34:52 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-26680416-18be-4e3e-b893-2ef8c322378a tempest-ProjectMemberTests-188752871 None] Delete snapshot completed successfully. Aug 05 10:34:52 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-26680416-18be-4e3e-b893-2ef8c322378a tempest-ProjectMemberTests-188752871 None] Lock "cinder-6f6572d1-f077-4a96-bbdc-2485d2cc25cb-delete_snapshot" released by "delete_snapshot" :: held 1.636s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:34:53 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d07f6cb1-5943-46a6-8ef0-afbdd458f6db tempest-ProjectMemberTests-188752871 None] Acquiring lock "cinder-31c15518-96b6-4c6f-9e0c-97d9d70c73aa-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:34:53 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d07f6cb1-5943-46a6-8ef0-afbdd458f6db tempest-ProjectMemberTests-188752871 None] Lock "cinder-31c15518-96b6-4c6f-9e0c-97d9d70c73aa-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:34:53 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d07f6cb1-5943-46a6-8ef0-afbdd458f6db tempest-ProjectMemberTests-188752871 None] Acquiring lock "cinder-quobyte-31c15518-96b6-4c6f-9e0c-97d9d70c73aa" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:34:53 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d07f6cb1-5943-46a6-8ef0-afbdd458f6db tempest-ProjectMemberTests-188752871 None] Lock "cinder-quobyte-31c15518-96b6-4c6f-9e0c-97d9d70c73aa" acquired by "delete_volume" :: waited 0.020s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:34:53 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[874c4879-0b82-4336-ae09-67f8bc81c836]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:34:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d07f6cb1-5943-46a6-8ef0-afbdd458f6db tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-31c15518-96b6-4c6f-9e0c-97d9d70c73aa {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:53 devstack sudo[107969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-31c15518-96b6-4c6f-9e0c-97d9d70c73aa Aug 05 10:34:53 devstack sudo[107969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:53 devstack cinder-volume[88613]: DEBUG cinder.volume.flows.manager.create_volume [None req-c262e511-2a55-48f4-9735-2f449ca07014 tempest-SnapshotDependencyTests-331849871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88613) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:34:53 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c262e511-2a55-48f4-9735-2f449ca07014 tempest-SnapshotDependencyTests-331849871 None] Flow 'volume_create_manager' (b0286775-3729-4451-aa3a-d35ae4178e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:34:53 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c262e511-2a55-48f4-9735-2f449ca07014 tempest-SnapshotDependencyTests-331849871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fc676cd-5a5f-447c-9a60-19b867aeb597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:53 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c262e511-2a55-48f4-9735-2f449ca07014 tempest-SnapshotDependencyTests-331849871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fc676cd-5a5f-447c-9a60-19b867aeb597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:34:53Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08eb9a09-9e1b-4fea-8088-7f6f700a4a4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='757cc11573f8422385abea75eead8583',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:34:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=239a221e-f8ae-4903-ad9e-4593ee5c90f4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:34:54Z,use_quota=True,user_id='2f8f9f310b914dff8efd2b08c0f1e02b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41),volume_type_id=02d0a29c-f8c7-4fa4-b4c8-32d4ac578c41)' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:53 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c262e511-2a55-48f4-9735-2f449ca07014 tempest-SnapshotDependencyTests-331849871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a2d0a13-2ae3-4ccb-8093-1ff2fadbb5ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:53 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c262e511-2a55-48f4-9735-2f449ca07014 tempest-SnapshotDependencyTests-331849871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a2d0a13-2ae3-4ccb-8093-1ff2fadbb5ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:53 devstack sudo[107969]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:53 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c262e511-2a55-48f4-9735-2f449ca07014 tempest-SnapshotDependencyTests-331849871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83f7d2c6-dde2-40bb-909c-5a11902dd460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:53 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c262e511-2a55-48f4-9735-2f449ca07014 tempest-SnapshotDependencyTests-331849871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83f7d2c6-dde2-40bb-909c-5a11902dd460) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '08eb9a09-9e1b-4fea-8088-7f6f700a4a4f', 'volume_name': 'volume-08eb9a09-9e1b-4fea-8088-7f6f700a4a4f', 'volume_size': 1, 'snapshot_id': '239a221e-f8ae-4903-ad9e-4593ee5c90f4'}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:53 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c262e511-2a55-48f4-9735-2f449ca07014 tempest-SnapshotDependencyTests-331849871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7710b6f1-c4f0-4f01-ba7f-a413b8ce5d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:53 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c262e511-2a55-48f4-9735-2f449ca07014 tempest-SnapshotDependencyTests-331849871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7710b6f1-c4f0-4f01-ba7f-a413b8ce5d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:53 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c262e511-2a55-48f4-9735-2f449ca07014 tempest-SnapshotDependencyTests-331849871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23f42331-fdf3-44ac-9098-d852013c5f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:53 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-c262e511-2a55-48f4-9735-2f449ca07014 tempest-SnapshotDependencyTests-331849871 None] Volume 08eb9a09-9e1b-4fea-8088-7f6f700a4a4f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-08eb9a09-9e1b-4fea-8088-7f6f700a4a4f', 'volume_size': 1, 'snapshot_id': '239a221e-f8ae-4903-ad9e-4593ee5c90f4'} Aug 05 10:34:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d07f6cb1-5943-46a6-8ef0-afbdd458f6db tempest-ProjectMemberTests-188752871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-31c15518-96b6-4c6f-9e0c-97d9d70c73aa" returned: 0 in 0.430s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d07f6cb1-5943-46a6-8ef0-afbdd458f6db tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-31c15518-96b6-4c6f-9e0c-97d9d70c73aa {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c262e511-2a55-48f4-9735-2f449ca07014 tempest-SnapshotDependencyTests-331849871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:34:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c262e511-2a55-48f4-9735-2f449ca07014 tempest-SnapshotDependencyTests-331849871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:34:53 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-c262e511-2a55-48f4-9735-2f449ca07014 tempest-SnapshotDependencyTests-331849871 None] Acquiring lock "cinder-quobyte-239a221e-f8ae-4903-ad9e-4593ee5c90f4-08eb9a09-9e1b-4fea-8088-7f6f700a4a4f" by "_create_volume_from_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:34:53 devstack sudo[107974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-31c15518-96b6-4c6f-9e0c-97d9d70c73aa Aug 05 10:34:53 devstack sudo[107974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:53 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-c262e511-2a55-48f4-9735-2f449ca07014 tempest-SnapshotDependencyTests-331849871 None] Lock "cinder-quobyte-239a221e-f8ae-4903-ad9e-4593ee5c90f4-08eb9a09-9e1b-4fea-8088-7f6f700a4a4f" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:34:53 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-c262e511-2a55-48f4-9735-2f449ca07014 tempest-SnapshotDependencyTests-331849871 None] Creating volume 08eb9a09-9e1b-4fea-8088-7f6f700a4a4f from snapshot 239a221e-f8ae-4903-ad9e-4593ee5c90f4 {{(pid=88613) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 05 10:34:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c262e511-2a55-48f4-9735-2f449ca07014 tempest-SnapshotDependencyTests-331849871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:34:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c262e511-2a55-48f4-9735-2f449ca07014 tempest-SnapshotDependencyTests-331849871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:34:53 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-c262e511-2a55-48f4-9735-2f449ca07014 tempest-SnapshotDependencyTests-331849871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:34:53 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-c262e511-2a55-48f4-9735-2f449ca07014 tempest-SnapshotDependencyTests-331849871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:34:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c262e511-2a55-48f4-9735-2f449ca07014 tempest-SnapshotDependencyTests-331849871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:34:53 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-c262e511-2a55-48f4-9735-2f449ca07014 tempest-SnapshotDependencyTests-331849871 None] Selected osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1 as target Quobyte volume. {{(pid=88613) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:34:53 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-c262e511-2a55-48f4-9735-2f449ca07014 tempest-SnapshotDependencyTests-331849871 None] Acquiring lock "cinder-quobyte-08eb9a09-9e1b-4fea-8088-7f6f700a4a4f" by "_copy_volume_from_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:34:53 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-c262e511-2a55-48f4-9735-2f449ca07014 tempest-SnapshotDependencyTests-331849871 None] Lock "cinder-quobyte-08eb9a09-9e1b-4fea-8088-7f6f700a4a4f" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:34:53 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-c262e511-2a55-48f4-9735-2f449ca07014 tempest-SnapshotDependencyTests-331849871 None] snapshot: 239a221e-f8ae-4903-ad9e-4593ee5c90f4, volume: 08eb9a09-9e1b-4fea-8088-7f6f700a4a4f, {{(pid=88613) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 05 10:34:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c262e511-2a55-48f4-9735-2f449ca07014 tempest-SnapshotDependencyTests-331849871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:34:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c262e511-2a55-48f4-9735-2f449ca07014 tempest-SnapshotDependencyTests-331849871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:34:53 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-c262e511-2a55-48f4-9735-2f449ca07014 tempest-SnapshotDependencyTests-331849871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:34:53 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-c262e511-2a55-48f4-9735-2f449ca07014 tempest-SnapshotDependencyTests-331849871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:34:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c262e511-2a55-48f4-9735-2f449ca07014 tempest-SnapshotDependencyTests-331849871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:34:53 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e32504-9683-4255-a943-3c7d466d8a8c]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:34:53 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c262e511-2a55-48f4-9735-2f449ca07014 tempest-SnapshotDependencyTests-331849871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8d738b02-4355-45ef-b9dc-c6d9aa1552cb.239a221e-f8ae-4903-ad9e-4593ee5c90f4 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:54 devstack sudo[107976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8d738b02-4355-45ef-b9dc-c6d9aa1552cb.239a221e-f8ae-4903-ad9e-4593ee5c90f4 Aug 05 10:34:54 devstack sudo[107976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:54 devstack sudo[107974]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d07f6cb1-5943-46a6-8ef0-afbdd458f6db tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-31c15518-96b6-4c6f-9e0c-97d9d70c73aa" returned: 0 in 0.275s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:54 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d07f6cb1-5943-46a6-8ef0-afbdd458f6db tempest-ProjectMemberTests-188752871 None] Lock "cinder-quobyte-31c15518-96b6-4c6f-9e0c-97d9d70c73aa" released by "delete_volume" :: held 0.765s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:34:54 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-d07f6cb1-5943-46a6-8ef0-afbdd458f6db tempest-ProjectMemberTests-188752871 None] Created reservations ['142d2b1c-b4d4-4b21-bc65-a6e22b97a419', 'be3fbfbe-01af-43ff-837a-765580384268', 'b614f021-fd40-4068-81c3-1d65d9957760', 'ff8889d8-6bd3-4bab-908c-dd8d58f0bf9c'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:34:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-d07f6cb1-5943-46a6-8ef0-afbdd458f6db tempest-ProjectMemberTests-188752871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:34:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-d07f6cb1-5943-46a6-8ef0-afbdd458f6db tempest-ProjectMemberTests-188752871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:34:54 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-d07f6cb1-5943-46a6-8ef0-afbdd458f6db tempest-ProjectMemberTests-188752871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:34:54 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-d07f6cb1-5943-46a6-8ef0-afbdd458f6db tempest-ProjectMemberTests-188752871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:34:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-d07f6cb1-5943-46a6-8ef0-afbdd458f6db tempest-ProjectMemberTests-188752871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:34:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d07f6cb1-5943-46a6-8ef0-afbdd458f6db tempest-ProjectMemberTests-188752871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:54 devstack sudo[107979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:34:54 devstack sudo[107979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:54 devstack sudo[107976]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c262e511-2a55-48f4-9735-2f449ca07014 tempest-SnapshotDependencyTests-331849871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8d738b02-4355-45ef-b9dc-c6d9aa1552cb.239a221e-f8ae-4903-ad9e-4593ee5c90f4" returned: 0 in 0.360s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:54 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-c262e511-2a55-48f4-9735-2f449ca07014 tempest-SnapshotDependencyTests-331849871 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d738b02-4355-45ef-b9dc-c6d9aa1552cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88613) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:34:54 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[71cfce08-0899-4409-9b83-35955f0e93fd]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:34:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c262e511-2a55-48f4-9735-2f449ca07014 tempest-SnapshotDependencyTests-331849871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8d738b02-4355-45ef-b9dc-c6d9aa1552cb {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:54 devstack sudo[107985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8d738b02-4355-45ef-b9dc-c6d9aa1552cb Aug 05 10:34:54 devstack sudo[107985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:54 devstack sudo[107979]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-d07f6cb1-5943-46a6-8ef0-afbdd458f6db tempest-ProjectMemberTests-188752871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.270s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:54 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-d07f6cb1-5943-46a6-8ef0-afbdd458f6db tempest-ProjectMemberTests-188752871 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:34:54 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-d07f6cb1-5943-46a6-8ef0-afbdd458f6db tempest-ProjectMemberTests-188752871 None] Deleted volume successfully. Aug 05 10:34:54 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-d07f6cb1-5943-46a6-8ef0-afbdd458f6db tempest-ProjectMemberTests-188752871 None] Lock "cinder-31c15518-96b6-4c6f-9e0c-97d9d70c73aa-delete_volume" released by "delete_volume" :: held 1.252s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:34:54 devstack sudo[107985]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c262e511-2a55-48f4-9735-2f449ca07014 tempest-SnapshotDependencyTests-331849871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8d738b02-4355-45ef-b9dc-c6d9aa1552cb" returned: 0 in 0.423s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:54 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-c262e511-2a55-48f4-9735-2f449ca07014 tempest-SnapshotDependencyTests-331849871 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8d738b02-4355-45ef-b9dc-c6d9aa1552cb {{(pid=88613) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 05 10:34:54 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-c262e511-2a55-48f4-9735-2f449ca07014 tempest-SnapshotDependencyTests-331849871 None] Creating direct copy from snapshot {{(pid=88613) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 05 10:34:54 devstack cinder-volume[88613]: DEBUG cinder.utils [None req-c262e511-2a55-48f4-9735-2f449ca07014 tempest-SnapshotDependencyTests-331849871 None] Path /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-08eb9a09-9e1b-4fea-8088-7f6f700a4a4f not found in is_blk_device check {{(pid=88613) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 05 10:34:54 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c262e511-2a55-48f4-9735-2f449ca07014 tempest-SnapshotDependencyTests-331849871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8d738b02-4355-45ef-b9dc-c6d9aa1552cb /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-08eb9a09-9e1b-4fea-8088-7f6f700a4a4f {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:54 devstack sudo[107991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8d738b02-4355-45ef-b9dc-c6d9aa1552cb /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-08eb9a09-9e1b-4fea-8088-7f6f700a4a4f Aug 05 10:34:54 devstack sudo[107991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:59 devstack sudo[107991]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c262e511-2a55-48f4-9735-2f449ca07014 tempest-SnapshotDependencyTests-331849871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8d738b02-4355-45ef-b9dc-c6d9aa1552cb /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-08eb9a09-9e1b-4fea-8088-7f6f700a4a4f" returned: 0 in 4.843s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:59 devstack cinder-volume[88613]: DEBUG cinder.image.image_utils [None req-c262e511-2a55-48f4-9735-2f449ca07014 tempest-SnapshotDependencyTests-331849871 None] Image conversion details: src /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8d738b02-4355-45ef-b9dc-c6d9aa1552cb, size 1024.00 MB, duration 4.85 sec, destination /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-08eb9a09-9e1b-4fea-8088-7f6f700a4a4f {{(pid=88613) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 10:34:59 devstack cinder-volume[88613]: INFO cinder.image.image_utils [None req-c262e511-2a55-48f4-9735-2f449ca07014 tempest-SnapshotDependencyTests-331849871 None] Converted 1024.00 MB image at 211.33 MB/s Aug 05 10:34:59 devstack cinder-volume[88613]: WARNING cinder.volume.drivers.remotefs [None req-c262e511-2a55-48f4-9735-2f449ca07014 tempest-SnapshotDependencyTests-331849871 None] /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-08eb9a09-9e1b-4fea-8088-7f6f700a4a4f is being set with open permissions: ugo+rw Aug 05 10:34:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c262e511-2a55-48f4-9735-2f449ca07014 tempest-SnapshotDependencyTests-331849871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-08eb9a09-9e1b-4fea-8088-7f6f700a4a4f {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:59 devstack sudo[108005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-08eb9a09-9e1b-4fea-8088-7f6f700a4a4f Aug 05 10:34:59 devstack sudo[108005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:59 devstack sudo[108005]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-c262e511-2a55-48f4-9735-2f449ca07014 tempest-SnapshotDependencyTests-331849871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-08eb9a09-9e1b-4fea-8088-7f6f700a4a4f" returned: 0 in 0.243s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:59 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-c262e511-2a55-48f4-9735-2f449ca07014 tempest-SnapshotDependencyTests-331849871 None] Lock "cinder-quobyte-08eb9a09-9e1b-4fea-8088-7f6f700a4a4f" released by "_copy_volume_from_snapshot" :: held 5.972s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:34:59 devstack cinder-volume[88613]: DEBUG dbcounter [-] [88613] Writing DB stats cinder:SELECT=123,cinder:INSERT=42,cinder:DELETE=12,cinder:UPDATE=176 {{(pid=88613) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:34:59 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-c262e511-2a55-48f4-9735-2f449ca07014 tempest-SnapshotDependencyTests-331849871 None] Lock "cinder-quobyte-239a221e-f8ae-4903-ad9e-4593ee5c90f4-08eb9a09-9e1b-4fea-8088-7f6f700a4a4f" released by "_create_volume_from_snapshot" :: held 6.043s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:34:59 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-c262e511-2a55-48f4-9735-2f449ca07014 tempest-SnapshotDependencyTests-331849871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.068s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:34:59 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c262e511-2a55-48f4-9735-2f449ca07014 tempest-SnapshotDependencyTests-331849871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23f42331-fdf3-44ac-9098-d852013c5f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08eb9a09-9e1b-4fea-8088-7f6f700a4a4f', 'volume_size': 1, 'snapshot_id': '239a221e-f8ae-4903-ad9e-4593ee5c90f4'}' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:59 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c262e511-2a55-48f4-9735-2f449ca07014 tempest-SnapshotDependencyTests-331849871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ac66a2e-b8b2-443c-80d6-2cf1827bc8a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:59 devstack cinder-volume[88613]: INFO cinder.volume.flows.manager.create_volume [None req-c262e511-2a55-48f4-9735-2f449ca07014 tempest-SnapshotDependencyTests-331849871 None] Volume volume-08eb9a09-9e1b-4fea-8088-7f6f700a4a4f (08eb9a09-9e1b-4fea-8088-7f6f700a4a4f): created successfully Aug 05 10:34:59 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c262e511-2a55-48f4-9735-2f449ca07014 tempest-SnapshotDependencyTests-331849871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ac66a2e-b8b2-443c-80d6-2cf1827bc8a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88613) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:59 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-c262e511-2a55-48f4-9735-2f449ca07014 tempest-SnapshotDependencyTests-331849871 None] Flow 'volume_create_manager' (b0286775-3729-4451-aa3a-d35ae4178e7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88613) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:34:59 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-c262e511-2a55-48f4-9735-2f449ca07014 tempest-SnapshotDependencyTests-331849871 None] Created volume successfully. Aug 05 10:35:00 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e3c21b8f-c7be-41a5-8196-2c88a9091d8b tempest-SnapshotDependencyTests-331849871 None] Acquiring lock "cinder-239a221e-f8ae-4903-ad9e-4593ee5c90f4-delete_snapshot" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:35:00 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e3c21b8f-c7be-41a5-8196-2c88a9091d8b tempest-SnapshotDependencyTests-331849871 None] Lock "cinder-239a221e-f8ae-4903-ad9e-4593ee5c90f4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:35:00 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e3c21b8f-c7be-41a5-8196-2c88a9091d8b tempest-SnapshotDependencyTests-331849871 None] Acquiring lock "cinder-quobyte-8d738b02-4355-45ef-b9dc-c6d9aa1552cb" by "delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:35:00 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e3c21b8f-c7be-41a5-8196-2c88a9091d8b tempest-SnapshotDependencyTests-331849871 None] Lock "cinder-quobyte-8d738b02-4355-45ef-b9dc-c6d9aa1552cb" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:35:00 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e3c21b8f-c7be-41a5-8196-2c88a9091d8b tempest-SnapshotDependencyTests-331849871 None] Acquiring lock "cinder-quobyte-239a221e-f8ae-4903-ad9e-4593ee5c90f4" by "_delete_snapshot" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:35:00 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e3c21b8f-c7be-41a5-8196-2c88a9091d8b tempest-SnapshotDependencyTests-331849871 None] Lock "cinder-quobyte-239a221e-f8ae-4903-ad9e-4593ee5c90f4" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:35:00 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-e3c21b8f-c7be-41a5-8196-2c88a9091d8b tempest-SnapshotDependencyTests-331849871 None] Deleting offline snapshot 239a221e-f8ae-4903-ad9e-4593ee5c90f4 of volume 8d738b02-4355-45ef-b9dc-c6d9aa1552cb {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:35:00 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-e3c21b8f-c7be-41a5-8196-2c88a9091d8b tempest-SnapshotDependencyTests-331849871 None] snapshot_file for this snap is: volume-8d738b02-4355-45ef-b9dc-c6d9aa1552cb.239a221e-f8ae-4903-ad9e-4593ee5c90f4 {{(pid=88613) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:35:00 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[4052cb5a-ad0d-48f7-a2f3-bd2d584b08e2]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:35:00 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e3c21b8f-c7be-41a5-8196-2c88a9091d8b tempest-SnapshotDependencyTests-331849871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8d738b02-4355-45ef-b9dc-c6d9aa1552cb.239a221e-f8ae-4903-ad9e-4593ee5c90f4 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:35:00 devstack sudo[108008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8d738b02-4355-45ef-b9dc-c6d9aa1552cb.239a221e-f8ae-4903-ad9e-4593ee5c90f4 Aug 05 10:35:00 devstack sudo[108008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:35:00 devstack sudo[108008]: pam_unix(sudo:session): session closed for user root Aug 05 10:35:00 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e3c21b8f-c7be-41a5-8196-2c88a9091d8b tempest-SnapshotDependencyTests-331849871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8d738b02-4355-45ef-b9dc-c6d9aa1552cb.239a221e-f8ae-4903-ad9e-4593ee5c90f4" returned: 0 in 0.402s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:35:00 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.remotefs [None req-e3c21b8f-c7be-41a5-8196-2c88a9091d8b tempest-SnapshotDependencyTests-331849871 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d738b02-4355-45ef-b9dc-c6d9aa1552cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88613) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:35:00 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[173df866-e3f9-41b2-a082-36f28f1fe354]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:35:00 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e3c21b8f-c7be-41a5-8196-2c88a9091d8b tempest-SnapshotDependencyTests-331849871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8d738b02-4355-45ef-b9dc-c6d9aa1552cb {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:35:01 devstack sudo[108013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8d738b02-4355-45ef-b9dc-c6d9aa1552cb Aug 05 10:35:01 devstack sudo[108013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:35:01 devstack sudo[108013]: pam_unix(sudo:session): session closed for user root Aug 05 10:35:01 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e3c21b8f-c7be-41a5-8196-2c88a9091d8b tempest-SnapshotDependencyTests-331849871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8d738b02-4355-45ef-b9dc-c6d9aa1552cb" returned: 0 in 0.537s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:35:01 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e3c21b8f-c7be-41a5-8196-2c88a9091d8b tempest-SnapshotDependencyTests-331849871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8d738b02-4355-45ef-b9dc-c6d9aa1552cb.239a221e-f8ae-4903-ad9e-4593ee5c90f4 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:35:01 devstack sudo[108018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8d738b02-4355-45ef-b9dc-c6d9aa1552cb.239a221e-f8ae-4903-ad9e-4593ee5c90f4 Aug 05 10:35:01 devstack sudo[108018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:35:01 devstack sudo[108018]: pam_unix(sudo:session): session closed for user root Aug 05 10:35:01 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e3c21b8f-c7be-41a5-8196-2c88a9091d8b tempest-SnapshotDependencyTests-331849871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8d738b02-4355-45ef-b9dc-c6d9aa1552cb.239a221e-f8ae-4903-ad9e-4593ee5c90f4" returned: 0 in 0.360s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:35:01 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e3c21b8f-c7be-41a5-8196-2c88a9091d8b tempest-SnapshotDependencyTests-331849871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8d738b02-4355-45ef-b9dc-c6d9aa1552cb.239a221e-f8ae-4903-ad9e-4593ee5c90f4 {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:35:01 devstack sudo[108063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8d738b02-4355-45ef-b9dc-c6d9aa1552cb.239a221e-f8ae-4903-ad9e-4593ee5c90f4 Aug 05 10:35:01 devstack sudo[108063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:35:02 devstack sudo[108063]: pam_unix(sudo:session): session closed for user root Aug 05 10:35:02 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-e3c21b8f-c7be-41a5-8196-2c88a9091d8b tempest-SnapshotDependencyTests-331849871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8d738b02-4355-45ef-b9dc-c6d9aa1552cb.239a221e-f8ae-4903-ad9e-4593ee5c90f4" returned: 0 in 0.277s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:35:02 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e3c21b8f-c7be-41a5-8196-2c88a9091d8b tempest-SnapshotDependencyTests-331849871 None] Lock "cinder-quobyte-239a221e-f8ae-4903-ad9e-4593ee5c90f4" released by "_delete_snapshot" :: held 1.692s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:35:02 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e3c21b8f-c7be-41a5-8196-2c88a9091d8b tempest-SnapshotDependencyTests-331849871 None] Lock "cinder-quobyte-8d738b02-4355-45ef-b9dc-c6d9aa1552cb" released by "delete_snapshot" :: held 1.720s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:35:02 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-e3c21b8f-c7be-41a5-8196-2c88a9091d8b tempest-SnapshotDependencyTests-331849871 None] Created reservations ['0b866f22-fcf3-4797-a5dd-d22c50a3a1f3', 'f6e92b42-fdc1-4ba5-a2f5-5fd62fe0ec45', '39eb45a0-a257-46f3-a03f-7bd3ad7807a6', 'b5e5fa8d-69cd-4d33-b231-a9921a5561bf'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:35:02 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-e3c21b8f-c7be-41a5-8196-2c88a9091d8b tempest-SnapshotDependencyTests-331849871 None] Delete snapshot completed successfully. Aug 05 10:35:02 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-e3c21b8f-c7be-41a5-8196-2c88a9091d8b tempest-SnapshotDependencyTests-331849871 None] Lock "cinder-239a221e-f8ae-4903-ad9e-4593ee5c90f4-delete_snapshot" released by "delete_snapshot" :: held 1.880s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:35:02 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-6a5de0a0-2a1e-466a-98f3-d5dbe582645d tempest-SnapshotDependencyTests-331849871 None] Acquiring lock "cinder-8d738b02-4355-45ef-b9dc-c6d9aa1552cb-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:35:02 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-6a5de0a0-2a1e-466a-98f3-d5dbe582645d tempest-SnapshotDependencyTests-331849871 None] Lock "cinder-8d738b02-4355-45ef-b9dc-c6d9aa1552cb-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:35:02 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-6a5de0a0-2a1e-466a-98f3-d5dbe582645d tempest-SnapshotDependencyTests-331849871 None] Acquiring lock "cinder-quobyte-8d738b02-4355-45ef-b9dc-c6d9aa1552cb" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:35:02 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-6a5de0a0-2a1e-466a-98f3-d5dbe582645d tempest-SnapshotDependencyTests-331849871 None] Lock "cinder-quobyte-8d738b02-4355-45ef-b9dc-c6d9aa1552cb" acquired by "delete_volume" :: waited 0.023s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:35:02 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af3c3d5-025c-4c9f-b1fa-6bccbbad4f40]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:35:02 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6a5de0a0-2a1e-466a-98f3-d5dbe582645d tempest-SnapshotDependencyTests-331849871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8d738b02-4355-45ef-b9dc-c6d9aa1552cb {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:35:02 devstack sudo[108066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8d738b02-4355-45ef-b9dc-c6d9aa1552cb Aug 05 10:35:02 devstack sudo[108066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:35:03 devstack sudo[108066]: pam_unix(sudo:session): session closed for user root Aug 05 10:35:03 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6a5de0a0-2a1e-466a-98f3-d5dbe582645d tempest-SnapshotDependencyTests-331849871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8d738b02-4355-45ef-b9dc-c6d9aa1552cb" returned: 0 in 0.379s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:35:03 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6a5de0a0-2a1e-466a-98f3-d5dbe582645d tempest-SnapshotDependencyTests-331849871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8d738b02-4355-45ef-b9dc-c6d9aa1552cb {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:35:03 devstack sudo[108071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8d738b02-4355-45ef-b9dc-c6d9aa1552cb Aug 05 10:35:03 devstack sudo[108071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:35:03 devstack sudo[108071]: pam_unix(sudo:session): session closed for user root Aug 05 10:35:03 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6a5de0a0-2a1e-466a-98f3-d5dbe582645d tempest-SnapshotDependencyTests-331849871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-8d738b02-4355-45ef-b9dc-c6d9aa1552cb" returned: 0 in 0.250s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:35:03 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-6a5de0a0-2a1e-466a-98f3-d5dbe582645d tempest-SnapshotDependencyTests-331849871 None] Lock "cinder-quobyte-8d738b02-4355-45ef-b9dc-c6d9aa1552cb" released by "delete_volume" :: held 0.696s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:35:03 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-6a5de0a0-2a1e-466a-98f3-d5dbe582645d tempest-SnapshotDependencyTests-331849871 None] Created reservations ['84b771c4-4201-4091-80a3-273b72971f3c', 'dda6a0d3-bd66-4f56-afe3-07f7399eeadc', '47813bb7-c556-4080-8b7a-0fcf02c7d4a1', '4c698014-806d-42b1-aecf-e0d1d4af84f7'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:35:03 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-6a5de0a0-2a1e-466a-98f3-d5dbe582645d tempest-SnapshotDependencyTests-331849871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:35:03 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-6a5de0a0-2a1e-466a-98f3-d5dbe582645d tempest-SnapshotDependencyTests-331849871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:35:03 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-6a5de0a0-2a1e-466a-98f3-d5dbe582645d tempest-SnapshotDependencyTests-331849871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:35:03 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-6a5de0a0-2a1e-466a-98f3-d5dbe582645d tempest-SnapshotDependencyTests-331849871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:35:03 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-6a5de0a0-2a1e-466a-98f3-d5dbe582645d tempest-SnapshotDependencyTests-331849871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:35:03 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6a5de0a0-2a1e-466a-98f3-d5dbe582645d tempest-SnapshotDependencyTests-331849871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:35:03 devstack sudo[108074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:35:03 devstack sudo[108074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:35:03 devstack sudo[108074]: pam_unix(sudo:session): session closed for user root Aug 05 10:35:03 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-6a5de0a0-2a1e-466a-98f3-d5dbe582645d tempest-SnapshotDependencyTests-331849871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.245s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:35:03 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-6a5de0a0-2a1e-466a-98f3-d5dbe582645d tempest-SnapshotDependencyTests-331849871 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:35:03 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-6a5de0a0-2a1e-466a-98f3-d5dbe582645d tempest-SnapshotDependencyTests-331849871 None] Deleted volume successfully. Aug 05 10:35:03 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-6a5de0a0-2a1e-466a-98f3-d5dbe582645d tempest-SnapshotDependencyTests-331849871 None] Lock "cinder-8d738b02-4355-45ef-b9dc-c6d9aa1552cb-delete_volume" released by "delete_volume" :: held 1.143s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:35:03 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-b4f91f88-d68b-4246-aa0f-0bdcea418b9f tempest-SnapshotDependencyTests-331849871 None] Acquiring lock "cinder-08eb9a09-9e1b-4fea-8088-7f6f700a4a4f-delete_volume" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:35:03 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-b4f91f88-d68b-4246-aa0f-0bdcea418b9f tempest-SnapshotDependencyTests-331849871 None] Lock "cinder-08eb9a09-9e1b-4fea-8088-7f6f700a4a4f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:35:03 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-b4f91f88-d68b-4246-aa0f-0bdcea418b9f tempest-SnapshotDependencyTests-331849871 None] Acquiring lock "cinder-quobyte-08eb9a09-9e1b-4fea-8088-7f6f700a4a4f" by "delete_volume" {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:35:03 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-b4f91f88-d68b-4246-aa0f-0bdcea418b9f tempest-SnapshotDependencyTests-331849871 None] Lock "cinder-quobyte-08eb9a09-9e1b-4fea-8088-7f6f700a4a4f" acquired by "delete_volume" :: waited 0.020s {{(pid=88613) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:35:03 devstack cinder-volume[88613]: DEBUG oslo.privsep.daemon [-] privsep: reply[b04538f4-e78e-4ae1-ad97-8fb7186d1b8d]: (4, 'qcow2') {{(pid=89803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:35:03 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b4f91f88-d68b-4246-aa0f-0bdcea418b9f tempest-SnapshotDependencyTests-331849871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-08eb9a09-9e1b-4fea-8088-7f6f700a4a4f {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:35:04 devstack sudo[108077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-08eb9a09-9e1b-4fea-8088-7f6f700a4a4f Aug 05 10:35:04 devstack sudo[108077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:35:04 devstack sudo[108077]: pam_unix(sudo:session): session closed for user root Aug 05 10:35:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b4f91f88-d68b-4246-aa0f-0bdcea418b9f tempest-SnapshotDependencyTests-331849871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-08eb9a09-9e1b-4fea-8088-7f6f700a4a4f" returned: 0 in 0.374s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:35:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b4f91f88-d68b-4246-aa0f-0bdcea418b9f tempest-SnapshotDependencyTests-331849871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-08eb9a09-9e1b-4fea-8088-7f6f700a4a4f {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:35:04 devstack sudo[108083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-08eb9a09-9e1b-4fea-8088-7f6f700a4a4f Aug 05 10:35:04 devstack sudo[108083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:35:04 devstack sudo[108083]: pam_unix(sudo:session): session closed for user root Aug 05 10:35:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b4f91f88-d68b-4246-aa0f-0bdcea418b9f tempest-SnapshotDependencyTests-331849871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde/volume-08eb9a09-9e1b-4fea-8088-7f6f700a4a4f" returned: 0 in 0.249s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:35:04 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-b4f91f88-d68b-4246-aa0f-0bdcea418b9f tempest-SnapshotDependencyTests-331849871 None] Lock "cinder-quobyte-08eb9a09-9e1b-4fea-8088-7f6f700a4a4f" released by "delete_volume" :: held 0.674s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:35:04 devstack cinder-volume[88613]: DEBUG cinder.quota [None req-b4f91f88-d68b-4246-aa0f-0bdcea418b9f tempest-SnapshotDependencyTests-331849871 None] Created reservations ['e6dcf1ef-09c7-4ba0-9805-884320954981', '19975324-92d5-43d4-8e63-d070d42cc903', '9e84aedb-0e16-4331-b267-4a55cec04879', '6539239c-3983-4f86-a188-b5e15552aeb6'] {{(pid=88613) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:35:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-b4f91f88-d68b-4246-aa0f-0bdcea418b9f tempest-SnapshotDependencyTests-331849871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:35:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-b4f91f88-d68b-4246-aa0f-0bdcea418b9f tempest-SnapshotDependencyTests-331849871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:35:04 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-b4f91f88-d68b-4246-aa0f-0bdcea418b9f tempest-SnapshotDependencyTests-331849871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:35:04 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-b4f91f88-d68b-4246-aa0f-0bdcea418b9f tempest-SnapshotDependencyTests-331849871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:35:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-b4f91f88-d68b-4246-aa0f-0bdcea418b9f tempest-SnapshotDependencyTests-331849871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:35:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b4f91f88-d68b-4246-aa0f-0bdcea418b9f tempest-SnapshotDependencyTests-331849871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:35:04 devstack sudo[108086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:35:04 devstack sudo[108086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:35:04 devstack sudo[108086]: pam_unix(sudo:session): session closed for user root Aug 05 10:35:04 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-b4f91f88-d68b-4246-aa0f-0bdcea418b9f tempest-SnapshotDependencyTests-331849871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.262s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:35:04 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-b4f91f88-d68b-4246-aa0f-0bdcea418b9f tempest-SnapshotDependencyTests-331849871 None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:35:04 devstack cinder-volume[88613]: INFO cinder.volume.manager [None req-b4f91f88-d68b-4246-aa0f-0bdcea418b9f tempest-SnapshotDependencyTests-331849871 None] Deleted volume successfully. Aug 05 10:35:05 devstack cinder-volume[88613]: DEBUG cinder.coordination [None req-b4f91f88-d68b-4246-aa0f-0bdcea418b9f tempest-SnapshotDependencyTests-331849871 None] Lock "cinder-08eb9a09-9e1b-4fea-8088-7f6f700a4a4f-delete_volume" released by "delete_volume" :: held 1.177s {{(pid=88613) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:35:14 devstack cinder-volume[88613]: DEBUG dbcounter [-] [88613] Writing DB stats cinder:UPDATE=23,cinder:DELETE=2,cinder:SELECT=15,cinder:INSERT=3 {{(pid=88613) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:35:14 devstack cinder-volume[88613]: DEBUG dbcounter [-] [88613] Writing DB stats cinder:UPDATE=80,cinder:SELECT=68,cinder:INSERT=29,cinder:DELETE=6 {{(pid=88613) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:35:21 devstack cinder-volume[88613]: DEBUG oslo_service.periodic_task [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88613) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:35:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:35:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:35:21 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1': None} {{(pid=88613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:35:21 devstack cinder-volume[88613]: DEBUG cinder.volume.drivers.quobyte [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-393c97cf-8fe0-4fd4-95a4-58b47043eda1'] {{(pid=88613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:35:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.lockutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88613) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:35:21 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:35:21 devstack sudo[108109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde Aug 05 10:35:21 devstack sudo[108109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:35:22 devstack sudo[108109]: pam_unix(sudo:session): session closed for user root Aug 05 10:35:22 devstack cinder-volume[88613]: DEBUG oslo_concurrency.processutils [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4386248c03f5dd63f0110359c541bde" returned: 0 in 0.237s {{(pid=88613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:35:22 devstack cinder-volume[88613]: DEBUG cinder.manager [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Notifying Schedulers of capabilities ... {{(pid=88613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:35:22 devstack cinder-volume[88613]: DEBUG oslo_service.periodic_task [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] Running periodic task VolumeManager._thread_info {{(pid=88613) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:35:22 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] thread count: 29 {{(pid=88613) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 10:35:22 devstack cinder-volume[88613]: DEBUG cinder.volume.manager [None req-02b96b49-49ca-4e68-bddc-7e3106707776 None None] thread info: [<_MainThread(MainThread, started 126173666128000)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88613) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}